I think I remember some weirdness when I had a similar rule. I did solve it using Rule Machine somehow (can't remember now) but it was much easier to use an app to do that.
I used Wake Me Up. It does fade down as well as fade up. You can pick days, times, dim levels, and so on. Much easier than Rule Machine. It is available in Hubitat Package Manager if you have that installed.
