I'm not sure this is intended or not, but here it goes.
I have a room that is only activated with motion sensors. I have different light levels per mode.
I enabled the option "activate on mode changes" because I wanted the lights to be adjusted if the room was active and the mode changed.
However, I noticed the following problem:
Before leaving the house, said room is activated because of motion, and the mode is day.
Then I leave, and the mode changes to away. The light then adjusts.
However, it never deactivates after that. I think the previous motion inactive timer gets ignored.
I think I have experienced the same/similar issues. Some lights that are on via motion stay on when the mode changes, and won't go off until motion occurs and retrievers the motion rule.
I'm seeing the same behavior. It looks like Room Lighting is sending an activation on mode change instead of just adjusting the dim percentage. Since motion is already inactive at this point it never receives a turn off command so the light stays on.