My understanding is that "override for automation" suspend shouldn't turn the lights off with motion inactivity if you manually adjust the level, but there have been so many options added to this app and the docs aren't super-clear, so I could be wrong (but here's one of few posts I could find on it?).
Regardless, one thing you could try is this: turn on logging for this app, then keep live logs open (or view past logs shortly thereafter) to see what the app thinks it should be doing versus what you think should be happening as real events happen on your system. Perhaps one of your devices isn't reporting properly, or maybe there's a bug in the app (or again, maybe none of us know what both of these options are supposed to do).
