LED Mini-Dashboard (replacement for "Switch Dashboard" and Switch Notifications) for Inovelli dimmer/switches

Strange, I tested when a switch was on and it worked as well:

Do you have another automation that might be cancelling the notification or trying to start another one? You have fw 2.18 I assume? Also, the app is up to date you are using?