Is there a way to make this simple rule act faster?

Did you try using any other apps like this one? I know that it worked great when I used it and never noticed delays except for motion sensor delays. It also has a few features that might interest you like the "Dim before off".

Another thing to consider that might introduce delays is the switch or smart light you are using, what protocol does it use, etc. ?