This definitely sounds like a polling issue as it can take a little bit for the Hubitat to catch up to a manual press of the switch.
The other thing I recommend is to possibly look at Switch Bindings ([RELEASE] Switch Bindings) that might help slightly compared to a rule. It’s not going to solve your polling issue, but works really well for syncing switch together.