Here's a quick demo of using a Pico remote, paired to the Lutron Smart Hub Pro, integrated into Hubitat using the built in Lutron Integration App, which is then wired up to another built in App, Button Controller which then maps the buttons to commands that are then sent to a Hue Hub, to a group of bulbs.
This is 100% local, almost near real time. Just a hint of the speed and reliability a 100% local home automation solution can do.