I've been doing this as well, actually both. I have HomeAssistant installed. When our internet went out, I could verify control of devices still worked without issue. Although, Google Assistant did fail, so I could only control them through a control panel.
When the network is up (99% of the time, my outage was an anomaly), control through Google and remote has been solid.
Given the success of our Kasa buttons, we've been integrating more Kasa (TP-Link) devices over older items we have.