I've slowly been doing this very thing. Currently, my home is almost completely automated. You can walk into any room and lights come on to what my wife and I like as "appropriate" levels. But, what if a friend comes over and wants to do something at the dining room table and the lights are too dim for them? Sure, we have Alexa in every room and I painstakingly make sure that devices are sync'd up and groups are up to date where that guest could just tell Alexa to make the dining room lights brighter. Most of our friends that understand how to voice control things get used to things pretty quickly here.
But, what about friends of ours that are what I affectionately refer to as "automation troglodytes"? To that end, I've been working on making all my switches smarter and putting various remotes around along with being able to use Alexa blueprints to explain how the house works: "Alexa, how do I turn on the TV?" gets a response of "To turn on the TV, just say Alexa turn on the TV and I'll know what room you are in and I'll turn on the TV for you".
To be honest, it's a lot of work automating your home and making it easy for guests that don't know how home automation works.