you could look at Tuya based wifi plugs and flash them with Tasmota to work locally. They are usually pretty cheap. These are what I use with my setup.
There is a fork of this firmware to work with HE below with information on how to do it.
If you look here you should be able to find a list of devices that should work.