Probably would be easier to figure out why Matter isn't working since it's also a Matter Bridge, and that should work?
But if you go this route, it's unlikely you'd need dedicated drivers for each device; a parent app or driver would need to do some work to make it work (and that might need to be tailored to each device type), but actual devices could probably use built-in generic component drivers -- just to make that part easier.