Have you reviewed any hub logs to get a better grasp on why your automations are sluggish?
If you know you have z-wave ghosts in your system, what makes you say that isn’t related to the issues you’re seeing?
Z-wave ghosts can cause all kinds of mayhem, and generally speaking, would be the first thing to try to address.
This post also has some very helpful info re: hub troubleshooting: