From what I am seeing, I am utilizing the correct driver as described. The Generic Zigbee RGBW Light driver. I will test with that option "Enable color pre-staging". This appears to set the color before it turns on. That way if the light was already a different color it wouldn't turn on the old color then transition to the new. Maybe that will provide different results.
I have a lot of Zigbee devices plugged in, I believe my Zigbee mesh is solid.