Nest Hub TTS delays

I had the thing occur where TTS stops working with Nest Hub and then you click initialise and all of a sudden all the TTS messages come through from the time it broke. Is that something people are scheduling or is there a workaround?

Try Chromecast Helper