Updating to 2.2.3.118 and then 2.2.3.119 is causing my C4 hub's web services to become un-responsive

Last Wednesday and now today my C-4 Hub's web UI and dashboards showed up with the "red" checkmark. When I tried to log into the Hub I got the login screen but wouldn't go past the login screen. I had to go to the recovery screen and reboot the hub. I can run months on this hub and the only changes made was adding the Tempest socket driver from @augoisms back in the beginning of July.

Looking at the logs I see nothing out of the ordinary except for a Websocket error showing a socket timeout for both my Harmony Hub and the Tepmptest and it appears that other functions such as receiving updates from devices were working.

dev:6542020-08-18 07:12:10.243 pm infoSent list_start for 74597
dev:6542020-08-18 07:12:10.100 pm infowebSocket is open
dev:4282020-08-18 07:12:10.055 pm infowebsocket is open
dev:4282020-08-18 07:12:09.484 pm infoinitialize() called
dev:4842020-08-18 07:12:08.634 pm infoHub is 1597795928521 aka Tue Aug 18 19:12:08 CDT 2020
dev:4842020-08-18 07:12:08.621 pm infoNTP Server returned time of 1.5977959301886763E12 aka Tue Aug 18 19:12:10 CDT 2020
dev:4842020-08-18 07:12:06.116 pm infoExecuting 'configure()'
dev:6542020-08-18 07:12:04.662 pm infoinitialize()
dev:4282020-08-18 07:09:40.489 pm warnWebSocket connection closing.
dev:6542020-08-18 07:09:40.425 pm warnwebSocket connection closing.

Identified the non-responsive dashboards here and rebooted via recovery page


dev:4412020-08-18 07:05:17.516 pm infoMaster Bedroom-Outlet is on
dev:2292020-08-18 06:51:16.490 pm infoOffice Button battery is 84%
dev:3142020-08-18 06:48:28.772 pm infoKitchen-Leak Sensor temperature is 75.62°F
dev:3102020-08-18 06:14:39.542 pm infoMaster Bathroom-Leak Sensor temperature is 78.86°F
dev:3132020-08-18 06:09:05.087 pm infoBasement-Leak Sensor battery is 90%
dev:3242020-08-18 05:33:09.952 pm infoKitchen-Siren switch is off
dev:3242020-08-18 05:33:09.937 pm infoKitchen-Siren status is off
dev:3242020-08-18 05:33:08.287 pm infoKitchen-Siren switch is on
dev:3242020-08-18 05:33:08.247 pm infoKitchen-Siren status is chime
dev:2292020-08-18 05:28:43.143 pm infoOffice Button temperature is 81.74°F
dev:4422020-08-18 04:53:03.563 pm infoMaster Bedroom-Button temperature is 85.09°F
dev:3022020-08-18 04:06:20.161 pm infoUpstairs Bathroom-Leak Sensor temperature is 79.04°F
dev:4422020-08-18 04:00:05.289 pm infoMaster Bedroom-Button temperature is 84.17°F
dev:3242020-08-18 03:57:13.246 pm infoKitchen-Siren switch is off
dev:3242020-08-18 03:57:13.244 pm infoKitchen-Siren status is off
dev:3242020-08-18 03:57:11.584 pm infoKitchen-Siren switch is on
dev:3242020-08-18 03:57:11.544 pm infoKitchen-Siren status is chime
dev:3102020-08-18 03:49:11.314 pm infoMaster Bathroom-Leak Sensor temperature is 77.96°F
dev:3112020-08-18 03:42:37.808 pm infoPowder Room-Leak Sensor battery is 87%
dev:4282020-08-18 03:30:48.886 pm infowebsocket is open
dev:4282020-08-18 03:30:48.827 pm infoinitialize() called
dev:4282020-08-18 03:30:40.808 pm warnfailure message from web socket failure: No route to host (Host unreachable)
dev:4282020-08-18 03:30:37.781 pm infoinitialize() called
dev:4282020-08-18 03:30:33.748 pm warnfailure message from web socket failure: No route to host (Host unreachable)
dev:4282020-08-18 03:30:32.701 pm infoinitialize() called
dev:4282020-08-18 03:30:30.663 pm warnfailure message from web socket failure: sent ping but didn't receive pong within 30000ms (after 676 successful ping/pongs)
dev:4422020-08-18 03:25:52.724 pm infoMaster Bedroom-Button temperature is 83.25°F
dev:3142020-08-18 03:08:08.535 pm infoKitchen-Leak Sensor temperature is 76.54°F
dev:4842020-08-18 03:00:00.257 pm infoHub is 1597780800236 aka Tue Aug 18 15:00:00 CDT 2020
dev:4842020-08-18 03:00:00.252 pm infoNTP Server returned time of 1.5977808044535154E12 aka Tue Aug 18 15:00:04 CDT 2020
dev:3142020-08-18 02:53:49.124 pm infoKitchen-Leak Sensor temperature is 75.60°F
dev:3142020-08-18 02:38:23.709 pm infoKitchen-Leak Sensor temperature is 74.65°F
dev:3122020-08-18 02:19:59.987 pm infoLaundry Room-Leak Sensor battery is 100%
dev:3112020-08-18 02:02:53.500 pm infoPowder Room-Leak Sensor temperature is 74.61°F
dev:4422020-08-18 02:00:55.263 pm infoMaster Bedroom-Button temperature is 82.35°F
dev:3012020-08-18 01:58:17.127 pm infoMichael Bedroom-Button temperature is 81.13°F
dev:4262020-08-18 01:43:00.439 pm infomZone-All House-Motion Zone is active
dev:3142020-08-18 01:39:12.991 pm infoKitchen-Leak Sensor battery is 87%
dev:3022020-08-18 01:15:16.306 pm infoUpstairs Bathroom-Leak Sensor temperature is 78.14°F
dev:2292020-08-18 01:12:56.715 pm infoOffice Button temperature is 82.64°F
dev:3102020-08-18 01:08:17.550 pm infoMaster Bathroom-Leak Sensor temperature is 77.04°F
dev:2032020-08-18 01:00:03.396 pm infoTest-Leak Sensor temperature is 79.22°F
dev:4262020-08-18 12:52:56.008 pm infomZone-All House-Motion Zone is inactive
dev:4422020-08-18 12:52:28.363 pm infoMaster Bedroom-Button temperature is 81.45°F
dev:4422020-08-18 12:51:16.851 pm infoMaster Bedroom-Button battery is 69%
dev:3102020-08-18 12:33:38.150 pm infoMaster Bathroom-Leak Sensor battery is 87%
dev:2292020-08-18 12:12:17.252 pm infoOffice Button temperature is 81.74°F
dev:3242020-08-18 12:00:03.782 pm infoKitchen-Siren Battery is 32%
dev:3242020-08-18 12:00:01.513 pm infoKitchen-Siren Battery is 32%
dev:2032020-08-18 11:22:56.132 am infoTest-Leak Sensor temperature is 78.28°F
dev:3112020-08-18 11:13:26.290 am infoPowder Room-Leak Sensor temperature is 73.71°F
dev:3022020-08-18 11:02:53.456 am infoUpstairs Bathroom-Leak Sensor battery is 24%
dev:3012020-08-18 10:50:20.222 am infoMichael Bedroom-Button battery is 86%
dev:2292020-08-18 10:44:04.922 am infoOffice Button temperature is 80.82°F
dev:3252020-08-18 10:31:21.861 am infoFront Door-Lock battery is 99%
dev:2032020-08-18 10:21:07.762 am infoTest-Leak Sensor temperature is 77.38°F
dev:4842020-08-18 10:00:00.210 am infoHub is 1597762800197 aka Tue Aug 18 10:00:00 CDT 2020
dev:4842020-08-18 10:00:00.209 am infoNTP Server returned time of 1.5977628041147126E12 aka Tue Aug 18 10:00:04 CDT 2020
dev:4282020-08-18 09:51:30.641 am infowebsocket is open
dev:4282020-08-18 09:51:30.560 am infoinitialize() called
dev:4282020-08-18 09:51:22.535 am warnfailure message from web socket failure: No route to host (Host unreachable)
dev:4282020-08-18 09:51:22.259 am infoinitialize() called
dev:4282020-08-18 09:51:18.236 am warnfailure message from web socket failure: No route to host (Host unreachable)
dev:4282020-08-18 09:51:17.146 am infoinitialize() called
dev:4282020-08-18 09:51:15.093 am warnfailure message from web socket failure: sent ping but didn't receive pong within 30000ms (after 495 successful ping/pongs)
dev:2032020-08-18 09:37:30.817 am infoTest-Leak Sensor battery is 87%

This also happened to me. I downgraded and it works fine now.

My C4 was acting up as well on 2.2.3.118, sometimes lights were taking 3-5 seconds to come on after motion was triggered. The webUI also was painfully slow when trying to browse to the devices or logs. Rolled back to 2.2.2.129 and all is good again.

I haven't upgraded past 2.2.2.129 and my C4 hub has been running now for 23days straight with no lag, reboots or any other issues. I will be sitting on this release for a while.

Thanks glad I am wasn't the only one seeing this issue. I have rolled back to 2.2.2.129 this morning. Lets see how this goes. As I stated before this hub has been rock solid since I deployed it over two years ago.

1 Like

My 2 C4's appear to be okay so far (just checked) on 2.2.3.119 :crossed_fingers:

The UI on my C5 stopped responding so had to roll back.

I just wanted to give an update after about 5 days after rolling back to 2.2.2.129 on the C-4. Hub is back to being stable and processing all events as expected.

Just one issues came up after rolling back. I use @storageanarchy Ecobee drivers and their occupancy sensors in various apps, Rule Machine, Zone Motion Controllers, and Dashboards. After the rollback everything seemed normal but then my rules that fired when rooms were unoccupied stopped executing. When looking at Zone Motion none of the rules I defined had sensors selected anymore, the same for Rule Machine and for the Dashboards. It also looks like I have new network ID"s for the sensors after the roll back.

It was a pretty simple fix to just to go into each app and select the right sensors again but I didn't expect rolling back would cause something like this.

2.2.3 FW appears to be a mess! I’ve held off updating until the FW stabilizes. Users shouldn’t have to be Guinea pigs

1 Like

My hub has been stable and working great on 2.2.2.129, but of course last week I decided I had to try 2.2.3.145 to see if anything has been fixed. Well, after 4 days my hub started slowing down and then locked up and when I did a soft reset it went into an infinite reboot process. After watching it reboot for about 5 times I rolled back to 2.2.2.129 and it has been “normal” again since then.

Keep in mind, I have very little running on my hub, it is basically acting as my zigbee and zwave controller as I use node-red for all my rules. The only non hubitat code on it is Ecobee Suite Manager. I have to agree, I’m done updating my FW, it works for me on 2.2.2.129 and I need nothing more.