Several days ago, on two different production HE hubs, I simultaneously experienced no events on a bunch of battery-powered zigbee devices (e.g., motion sensors, contact sensors, etc.). At first I thought it might be the greatest battery coincidence in the history of the planet, but I quickly ruled that out. FWIW the affected devices are mostly either motion sensors (a mix of Hue motions, Iris v2's, and Smartthings/Aeotec) or contact sensors (Visionic MCT340's and Smartthings/Aeotec). Both sets have been rock solid for years.
Then I realized some of my zigbee devices were doing fine. Upon further troubleshooting, I noticed that all the problem devices seemed to have one thing in common: they were all using my zigbee outlets (Jasco Enbrighten 43102s or Smartthings Plugs) as repeaters, which form the primary ring around the hub to establish good mesh for the outer reaches. End devices that were connected directly to the hub seem to be behaving fine. When I then zeroed in on the outlets, it turns out they were misbehaving. I can turn them on/off physically, but not through the device details page. They ignore all inputs.
- Nothing remarkable in the logs.
- My mesh is solid--one hub has 49 zigbee devices 6 of which repeat; the other only has 13 zigbee devices, 3 of which repeat.
- That said, only 1 repeater on the first hub and no repeaters on the second hub shows up in the neighbor table when I look at the getChildAndRouteInfo page.
- I have tried switching zigbee channels and waiting. No luck.
- I have confirmed my 2.4g wifi network is down at channel 1, whereas my hubs are on zigbee channels in the low-to-mid 20's, so no conflict there.
- I have no bulbs on these hubs, so that's not it.
- I rebooted the hub. No help.
- I did a soft reset, and then reloaded a backup. Still same problem after waiting ~10 hours.
- I even successfully re-discovered a number of the zigbee outlets. No change.
I'm out of ideas. It would seem that zigbee outlets are the culprit since it happened on two different hubs simultaneously and they're the common denominator. But I don't really know. All of the affected devices use Generic Zigbee Outlet as the driver. Could they have received OTA firmware upgrades that killed their ability to repeat? I didn't think HE supported OTA updates for Zigbee.
Edit: on one of the hubs, when I look at the zigbee log (the one with 13 zigbee devices 3 of which repeat), I get a device “0000” and profileID:0x0, clusterId:0x8032, sourceEndpoint:0, destinationEndpoint:0, groupID:0, lastHoplqi:255, lastHopRssi:0. Seems suspiciously like a ghost device are an offline zigbee network, but neither appear to be the case. Stumped.
Anyone else having a similar problem? Or any ideas before WAF is irretrievably lost?