Wanted to thank everyone for the advice. I feel I have derailed this thread a little. I apologize @concan !
I think I'm done playing for now. This week (before I got / could test the suggestions) I had 2 of 5 duplicating. One I took the battery out and put it back, the other I replaced the battery.
All 5 appear to be working fine now - right when I want to test them. So, I'll wait for one to mess up again and take a look.
I also just started up my SmartThings hub and checked this as well. I had just done the same in June. The hub and the buttons appear to be on the latest firmware, and no update to the buttons since the last time I tried.
I'm wondering if maybe the batteries need to be fully replaced with new ones to keep the issue from returning. I think all besides the one I changed are on the batteries that came with them. I'll pay attention to which of those two I fixed messes up first - the battery I fully replaced or the one I just took out for a minute.
Another idea, is possibly they don't like being on channel 25. But that's a bit of work to move all my devices that are working fine over.
Thanks for all the help everyone - if it happens again, I'll create a new thread.