Replying to myself to document this, but this hopefully will help else having trouble with this in the future.
I could not get this to pair again (was previously paired with this hub) no matter what I did. Apparently, I found a way to factory reset it. Hold the "on" button until it blinks, then press the "on" button 5 times very rapidly.
Start pairing mode on the hub. Hold the "on" button on the remote until it blinks, then short press the "off" button. It nearly instantly was found by the hub. Just doing the pairing procedure did not work, you had to do a reset.