BUG- Built in notification app / presence [2.4.3.135]

I setup a notification for presence to notify me if a presence sensor arrives or departs. It works as long as I don't set a time in "For how long". With no time set, both notifications work. If I set it to a couple minutes, the arrived notification works but I never get a not-present notification.

Logging doesn't show much. With a delay, I'll see a app log entry for the arrived event but not for the departed event.