Interesting. I see how that works and it does work. However, the previous 15 dashboards I had created under the previous HE firmware I've never selected any devices to be used and yet they all showed up. Point in fact. Here's my Kitchen dashboard created a few months ago.
Now, here are the app settings for that dashboard and you can see that no devices are or ever have been selected. Sounds like this was a bug earlier and I was just not aware and now it is fixed.

