I know this setting is "working" because if I scroll to the bottom of the Release 2.3.0 Available thread, I see the following:
I will get a notification when the original thread is made, but not any replies to it. This actually started a while back (I think I noticed it first with the 2.2.9 release) but I never bothered posting about it.
So for example, I did not get any notification about 2.3.0.112 or 113.