Disabling New Dashboard for Local

When disabling "Allow new Dashboards...."
image

This doesn't actually disable the ability to create new dashboards when local. The add new dashboard button still shows up.