Firewall: Unchecking port block still allows traffic

[proxybox]

I noticed when setting up Remote Desktop on Windows 10 that I checked the Port 3389 and it opened it up properly. I am able to setup a remote desktop connection from another PC in the network. However, if I uncheck the box it still allows a connection. Isn't the point of a firewall to be able to control this traffic via the checkbox?

Attached you will see the firewall for Remote Desktop unchecked and it still allows a connection.

SecurityCenter

16.0 R24

Mcafee Security Center

Build 18.4.139

[Madhan]

Hello @proxybox 

Please update McAfee and also make sure Windows is up to date. Select Restore Defaults and then try enabling the Port 3389, check if you are able to setup a remote desktop connection from another PC in the network. Then, uncheck the box and let us know the outcome.

Regards,
Madhan M

[proxybox]

I performed all those steps prior to submitting my question. Even with the checkbox unchecked other pcs can establish a connection on port 3389