If you try to remove a property defined in a properties file by double clicking the property name in the property sheet you will see this dialog