When you choose to remove a page from the menu, this alert box will confirm that this is what you want to do, if you choose "Yes, remove" the button will be removed from the menu and your settings will automatically be saved. This will only remove the tab from the menu, it will not delete the actual XML file from the server.