Fix a regression where the map was briefly visible when the map was closing while fog of war is active