Apply the same fix when going from loaded-> unloaded (should never really happen in reality, but there's no reason for it to take 0.25s)