When reading an item entity and its world entity is no longer valid, remove it if we are the server