Changed the car to work more like the player: Instead of the prefab being everything, it's just the base, and then visuals and colliders are only added as necessary by client/server.