Only refresh player collider size on the local client, since it's always disabled on other clients. Also adds an early exit.