Don't update look direction on modelstate from the server on the local player - we set that every frame so it's more accurate locally Rotate our smoothed direction instead of lerping