Maintain interpolated local position and rotation so we can just keep applying, add sliding state to vm