Forcefully refresh terrain collider after setting the height map (fixes raycast issues with terrain)