Local transforms for hand info, we'll convert back to world transforms in managed after anchor transform changes