Delete physics joint handle before delayed delete, add extra safety checks when removing physics joint