Remove all unused GameObjects from the server side of server-side ragdolls. They only need the bones that actually have colliders on, and can ignore+remove all the other bones.