Use abs on our paddle return velocity length before multiplying by the sweep normal, stops the ball flying behind the paddle
Simulate physics entirely clientside each frame, make the client authoritative packing the ball position into the usercmd. The game should decide which client is authoritative based on which side of the table the ball is on.