Unity was taking a dumb amount of time just to assign a sprite in world space UI. In editor it was >1ms per assignment. Made large cards be 512 at max size instead of 2048 which improves the time a lot.