Keep the 'change accessory' button on selected items even if you dont have any charms unlocked So you can remove a charm on a picked up gun