This may not be an option if you need to use that chuck on different spindle sizes, but...
All my chucks are Vicmarc. The VM120s for my full size lathe (Oneway) and VM100s for my smaller/travel lathe (Delta). Not long after I purchased my first VM100, I was teaching a class at Rockler Woodworking. I bring my own chucks when teaching/demonstrating when possible. Class finished, I packed everything up and returned home. A couple days later, I picked up that chuck to use on the smaller lathe, and saw the insert was missing. When I removed the chuck, the insert unthreaded from the chuck. Fortunately, the insert was still on the classroom lathe when I called the store. After that episode, I used Loctite to permanently fix all my inserts to the chucks.
I have a Oneway adapter (M33.5 to 1x8) that allows me to use the VM100 on the big lathe. Oneway adapters have a set screw, a hole to use a bar for removal, and two flat surfaces for a wrench if needed. Oh, and because Vicmarc chucks didn't have set screws, I had a friend drill and tap all my Vicmarcs for a threaded set screw.