I've had this before when re-attaching the loader on a significantly warmer day than on which I removed it.
Simplest fix I found was a small hammer and brass punch/drift. Insert the drift/punch into the coupler and hold it against the stem inside. Wrap a rag around the coupler and punch...