Thanks for all the advice, I tried heating with a torch but it didn't seem to help.
Probably should have been a 15 minute job with the correct drift. Not quite sure how but it turned out to be about 2 hours using a variety of improvised tools such as cut down hex keys, bits of socket...