How to remove the Shift Lever Housing?

[Zeroman]

I have a 72 non-tilt column and the Shift Lever Housing is being a real pain to remove.

Is there some trick to taking it off, or are some more difficult than others?

Do you have to use a puller of some kind? I did notice three "ears" on the inside which look like a small three jaw puller would do the job, but I just don't want to damage it.

Thanks for the advice.