Turn Signal Pivot Removal

I'm looked through Jim's steering papers, but I am unable to find instructions on how to remove the Turn Signal Pivot. I have the 1978 Late version which is a pressed in pin. I have the column tore down (in the car) as far as the signal switch, which I am also replacing and have removed. I can see the broken Pivot, and have pulled out the broken plastic part, but the metal part that is still there and has the pressed in pin is still there. Is there a trick to getting it out?