580C transaxle shifter cover removal?

I just got on my 580c and the shifter just started to be able to turn it in every direction ,so I pulled up on it and it pulled rite out, the shifter rite out of the housing. looks like it has a pin throught it that sheared.
I took all 4 bolts out of the cover and figured it would just come up and out easy but it doesn't. I haven't put much pressure on it, Should I? is there a trick to it? I definatly don't want to have to go deep in the transaxle so I need to know what to do so I do not...

580C transaxle shifter cover removal?

580C transaxle shifter cover removal?