Getting lower balljoint out of arm?

[Gmc-76]

In a attempt to lower the front of my truck last night I took apart the whole front end. Well after I got the nut that hold the lower balljoint to the control arm, I can't get the balljoint to come out of the arm. I undid the shock and tie rod from the arm and spindle so it should just pop out now. I provided the best pics I could get to show what I'm talking about. The red arrow is that the spindle needs to move up, the white arrow is where the balljoint "bolt" needs to go down through the hole on the arm.