There should be a bracket on the pitman near the ball that acts as a fulcrum point, when a bar is installed to pry the ball joint against the spring which allows
the joint to be lifted off of the ball. If you have tried to remove without the proper procedure it maybe damaged.