Yeah, was just about to post that I lever the spacer across a little with the drift - usually just enough to get the drift onto the edge of the bearing. Then work my way around the bearing lip knocking it out.

Well done for solving it yourself though!

Cheers, SB