It has been a long time since I replaced those in a camaro I used to have. Please verify, but I think that if it fit in the sleeves, it probably was meant to have them there, especially if it is now sloppy. Those things should not bind, but they should not have a lot of slack. There is an image of how they are centered in the hole, and how this guy drilled out the rubber.
http://www.pirate4x4.com/forum/chevy...sas-build.html