Air conditioner compressor problem..help?

[El Rondo]

Couple of days ago, while movin' on down the road, I started smelling some pretty serious burning rubber. Figuring I'd be walking soon, I prepared for the worse, since the smell was stronger and stronger (figured a belt was going). Made it to the house, luckily, and noticed the belt that goes around the fan and the air conditioner compressor was pretty thin and rubber shavings were everywhere (motor: 350 small block, V8). Changed the belt. Figured the problem was because the "Frigidaire" compressor was vibrating...I found a missing bolt on the mount and replaced it...nice and snug.

This morning she fired right up and I was getting ready to back out when I heard some rattle under the hood. When I checked, I traced it to the pulley for the belt at the end of the compressor. Right behind the hub is appears that a washer disc or something had torn loose and was now rattling around. I tightened the hub but it had no effect as the piece between the hub and the magnet is loose (gasket?) and is rattling noisily.

My question: Can I remove this washer/gasket, and simply not use my air and be in good shape? I never use air conditioning anyhow. Really won't bother to replace it for some time. Even in the summer, I don't care for air conditioning..just go with "redneck air system" (windows down..vents open). Can I run the vehicle fine without this system in place? Best to remove the belt, etc.?

Thanks for any tips...