Distributor Cap Noise

This sounds bizarre, but I have a Delco points distributor with a Pertronix inside it in my Oddfire and there’s a noise coming from the cap. Like the rotor is rubbing the terminals but there’s no evidence of it on the inside of the cap or rotor. When I first installed the rebuilt distributor it made this noise and after retiming it recently, it is making it again. The tighter I tighten the hold down on the base, the louder it is. If I leave it almost loose, it’s almost undetectable. I can’t remember fixing it last time, but it did go away. I have been thinking of buying an HEI style anyway, but I’ve had great luck with the Pertronix in this one and I'd like to keep it around for a spare if I get an HEI. If it's a spare, I'd like to be sure it was up to snuff. Do you guys have any ideas what this noise could be?

 

Any side-play in the shaft from worn distributor shaft bushing(s)? Or end-play (up-down)?

I did indeed have a distributor once that was so loose the rotor struck the cap terminals.

 

There is some slight up and down movement but no discernible side to side play. None that I can notice with the distributor still in. It was a remanufactured distributor what with the way things are remanufactured nowadays I can completely see it being worn out with only 30,000 or so miles on it. It's a possibility I guess. I'm going to pull it and see what things look like. Thanks for the reply