Rear clearance issues

[Fastest32]

So I'm installing a mini notch kit and some bags in the rear of this 65. The rear end that is in it is out of something newer so so the panhard bar is totally homemade. I'm gonna have to make another adjustable one. Also the wheels that are on it are too wide and I'd have to make an adjustable panhard bar and have it exactly centered and still only have a 1/2" or less between the outer fender and the rear tires. The other problem is the tops of the wheels hit the ridge where the rear fenders bolt to the inner wheel tubs. I guess my question is can I remove the inner wheel tubs and still be ok? I think I'm gonna have to go with a different wheel. I think I like the steel wheel look better any way. Thoughts ?