Anybody have trouble keeping inside window handles on when using thick door panels?

[72farmer]

I never thought i would have trouble keeping these handles on since they are so hard to get off sometimes.My custom made door panels are 1/4" thick plus foam and vinyl.I get the clip on and when you use it rolling down the window a couple of times it pops off because the door panel is pushing out on the handle.Has anyone drilled out the end of the shaft on the regulator and put a small screw through handle.I know this would not look good but i may not have a choice.Could you use 72 regulators since they stick out more?