OT-Look at welds...need advice.

[bucket]

Let me start off by saying I am a beginner welder.....& I need advice from you experts. I began by flanging the patch panel and plug welding it in. I then tried to do short continuous welds along the seam. You can see in the pic that as i grind the welds with a flap disc it is hitting adjacent panel. My concern is grinding to much and weakening the surrounding metal. Should i leave it and rely on filler? or grind till it looks like in books. My father always says "sometimes the fix is worse than the problem"