Rocker boxes, To remove or not to remove?

[chevy_fatman]

I'm replacing the outer rockers on my blazer and I notice that the inside of the rocker boxes has rust flaking off, some big flakes are already just laying there.

My question is, how hard is it to remove these rocker boxes? should I do it? there's no structural damage to them (no rot) just surface rust and I want to protact them from rusting again, so should I remove them? how hard are they to put back on?

Below is a couple of pics that show my boxes.

Thanks for the read and any advise given.

Paul.