Needing tilt column rebuilder expert advice.

[HO455]

I am going through a tilt column and I found these wear patterns on the tilt yokes (?). It appears that at some time in the past the nylon ball part failed and the car was driven for awhile that way.

Will I be okay if I polish the high spots off and reassembled the unit?

And should I replace the current nylon ball assembly or is this one still reliable? It's obviously an older piece but are the current repops any good?

I can post more pictures if needed.

Thanks in advance for any advice.