Here's what you need: Sanding Pen

They work great. Just take your time, get off all the rust, and use a brush on primer, sand smooth and then use touch up paint.

If you take your time, you'll barely see it.