It's just a wearing the paint off.. pulleys used to have a non-painted belt area. Manufacturers have made the process easier for them and just paint the whole thing. Nothing to be worried about.
If it was driving a waterpump, then the paint can cause slippage and noise. Pretty common on 8.1L replacement pumps. I've had to emery cloth off the paint on generators because they would squeal, slip, and cause the belt to get super hot.
You could remove it and sand off the paint if it makes you feel better about it.