The finish on a carry gun will wear......
get over it!
Seriously though, a nice pretty gun that you don't want to scratch should be kept for range work only. Like others said, drawing and keeping the gun in the holster is the best thing. Don't put any conditioner or anything on a holster.