"but I guess I'm concerned with how they will see me if I have to clear leather for any reason."
Naturally I hope the way they will see you will be "alive" and healthy
Hopefully if you ever DO need to clear leather it will not be for any reason.
It will be because you honestly feel that you are in grave/mortal danger of losing your life.
In my humble opinion you'll not be of very much use to your dream agency if you are not alive and healthy.
So I would continue to carry. It's only logical.
I'm sure that your agency wants to hire smart people and smart people do not walk around totally defenseless when they can just as easily be legally armed with the most effective means possible for defending life and limb.
Again...just my humble opinion. Your decision as to what you will ultimately do.