That probably would have been a good time for you to call 911 and say;
Originally Posted by MadMac
"Hello. My name is your name. This is not an emergency, I am at Bob's gas station on 1st street. I have a CC permit and my weapon was just seen by an elderly woman who looked very alarmed at the sight of it. I am going to be leaving here in 5 minuets heading south on I-00 in my blue Ford Focus. I can give you my permit number, lic plate, or any information that you need.
Kind of a preemptive call in case the person who obviously noticed your carry and seemed alarmed. This will save the LEO a trip if the 911 call center can defuse the issue. They get a call about a man with a gun as "X" address, and another call from the licensed person with a gun at the same address.