I can't have my hands in my pockets at work, but that's an Air Force reg. Under normal circumstances, if it makes him nervous that sounds like a personal problem to me.
What kind of work do you do if you don't mind me asking.