From what I was told in my CPL class, a person with a CPL can carry any gun he obtains legally. In other words it's OK to borrow the spouses, or a friends.
So the question is how is this handled in other states. Can anyone loan a handgun to a friend or spouse? Does the friend have to have a CPL? If it's a spouse does the pistol permit apply to them even if it's issued in your name?