jfl...
I understand your problem.
I love my Harley, too, and I choose to always be armed as I enjoy its open air comforts.
(Only a biker understands why dogs like to ride with their heads out of a car window.

)
My usual EDC is my Kimber Ultra in a Fist #1A IWB w/cant, clip, and body protector. It works on my Harley but...I wanted something else.
Then I purchased a my Glock-36 and a
Fist #41 IWB SOB. See the above 'Related Links...search out Fist.
The holster has a body protector and rides tightly against my right kidney. Note that the holster is a palm out draw. Some may not like this, but it's actually quite natural. I can ride, stand, sit, and walk for hours and hardly know the gun is there.
Additionally, I usually just wore a T-shirt on the bike, but I started wearing a (wifebeater) under the T...this makes the holster disappear. The wifebeater and T are no hotter than just a T.
I have an Electra Glide with a back rest...I sometimes have to double check that I brought my gun along (like checking for your watch because you can't feel it).
Hope this helps.
Enjoy the ride!
ret