Welcome to the forum.
To answer the title of you post, yes there is a balance between concealment and speed of draw. Is one more important than the other? It all depends on the situation you are in at the moment.
I can conceal any of my firearms pretty much so as you would probably have to do a half baked strip search to find them, but could I get to them fast enough to same my life? Not hardly. I can position my carry gun so I can draw and fire in under 2 seconds but obviously it would not be as concealed. You have to find that balance that works for your lifestyle and threat level so to speak.
As others have stated your choice of holsters is not the best. There are several holster makers that have the clip style attachment that you like. One other thing that may help is remember to dress around the gun/holster that you are wearing. Everyone is built different so what works for them may not work for you even with the same gun/holster combo.
I carry in different ways while I am home. IWB, AIWB and OWB. It all depends on what I am doing or where I am going. More and more I am carrying AIWB as my shoulders simply do not move the way they used to. It has gotten to the point that I could not reach around to draw my weapon with my weak hand if I had to so I simply adapted. When carrying strong side I have a BUG on my weak side but with AIWB I have no issues with reaching the gun and to me it is easier to protect in the event of a physical confrontation but I have built up quite a holster collection so I have one for each way that I carry.
Shop around and you will find different holsters. Go to a decent gunshop and see if they, with an unloaded gun, test fit them and see how them feel. Make sure you wear whatever it is you wear everyday do not change up or do something different from your everyday carry gear.
Personally I like the Galco J Hooks. They are simple, direct and to the point. They do however require you where a belt but I believe the make a model with a clip instead. Just keep experimenting and you will come up with the combination that works for you.