If it's legal in your state for it to be exposed, you shouldn't have an issue with brandishing unless you are waving, pointing it , etc. Or, unless some big scared anti see it's and calls 911.
Some states do require them to be concealed, or in certain locations such as consoles or glove boxes, but I'm with you.... I want it out where I can grab it.
There is a holster set up where it holds the holster on the front part of the driver's seat, keeping the gun literally in front of them between their legs, but I wouldn't want to draw it from that location.