The XD typically has a much longer pull, and is not as light as a 1911, unless you get it worked on. Out of the box, there is no comparison.
If the 1911 was truly drop safe, then I'd carry unlocked. This would require it be the type that has the firing pin block. There are hundreds of stories when a 1911 became unlocked while in the holster, and the person didn't realize it. BHPs too.
I read a post once that said," Keep your booger hook off the bang switch, and you will be fine." Sage advice...
Carry in a good holster that holds the pistol securely and completely covers the trigger. Do not place your finger on the trigger until you are ready to fire. If you do these, and have a drop safe pistol, then a safety switch is unnecessary, in my opinion.