Hi I have a 340 M&P that I disabled the internal lock by having a locking stud ground off of the locking flag,and the flag reinstalled. My question is at this point is there any way for the key hole part to fall inside the gun now?

Another poster here informed me of such a thing that happened to him when he removed his gun's locking flag and left the other lock parts inside the gun. Since removing the locking flag is a popular way to disable the locks in these guns,has anyone here who has removed just the locking flag had any issues of the remaining parts coming loose and causing an issue? I ask because on my gun,if you push on it theres a bit of play in the key hole it moves in and out of the frame. But it comes back up if you stop pressing on it. Is this piece under spring tention?