Yes, if you put the selector between safe and fire, with very little effort you can just push it right out.
You do not need to remove the grip and detent/spring.
The detent will stay captured in the reciever so there no chance of a sproing.....
Hey guys before you say it can't be done...maybe you ought to look closer at your guns.
Of course disassembling the pistol grip and removing the detent and spring will release the safety....but disassembly is not needed to remove the safety lever.
EDIT: Copied from another forum:
"Remove the Safety (AR-15's have safeties, M16's have selectors) to allow easy removal of
the Trigger later. Turn the Safety 45 degrees, halfway between SAFE and FIRE. Lay the Lower
Receiver on its left side on the two encyclopedias (with the Web, they aren't good for anything
else) or wood blocks, covered with soft rags such that the Lower Receiver is blocked up, and the
Safety can be tapped out. Tap out the Safety with the large soft Delrin® punch or wood dowel.
With the Safety halfway between Safe and Fire it will pop out without having to remove the grip
and detent. Don't worry about losing the Safety Detent, as it is captured by a groove in its hole."
add pics...wanted to show up close.
The trick to doing this is putting it back together not taking it apart.
You will need a pick or pin to push the detent down to re-install the safety.