From what I've learned and seen in my own loads, your best accuracy is below max velocities anyway. I don;t think any of my loads ever got close before accuracy started to wane.
My Dad got me started off reloading my own , and his first and most heartened advice was safety, and thats always first and foremost- its a personal law with me.
Another tidbit, that I havent seen mentioned, it the act of being sure to discharge yourself (of static electricity) before you even start towards powder or primers. Open primers are extremely suseptable to static charge, and a single rifle primer is fully capable of leaving you a finger shorter than when you started.