Off the shelf bullets are mass produced, using any number of point dies. This is where the variance will come in. On top of that, the bullet jacket itself can have varying wall thickness which will cause the bullet to be out of balance when it is spinning into the hundreds of thousand RPMs. Then throw the weight variance into the mix.
You don't say what caliber you are shooting. You may be able to get some custom bullets to try.
