With the same result with two shooters and the flyer going to the same spot for both, I'd discount the "shooter" theory. Given that the flyers are going to the same spot regardless of shooter, I'd look for a rifle or load problem. Since it seems to be after the barrel warms up, I'd check the rifle first.
Is the barrel free floated and how much? It's pretty common for "free floated" barrels to not have enough relief. The "normal" advice often given "slide 2 (pick a number) of pieces of paper" or "slide a business card" etc. are basically one size fits all solutions that are very often wrong. In my experience, very often factory stocks aren't stiff enough to be properly free floated without a gap of 1/4" (or more) between the barrel and forestock (it's better to stiffen them, but that's another discussion).
You often won't notice the difference until the barrel starts to warm up, which changes the way it flexes in the barrel channel and it starts contacting the barrel channel somewhere and causing (fairly consistent) flyers.
Try this, put the buttplate on the ground holding the rifle by the barrel, and give the forestock a sharp rap with the heel of your hand, directly towards the barrel and from side to side. If you can make the forestock slap the barrel, it doesn't have enough relief.
The next thing would be the load. As aulrich alluded to, if you are using a powder grain weight that is "on the edge" flyers are more likely. Did you use a ladder to work up loads (or Dan Newberry's OCW variation)?
Edit: On the other hand, Jack might be at least half right. One half of the problem might be the fact that it's a Hornet, the other half of the problem might just be the fact that it's a Ruger. /ubbthreads/images/graemlins/tongue.gif