When I used to shoot metalic silhouette, one of the first things I learned was that your bullet tends to follow the sun. In other words, if the sun is straight up above, you will hit high. Sun high left, bullet high left, etc. This of course assumes you sighted in with the sun at a different location than when you shoot for score. There were different theories as to why this happened. The most popular was gravitational pull from the sun. Don't know if that's the case or not. I would try to practice at as near the average match time as possible to help overcome this. I also recorded the number of clicks I adjusted my sights for each distance we shot at. We always got sighter shots before we shot for score. That way you could adjust your sights the same for each distance, no matter where you happened to start from.
That's how we did it. Hope it helps.
Paul