Dick's Sporting Goods sells a varmint Remington 700: 26" barrel, adj. trigger and camo stock. Basically an SPS except ADL (blind box) magazine. Usually on sale with a cheap 4-12x scope you can upgrade later. And don't forget the huge aftermarket for the 700 that lets one customize it as funds permit. Also, the aforementioned Marlin looks like the best bargain out there; I've seen 'em new for 300 bucks around here. From what I've been able to glean from articles and the internet, they seem to be generally reliable and accurate.
I would stay away from the pencil-barreled .22-250s. You need the length to wring the most speed from that cartridge, and the extra mass to shave a little bit of muzzle jump off for varmint shooting. Might quiet the report down a wee bit, also; to my ears the '250 seems loud for its caliber (with ear protection, of course.)