Another other question that comes to mind is whether you're going to record bird sounds, prey sounds, etc. If you're trying to get deep throated prey, leave the parabolic mic at home as it won't capture really low sounds (unless that is, you want to carry a dish that's 6 or more feet in diameter).
You can do a lot to clean up the signal on the PC these days, but always better to record it well. I have used my PoGo! Ripflash Plus with my Nady 151VR-LT to field-record in a relatively high quality .mp3 format. Most non-pro handholdable units, PoGo included, are somewhat compromised with the upper end of what they'll capture; ie my PoGo has an internal codec (set of instructions that compresses and decompresses audio) that records at a high-quality 256kbps but unfortunately clips frequencies above about 17 kHz. Which is equal to or better than what consumer-grade cassette tape recorders are capable of, so it does a very good job of transferring tapes to digital. This 17 kHz limitation not going to be any big deal for recording most mouth calls, or your typical bunny in distress.
But it's less-than-ideal for recording some things, notably mice and similar high-pitched squeaky stuff that can be useful as coaxer noises for predator calling.
My old laptop works adequately well for these, though I don't tend to take it out in the field.
There were a couple of later interesting handheld devices that if I recall record in .wav format all the way from 20Hz to 20kHz. The Neuros II is one I've been eyeing for awhile. Kind of bulky compared to some; they had a 256 MB unit that is about the size of a pack of smokes, dunno if they're still in production.
One feature I'd insist upon for any field-recording device is USB file uploads. That way you don't have to make an extra Analog to Digital conversion (potentially degading the sound) in order to import what you record into the computer to clean up in a sound editor like GoldWave.
If you also go the Nady route, the wireless microphone acts as a preamp for units with only a line-in jack, incidentally. There are far fewer units to choose from with a mic-in jack.
My last suggestion would be to search for whatever latest devices CD bootleggers favor for sneaking in to and recording concerts with these days... Keep us posted with what you find.
LionHo