I started by purchasing everything but components used - ads in papers, bulletin boards, the local gunshop sells used stuff etc. That stretches the budget.
First, get yourself a good manual and read it. That will let you know what you're in for. I like the Speer manuals.
Also to keep the budget out of the clouds I purchase powders that will work in more than one caliber - with your twenty twos it will be easy to double up on both powders, primers and even bullets!
If you can link up with someone who already reloads it will increase your startup time and decrease the problems you encounter.
Another great resource is Handloader magazine - they run in-depth articles on cartridges and even stuff like light handloads (taking the 22-250 down to 223 Rem. levels, taking the 223 down to Hornet levels, etc.) These can be helpful for cheap practice, kids and shooting in the more built up areas. All in all it's a pretty good mag. - no I don't work for them.
Bulletin boards with reloading info can be helpful but be careful not to use the loads posted on them - stick with published loads from a reliable source and ALWAYS follow the safety precautions of starting with lower pressure loads.
If you find that reloadin isn't for you you'll cut your losses by purchasing used equipment and you can always resell.
Best of luck.
Vthunter