I've moved one of the sites I administrate (not that there are that many of them) to a new hoster, PathHost. Cost me $3 (that's three $US) a year. With 50MB disk space and 1GB transport, it should really be enough for every home-scale site, except maybe if you run image gallery. For now (that's a few hours after I've installed the site there), they seem to be just fine.
Hosting prices are ridiculous, not just because disks or connectivity are cheap (though it helps), but also because good, robust, scalable server software comes for free, as it's open source. The nice thing is that some stuff, like cpanel, myphpadmin (for mysql) became de-facto standards in low-priced hosting services. So moving from one hoster implies no learning curve at all; it took me today about 10 minutes to dump that db at one side, load it on the other, move the files, and configure all the other stuff, like redirects and e-mail. Sababa.