If you're looking for a good, inexpensive web host, you should consider Bluehost.com. Their rates are cheap, you get tons of space and bandwidth, and there's a bunch of nice add-ons.
Also, you can host more than one site. So maybe you're just looking to start off one site, but down the line you may want to expand. Or, you could share hosting with a friend to make the cost even less!
There's also a system preinstalled called Fantastico. It is a mega load of web applications that you can install with the click of a button. So if you are not especially confident when it comes to app installs, this does all the work for you.
They're worth a look.