The best way to do a website nowadays is to use a Content Management System. The 3 main CMS's are Drupal, Joomla and Wordpress. I personally use Drupal on my site, and then Gallery for my photos.
David Drummond runs a hosting company which does low cost hosting on a Cpanel machine - Cpanel + fantastico is probably the best platform for the beginning. It is easy to click through and what not. You can find his hosting plans at
www.DrylineHosting.com. If you don't want to go through him, there's a few others out there. You get what you pay for normally. David runs a pretty decent operation. Many of the members here have used him in the past, and I think you will find all positive reviews.
Once you pick out a CMS, the next thing to pick out would typically be the theme. This is going to alter how your site 'looks' (as a default Drupal, Wordpress or Joomla site will look very bland) and how it is setup. Once the theme is in place, you are ready to add content. Blog posts, pages, photos, etc.
I am more than willing to answer questions if you'd like. My day job involves this kind of stuff.
For an (shameless plug) example of Drupal + Gallery, feel free to check out my site
http://www.benholcomb.com