Started with a fanny pack and did like it, but mine always start moving around and I found I was frankly carrying too much gear with me for a fanny pack to be viable without shoulder straps. Got an Asbell haversack and really enjoyed it (however, for this entire season I used an Eberlestock Mini-me and absolutely love it; incredibly versatile pack that isn't gigantic).
If you use a haversack and dislike it when you can't find things quickly, I suggest trying something like the Grid-It by Cocoon. I've used one of these with my Asbell haversack and it works great for keeping items organized.
Also, for carrying water, I use a Platypus Plus Bottle (basically a collapsible bottle with a 'sport cap' on it that holds a liter) -- squeeze the air out of it before sealing it up (same idea as the hydration packs) and it won't slosh around and make a lot of noise when walking like regular, stiff plastic/metal water bottles do.