I have a bike for this purpose, but have not used it yet, perhaps 2015 will be the year. My advice, use something CHEAP, that way if someone tries to get a five finger discount you won't be out much dough. Get a cheap old $20-50 bike off Craigslist. I would also take some spray paint and while you don't have to totally camo it, at least spray some dull colors here and there to knock down the shine and not make it stand out so much.
I will tell you this, it is QUIET, dry leaves excepting of course. I hike in to my spots carefully and quietly and one time a couple years back a fella passed me on the logging road with his tree stand on his back and MAN he about scared the daylights out of me in the dark...I couldn't hear him rolling through the soft grass pedaling at all. Crazy. My foot falls made more noise and I was actually trying to be quiet.
I think the key to this is to keep everything well lubed and in good tune.
Definitely invest in some tubes with 'Slime' or some puncture resistant tires...you don't want to have to haul a 25-30# bike out of the woods with flats.
Also, you can hook up a game cart to the bike, talk about convenience.
Like I said, I have a bike ready, but haven't used it yet out of simplicity, but a bike definitely helps when wanting to cover a few miles to a spot.