Oh, it's definitely considered a sport by the absolute majority of hunters...and non-hunters. As stated above, we don't hunt because of a need anymore. We hunt because of a DESIRE and challenge. It is...in essence...a game. We even call our quarry "game". Using any other words to describe it is simply a matter of semantics. Is bullfighting not sport? Of course it is...and the bull dies in the end. Who NEEDS to kill groundhogs, carp, starlings, prairie dogs and squirrels in order to survive. It's done for pleasure and satisfaction...little else.
I too am not wealthy, yet I can lease anytime I desire. I can't afford a Harley...a Ranger Boat...a huge 5th wheel...etc. I can afford a lease though, because I'll work, save, struggle and prioritize toward it. I have no problem compensating a landowner for the use of his property, either. If another guy is opposed to spending the money, let him go argue his case to the landowner and see if anything changes.
Is leasing hurting hunting as we know it? Don't ask me. Just look at any active group of leasers in TX, IA, MO, MS, IL, KS, KY, TN, GA, LA, AL, OK, MN, WI.... These guys are hunting hard and they sure aren't busy worrying about those who won't spend the money.
Finally: A lot is made of "If we keep leasing, we won't have any places to hunt!" How much private property is leased to hunters in your state...on a percentage basis of total acreage? I'd be totally shocked if any state had more than 10% of total lands under hunting leases. There is a huge amount of potential hunting land out there...waiting to be hunted. Free. Pay. It's an individual choice.