It can be a scarey and miserable malady. I am a family man with five kids, a busy life, and I have had vertigo problems for 10 years now (started at age 39). The GOOD NEWS is MOST vertigo is temporary and over time- manageable/curable.
In my case, I have it about as bad as you can get. I have a non-typical form of Meniere's Disease (Meniere's is already not typical; so "non-typical "means they do not understand it!). I have been to Mayo clinic and one of the top vertigo specialists in the country in St. Louis (the doc who teaches all the other docs about it).
To be honest; without a relationship with the living Lord/Creator who took care of me, I don't know how I would have made it! Anxiety, fear, and depression can all become a part of any disabling malady- especially vertigo stuff.
I still deal with it, but after many conservative approaches, I finally was forced to use a procedure to kill the balance nerve in my one ear. It has helped greatly, though I still must deal with it albeit to a much less degree. My balance has compensated for the loss- but I still lift wts., run/walk short distances, and shoot my bows regularly. My collegiate-level athletic kids say I look in better shape than most men my age. So. . . you can make it work.
It no doubt did affect my life, and certainly hunting. I can not walk too far on uneven ground or it sets it off (3D shoots are miserable). . .etc. But, during these years I have had many friends who understood my limitations. I can attend shoots and just enjoy the guys. I limited my hunting to mostly farm-type whitetail hunting. God has still been good to me as I did take a muley in WY with a rifle and have harvested PY deer almost every year with my trad gear during these difficult years (even out of a tree!). I hope to find a unique situation to hunt elk and/or bear one of these years.
Feel free to PM me if you have questions. I have lived through about every test and procedure in the vertigo world! My full-time work is helping men get to know the Author of life and hope. (I am even holding a Men's Hunting Gathering in ND this year to hunt and talk about real stuff.)
A couple of pieces of advice: 1) Suffering has a profound way of leading a man to things much deeper and more important. This gives HOPE. 2)If it persists to a more chronic problem- go beyond the regular ENT and get to a specific specialist for vertigo. In other words, there are docs out there who are even a step "more specialized" than the ENT. There can be a big difference in the testing and abilities.
Hoping for you
Dan in KS