You did the right thing. To quote Reg Darling's current TBM article.....
"I have taken some shots that I have regretted. But, I have never regretted passing on a shot".
I passed on an 8 pointer earlier this season. He came around a deadfall, and I figured the minute he does, I'll drop to one knee, draw and release. The buck immediately jumped at my motion, and I immediately let my draw down at his jump, he only went 5 yards, had I remained at full draw for a couple more seconds I probably would have had him. He only went 5 yards... but then the stare down started. Oh, well.. I have no regrets, he lived to pass on his genes another day. And I was blessed by the experience.