Dustin,
I don't believe that one is EVER wrong, when you choose to pass up a shot, becuae it doesn't feel right.
You missed an opportunity at a fine animal, but that animal is not laying somewhere, suffering, either.
My hat is off to you for "doing the right thing, even when nobody was looking!"
Now, cause you didn't spook the sneaky old bugger, you have agreat chance of getting a shot that "feels right" at him.
Best of luck, Dustin, and when the feeling is right, shoot straight, my friend.