Fawns of the year, including button bucks, are the most likely to succomb to the factors of life of any in the herd. Especially in an "up north winter" setting. We used to have a lot of ideas about how to manage a deer herd and some of those ideas have changed or are changing.
I personally have shot botton bucks and likely will again. If I have a choice of an adult doe, I will take her instead, cause there is more meat. You make the choice.
I suggest that if you are having some problem "gettin er done" for any reason, maybe consider committing to just shooting the next deer that comes by (that presents a reasonable shot opportunity).
That way there is no concern over what it is...... it is just "next". It is worthy of your arrow because it is "next".
Do that a few times and THEN worry about what you will or won't shoot. Deer are nutritious and delicious, but you gotta kill one before you get to eat it (unless you are a wolf... then you get to eat it while it is still alive and watching you).
Shoot straight and pick a spot.
ChuckC