My opinion ( I have a canoe, kayaks and larger boat) Wind is not so much a factor where I tend to use one. This would be smaller lakes and ponds and rivers / streams. A canoe is fine and in fact, I can haul two men and their gear in.. and all that plus a deer out, with the canoe. Most kayaks will not allow that.
For big water that can get rough, well a larger boat with a motor is the answer there. Just safer, especially loaded down. Remember, you are going out there to kill a deer (or larger game). You need to be able to get it back to your vehicle.
Kayaks are cool, and I like to fish and duck hunt out of them, but for deer hunting, my opinion is as above.
ChuckC