Even the big ones catch the wind and play hell with arrow flight. Been there and done that too. I have had a 5.5" fletched arrow turn sidewise when it passed thru a windy area. Feathers catch the wind. . that's their job.
While I definately agree that tiny feathers are not the way to go, I also feel that 5" or better feathers are not required for good arrow flight, if you did your homework, and you GOT to do your homework.
This is like a lot of other posts, with someone, typically someone new to the sport, with not a lot of actual experience asking about how to push the envelope. A lot of the envelopes have already been pushed, but a lot of what we do has also been based upon the "we've always done it that way" routine and some pushing might be OK.
In all things, Test your equipment in situ, that kinda means in the situation. Fletch them up five ways to heck, put on a big broadhead, a small braodhead, shoot it dry and wet (safely).
Then YOU have the answer you are looking for. Ask for opinions, sure, but do your own homework. That is called experience and it is a good thing.
ChuckC