Kenny,
I started doing this several years ago. After a week long hunt in rain and bitter cold I had problems. It would warn up enough during the day to rain instead of snow, but at night it would drop into the upper teens.
After returning home I noticed a hair line crack in one wedge. Can't say for sure if the swelling was due to the moisture or if it was from freezing at night.
Anyway, since then when I build a bow I take a Q-tip and rub atleast two coats of epoxy sealent (Massey Finish) in the holes. Since then I've not had any problem.
Troy