Today I tried out something that worked out really well. I bought some cheap $10 tight fitting fleece gloves from MEC and I put nitrile gloves over them. This turned out to be a cost effective way to get wind/waterproof gloves that are warm. The nitrile layer surprisingly helped to keep my hands warmer than if they weren't there. I figure it has to do with it being non-breathable and creating a small dead air section.
Another bonus was I could handle fish and bait without having to worry about the fish's health or dirtying the fleece gloves. All in all, there was some loss of finger dexterity, but I was still able to cast/thumb and tie well enough. Either way I would definitely suggest trying it out. Just make sure you buy tight fitting fleece and nitrile gloves. Also make sure to bring extra nitrile gloves in case a hook punctures it.