Do what I did. After decades fishing northern Pa, NJ and northwest NY I moved to Florida! Seriously though Gore-Tex Windstopper works wonders. Thermal underwear, insulated boots. Keep your head covered, most heat is lost through your noggin and don't rely on a ballcap.
Congrats on getting your wife to fish with you. Already a lot of good suggestions but I have suffered in the cold and don't anymore. I fish all winter until the line freezes to the rod and no longer get cold so let me tell you my way.
Head - cover with something .
Upper Body - long handle shirt + fleece shirt ,now duct tape hand buddy warmer to your chest ( duck tape to fleece shirt,not to skin) and put a jacket over this .The warmer provides a surprising amount of heat.
Hands- Fold back mittens with a stick on hand warmer in each
Legs- layers with hand warmer in each pocket,if needed.c
Feet- Insulated boots. Will socks. Now stick hand warmers to the socks . If really cold ,you can add another pair of socks.
Good Luck Fishing