That period of making $$ might be in your favor. Social Security payments are proportional to the amount you paid in over your max earning years (there's also a minimum number of years to be 'vested'). At 100K, you were probably paying the SS max - which could turn into getting the max payout (3ish K / month at 70yo). And a non (or less) earning spouse can collect half of that. Don't take it from me - talk to a financial planner (you'd probably need a US based one for this).