Couple more thoughts--this guy had a book on Kindle that I read this month and it swayed me against condos:
http://condo-helper.com/101-reasons-not-to-buy-a-condo/
You can read some free here or get the book free on Kindle.
If one is downsizing for retirement, then one would be better off with no mortgage, right? At least that is how I see it; pay off bigger house and pay off mortgage and pay cash with what is left over, not to exceed that, so that your basic housing needs are met through retirement. So that would be my gameplan, if thinking of downsizing and leaving one more expensive part of country for a less expensive part.
We've done that, but I would honestly move close to my kids if I had a choice, and this is too far. So I can understand why Vermont better than say, Arkansas or Tennessee or some other nice tax state.