I have a similar problem. It feels silly to buy a huge house just for two of us. But then you never know how big the family will be and you want to be sure everyone will get enough space. Though if we only have 1 child, there is no need for all that space. Never thought it would be such a difficult decision.