I am having this problem right now! Have started looking across state lines, as it's definitely cheaper, but finding something within an hour's drive of where we currently are and without lot fees or HOA's have been hard. Poor realtor I'm using is probably at his wits' end. Even affordable lots to build on end up being in HOA neighborhoods/communities!