That is the number that really will kill your financial future.
After you get the price for sure, save up to the amount that will give you best rate and the home. Your mortgage guy will tell you what you need. Also should have an emergency fund.
Lastly, consider renting. In many circumstances buying is way overrated.