History says you will do just fine. Yes we do have ups and downs in housing and stocks but I have yet to see the Real Estate or Stock market stay down permanently. The median home price in 1990 was $79,100. In 2000 it was 119,600.
In March of 2009 the Dow Jones Industrial Average was 6600. Think long term!