Of course they will. But you said the average buyer refis or sells every 2-3 years. That's dependent on a lot of refis.
The average person doesn't sell their home every 2-3 years, and that's going to be especially true if prices go down. A lot more people will be holding onto what they've currently got if the economy tanks.