That 4% interest is *annual* interest. Most loans are taken out for more than one year, and you'll typically pay a LOT of interest. Early-on in a loan, often times you're paying *more* in interest than principal.
Furthermore, at the end of the day these loans have to be paid back with taxable income.