Art Model wanted new stadium. The current one had been built around 1932 to attempt to allure the Olympics. It was not a good stadium for football. One, until the Indians finished their season, the field was part dirt from the baseball infield. When it rained it was pure mud. I have in my office a pic of Cleveland vs. Green Bay and they look like they're in a mud pit wrestling. After baseball ended they'd put some type of sod that stuck. The problem was for football, the filed was so far away from the sides of the stadium because of needing a track for olympics. You could have great seats and it still seemed a mile out onto the stadium.
2nd season away, the Baltimore Ravens then win the Super Bowl, which has alluded the city of Cleveland forever.
Yes, you pay to watch them play in your town or they go to a town that will.