If they are sought after, then its not big deal because new teams will want them and their old team (that they just left) will want them back too and will hold a spot for them for a reasonable amount of time.

If they are borderline, then their old team might not want them back.

So truly entering "free agency" every season could have a drawback.