Navy joins the AAC next year, so will only have 4 games a year. They have a near annual game with Notre Dame, play Air Force and Army every year, leaving them one game a year to play another team.
AF has a similar issue, since the play Army and Navy every year, and like to play a weaker team on parent's weekend. So they have one "free" game per year.