They went to an elite 8 the year prior to Coach K. In '79 they made the tourney and in '78 they played for a title.
3 tourneys, 2 elite 8s and a national title appearance in the 3 years immediately prior to Coach K. That is something.
Coach K's accomplishments would be amazing anywhere, but it wasn't like he was doing this in some basketball wasteland.