Only looking at record and not who they've played is meaningless. The Atlanta Falcons are 3-7, but my local high school team is 6-2. Definitely doesn't make beating the HS team more meaningful.

Clearly a bit of an exaggeration, but it illustrates the point