I am not really a Harry Potter fan, and I love Hogsmeade/Diagon Alley.
I've seen the movies, but haven't read the books. It's all well done. Get there early and do the attractions before the crowds get there, walk around and check out the shops. Buy some butter beer. You'll enjoy yourself.