It is generally less crowded. Stay away from Venice with your family. But really you need to go to San Diego. La Jolla shores, Pacific Beach and especially Coronado are head and shoulders above anything in the LA Area.
Edit: and as AFCoug mentioned - Carlsbad.
Edit 2: The nicest beach is Blacks Beach right below USD. But definitely don't take your kids or your self righteousness