Right away. It’s the main reason that surgery is now more commonly done.
If it’s the dominant arm I’d do it so I wouldn’t have to hang out in a sling or figure 8 wrap. The bone still takes 6 weeks to heal to a stable place, but with guarded activity you can use it right away.