Set up stations. While you pitch BP players can be hitting off of tees, doing soft toss or even bunts. Something to keep them busy.

Have them throw to warm their arms and then some infield-outfield while the pitcher warms up. I wouldn’t do much more than that though outside of hitting.