Unless you're including coaches talking or the batter taking practice swings or adjusting jersey there actually is a lot of time where nothing is happening in baseball (same is true of football incidentally).
If you're looking for a game where something is always happening, even if it doesn't always seem meaningful on the surface, then I'd recommend taking a look at soccer