There are a couple things that might do it.

I'm guessing skim milk might jack it up. I think I've done that once for lack of other milk. I think not using quick cooking oats probably adds to it.

Other than that, maybe the more butter, less milk thing.

I'm heading in.