The current research has debunked the skim milk experiment and shown that whole milk is better for you because the fat in it is good fat, relatively, and better than what they replace it with when they take it out.
So don't feel guilty and drink up the whole!
http://time.com/3734033/whole-milk-dairy-fat/