Thought of the Day

The phrase "cream of the crop" makes no sense to me. Cream is not an agricultural food item. Does the phrase allude to creamed corn? Shouldn't the phrase be "cream of the milk," since the best part of milk is the cream?