Another factor is that the spoon you use is (hopefully) made of metal. Metals conduct heat very well, meaning that the spoon itself will quickly absorb some of the liquid’s heat (and thereby become warm or even hot to the touch), and also help transfer heat from the lower layers to the air. Of course, this effect doesn’t require the stirring action itself, it’s enough for the spoon to just sit in the cup.
Latest Answers