The comment about temperature is significant. If you look at each as an insulating layer, it isn't surprising that hay keeps the heat of the soil.
The other point of interest was dew. A body of still air entrained in vegetation and well insulated.
Compost contains much less air than straw.
Competition between plants for water seems trivial compared with the water loss they collectively prevent by being tightly packed.