Clay will release and absorb moisture, from both air and surrounding soil. Great for traditional ovens, not great for a room with books, electronics...
Drywall: same problems.
Concrete less so but still permeable. Can be sealed on the surface but risk of water pressure pushing it off after rains.
Metal will corrode.
Not fond of fibre-reinforced plastic, but maybe best option.,,?