Traditional plaster was clay. Free and accessible, if not very good. "Lime plaster" being that with a dollop of lime to improve hardness.
Then status-seekers got into imitating the "plaster-of-paris" (gypsum). Its better, but not a lot better. Just as heavy, nearly as fragile, and requires transport over long distances if you don't live above a major deposit (as Parisiens did).
Whhhhyyyyyy...?