Umm.. honestly I'm not sure.. IRL I work with alot of different models, but mostly risk models.. I have little to no experience with language models.
However, content recommendation algorithms can be quite useful, Netflix is really good at recommending shows I might like. Pandora good at recommending songs I might like. Etc.
I think the danger is a single algorithm out of user control pushing the narrative top down... I imagine that if there were many competing algorithms that clients could kind of download and plug and play in to their client they could be a really useful tool.