LLMs that are trained on data and released for general usage certainly confabulate, or as I say, bullshit.
But a focused LLM would be less prone to that because it would only answer certain questions.
I'm not speaking as if I don't know anything about LLMs. If you peruse that website, you'll find I'm pretty much against most common usages.