AI6YR Ben on Nostr: I think it's just a side effect of the training. They're using a generic LLM trained ...
I think it's just a side effect of the training. They're using a generic LLM trained on "everything" in the world, multiple languages, multiple styles, and it mashes them all together. It's not like they trained it on, say, all the source code written to a high spec and documented and peer reviewed at IBM, or whatever company. Instead, it's code Joe Hacker posted on a forum, etc. etc. etc. Reddit, etc. and it all gets mashed into a kind of soup, which is inconsistent....