rich1.0semisol (npub122…cgrkj)https://yabu.me/npub12262qa4uhw7u8gdwlgmntqtv7aye8vdcmvszkqwgs0zchel6mz7s6cgrkjnjumphttps://yabu.meLLMs struggle with good software dev, especially on implementing novel things, and maintainability. The best way them to view them is as a really expensive machine translation from English to code. There are probably a few reasons: 1. ML models have limited generalization capability ML models can only "do" what they have been trained on. What is outside of that can't be reliably represented or processed by the model, and so trying to do anything outside that will lead to weird results. 2. Biases in training data Models are trained with a lot of data. The pre-training dataset can significantly bias the model (for example preferred frameworks, tools or "suggestions"), and so can the post-training (which is what results in models having a certain "design" style, or the LLMisms) 3. Reinforcement learning The RL stage of a model optimizes for things like the number of tool calls, and a binary pass metric. The problem is that, just like human-made code, it is easier to hack on a fix than to properly integrate it. The model is not trained for achieving anything more than satisfying your request with the bare minimum, and so you will accumulate layers of slop and slop.