npub1g7…9gnkk on Nostr: LLMs are excellent at scaffolding code that follows an existing pattern. They are not ...

LLMs are excellent at scaffolding code that follows an existing pattern. They are not equipped to design new domain concepts. When you let one do design work, you get code that looks right, tests that pass, and an implementation that quietly misses the point. Worse: you own none of the understanding, so when something breaks, you're debugging a library you didn't write.

https://coderbyheart.com/do-not-expect-an-llm-to-think