slembcke on Nostr: nprofile1q…0622w Local models are actually surprisingly good at ...

nprofile1qy2hwumn8ghj7un9d3shjtnyd968gmewwp6kyqpq0q8eanytqf3m9jd0fqvxu6r63lt6jle9qgyxfrd97zv2nwfa8cpq30622w (nprofile…622w) Local models are actually surprisingly good at understanding/explaining code (eh... kinda?), but I tried having them fix bugs that I already fixed and they just... couldn't. In the one case I tried a half dozen 30+ billion param models to implement a simple feature in my Lua debugger. Something I did in 2 lines of code in 5 minutes. I gave them all *hours* to do it and they just... couldn't. The closest I got was that one hand inlined a function that was ~5% of the total debugger size.