<oembed><type>rich</type><version>1.0</version><title>semisol wrote</title><author_name>semisol (npub122…cgrkj)</author_name><author_url>https://yabu.me/npub12262qa4uhw7u8gdwlgmntqtv7aye8vdcmvszkqwgs0zchel6mz7s6cgrkj</author_url><provider_name>njump</provider_name><provider_url>https://yabu.me</provider_url><html>The problem with these models, in general, is that they are reward-maximizing.&#xA;&#xA;They have no real intelligence, capability to engineer, or creativity to speak of.&#xA;&#xA;This makes them great for verifiable tasks where you can get away with “guided brute force”, but for anything else it ends up being not very good.&#xA;&#xA;I think the recent RL on “one-shotting apps” may have also made them worse at anything that isn’t one-shotting apps</html></oembed>