Gzuuus on Nostr: Meta paradox: the more context they have, the more their performance degrades; it ...

Meta paradox: the more context they have, the more their performance degrades; it doesn’t matter if they have a 1M token context window, once it exceeds 100 k they normally start to get exponentially confused, especially if that context window contains inconsistencies or repeated failures. The solution? Treat all of this as research, not as a production ready thing

quoting
nevent1q…skku

Here its the paradox: Agents need data, so called context; the more data they have, the more useful they are, and vice versa, the less data, the more useless they become. If you want to squeeze all the potential out of them, you have to give them free access to everything. That shouldn't need to be a problem, BUT the reality is you probably will need an upstream provider to do something useful, so you are sold. Sleeping agents are something to be worried about, you are sold. Random prompt injection attacks when fetching a website/skill, you are sold. Other agents that are instructed to scam naive agents, you are sold, or better put, a cryptobragent sold a new scam token to it, and probably paid with your money. We have to be conscious about all of this, not a doomer, just trying to cultivate some perspective to do things right.
nevent1q…flyr