iefan 🕊️ on Nostr: Many experts in the field believe that the Transformer architecture might be hitting ...

Many experts in the field believe that the Transformer architecture might be hitting a wall. Additionally, this architecture is not well-suited for decentralization.

We definitely need a breakthrough—something better.