Join Nostr
2025-03-08 14:25:37 UTC
in reply to

Matteo Capucci on Nostr: nprofile1q…ze5g0 That's a very clear rundown, Bartosz. However there some things I ...

That's a very clear rundown, Bartosz. However there some things I still don't get about attention... For starters, I don't see why we need values though, specifically the matrix W_V. Why can't we just use the context vectors again? What's the difference between E and V, intuitively?