nprofile1qy2hwumn8ghj7un9d3shjtnyd968gmewwp6kyqpqh659u7uz26ggxc9t534espqa3scnduw7fqhzcw86z74ejd0xsdpsxfdfxr (nprofile…dfxr) Yepp, bandwidth-bound workloads benefit most (as I found optimizing this: https://github.com/gicrisf/qwen-asr-rs/tree/bf16-gemm)
In this case, most of the gain comes from the weight matrices: this avoids allocating temp f32 buffers and halves input/output memory traffic
Giovanni Crisalfi
npub1d6…l3fm6
2026-03-29 17:37:43 UTC
in reply to nevent1q…p2k0
Author Public Key
npub1d6jul9s08n9ucxpn9kj04gcvkcxuqdtp6cm3sm82f2rr8wh2qg2qnl3fm6Seen on
wss://relay.ditto.pubPublished at
2026-03-29 17:37:43 UTCEvent JSON
{
"id": "7af0dbcf8920e1f21910c6a577e19b86325ef3174616231f30a5e3616efa6523",
"pubkey": "6ea5cf960f3ccbcc18332da4faa30cb60dc03561d637186cea4a8633baea0214",
"created_at": 1774805863,
"kind": 1,
"tags": [
[
"p",
"bea85e7b8256908360aba46b98041d8c3136f1de482e2c38fa17ab9935e68343",
"wss://relay.ditto.pub"
],
[
"p",
"74ae72ccb55a5bf0f441ea4192929690715ff1922ba0d7fa253a361e5b1a45a9",
"wss://relay.ditto.pub"
],
[
"e",
"08e39baa71e16ec4463b128fdb7c36555708db06a436ad12e7bb8379d298343d",
"wss://relay.ditto.pub",
"reply"
],
[
"proxy",
"https://fosstodon.org/users/gicrisf/statuses/116313677056187115",
"activitypub"
],
[
"client",
"Mostr",
"31990:6be38f8c63df7dbf84db7ec4a6e6fbbd8d19dca3b980efad18585c46f04b26f9:mostr",
"wss://relay.ditto.pub"
]
],
"content": "nostr:nprofile1qy2hwumn8ghj7un9d3shjtnyd968gmewwp6kyqpqh659u7uz26ggxc9t534espqa3scnduw7fqhzcw86z74ejd0xsdpsxfdfxr Yepp, bandwidth-bound workloads benefit most (as I found optimizing this: https://github.com/gicrisf/qwen-asr-rs/tree/bf16-gemm)\n\nIn this case, most of the gain comes from the weight matrices: this avoids allocating temp f32 buffers and halves input/output memory traffic",
"sig": "b4627da462aaab4d068df62c62668485d91328f8c86eaca13a353eef448cbe85c46f086cef9efb90dbd00736b636f06f14828e76ff45b7ff5cce881e6254aebb"
}