OMG AMD ROCm is a mess to get working for GPU accelerated LLMs... 🤮. They need to get their act together.
Finally got it working for somebody, but I see why most people go out of their way to avoid having to deal with their libraries...
Citizen
npub1p0…qmsfc
2025-08-25 18:27:21 UTC
Author Public Key
npub1p0a82zgmmaf8msys7p5ffn9l0c976f548a4l7hrsd4w2sjk6g8hsqqmsfcPublished at
2025-08-25 18:27:21 UTCEvent JSON
{
"id": "8e6fa0ed514c9b83cd1c9c84e8c767dc25cca62ac73cd7a4500977b10408b7a1",
"pubkey": "0bfa75091bdf527dc090f06894ccbf7e0bed26953f6bff5c706d5ca84ada41ef",
"created_at": 1756146441,
"kind": 1,
"tags": [
[
"alt",
"A short note: OMG AMD ROCm is a mess to get working for GPU acce..."
]
],
"content": "OMG AMD ROCm is a mess to get working for GPU accelerated LLMs... 🤮. They need to get their act together.\n\nFinally got it working for somebody, but I see why most people go out of their way to avoid having to deal with their libraries...",
"sig": "1441c16585017a5f452d7707f350cf14e4c1e6411d5604d8cc6613908d79473b86a21cc2b871d28d3bb05e3b19f05cf183da9725ad7793373660d3a2aacd0587"
}