captjack 🏴☠️✨💜 on Nostr: vLLM is hard vLLM is best for multiple GPUs in same LAN or riser. vLLM container~14GB ...
vLLM is hard vLLM is best for multiple GPUs in same LAN or riser.
vLLM container~14GB
nvidia cuda docker passthrough is MUST
#AI local python
Published at
2026-11-18 19:59:28 UTCEvent JSON
{
"id": "00003a66ab442951023b19546a52af7153139957de72735d00f029a32d8838aa",
"pubkey": "5e5fc1434c928bcdcba6f801859d5238341093291980fd36e33b7416393d5a2c",
"created_at": 1795031968,
"kind": 1,
"tags": [
[
"t",
"ai"
],
[
"nonce",
"65157",
"18"
]
],
"content": "vLLM is hard vLLM is best for multiple GPUs in same LAN or riser.\n\nvLLM container~14GB\n\nnvidia cuda docker passthrough is MUST\n\n#AI local python",
"sig": "7aedb474c4c3f1bf08d3f9a63b256e3a67d7f995d58980d5e8efa0e892115ac18bd270bfb76c493bf0418d8255394a050781971a49910d2de280623fefcc81a5"
}