@[url=https://microblog.shivering-isles.com/users/sheogorath]Sheogorath[/url] @[url=https://fosstodon.org/users/adingbatponder]adingbatponder 👾[/url]
That is not true on all accounts. You can train local LLMs on GPUs as modest as a RTX 3090 and even lower if you are willing to wait. In regards to the amount of data you need it depends on whether you are trying to make general purpose LLM or a Domain Specific LLM. The quality of the data means more than the quantity. A local LLM would be trained with a tool such as pytorch to add weights and meta data and then you would apply quantization to make it accessible for consumer based hardware.
Nothing you said is true today in regards to training an LLM, about 20 - 30 years ago you may have had a point, where did you get this information? Take a look at the docs on [url=https://huggingface.co/docs]Hugging Face Docs[/url] and the docs for [url=https://github.com/ggml-org/llama.cpp]Llama.cpp[/url] for details on how you can actually train an LLM. A modern gaming machine would be more than enough consumer grade power to train an LLM.
