npub1jpp36eeycvlkkdy4d4l4lgswvf8jtdare5vly0w0sk7rc39pzgrqlyu59l (npub1jpp…u59l) general consensus these days is that training a custom model on your own data isn't the right approach - you probably want RAG, Retrieval Augmented Generation
I need to write more about that - here's a few links:
- https://simonwillison.net/2023/Aug/27/wordcamp-llms/#retrieval-augmented-generation
- https://til.simonwillison.net/llms/embed-paragraphs
Simon Willison /
npub13v…4w5eu
2024-01-01 19:04:43
in reply to nevent1q…gryc
Author Public Key
npub13v97j0kknscwnf5pt87nsn7cxzxwfwl3dsu7ss8qsq7ukmqgwg8q84w5euPublished at
2024-01-01 19:04:43Event JSON
{
"id": "155579ee6acfd8d98757cb2c32328bcd0700822e1966327529fc2de9429005af",
"pubkey": "8b0be93ed69c30e9a68159fd384fd8308ce4bbf16c39e840e0803dcb6c08720e",
"created_at": 1704135883,
"kind": 1,
"tags": [
[
"p",
"90431d6724c33f6b34956d7f5fa20e624f25b7a3cd19f23dcf85bc3c44a11206",
"wss://relay.mostr.pub"
],
[
"p",
"e653eb60b2db5edf906d354c2825bf00a80dfab1b1766cd97805155e8fcc0db3",
"wss://relay.mostr.pub"
],
[
"e",
"65d9b10f8b96172ab4993c25f1b2f50796feac75487f18cab6400ecb92bb96a2",
"wss://relay.mostr.pub",
"reply"
],
[
"proxy",
"https://fedi.simonwillison.net/users/simon/statuses/111682249240449394",
"activitypub"
]
],
"content": "nostr:npub1jpp36eeycvlkkdy4d4l4lgswvf8jtdare5vly0w0sk7rc39pzgrqlyu59l general consensus these days is that training a custom model on your own data isn't the right approach - you probably want RAG, Retrieval Augmented Generation\n\nI need to write more about that - here's a few links:\n- https://simonwillison.net/2023/Aug/27/wordcamp-llms/#retrieval-augmented-generation\n- https://til.simonwillison.net/llms/embed-paragraphs",
"sig": "48aca546b2a4bc1be615e6c3ab97686806145b272c5aa8ca6d20ae544b674dfe6b78c945e1fbe88c2fc40b0171f381686a2edc8f031a84608223bc942118da1a"
}