jb55 on Nostr: nostrdb is now much faster than strfry when processing duplicate incoming events. ...
nostrdb is now much faster than strfry when processing duplicate incoming events. strfry will fully parse and validate an event before checking if it exists in the local DB. nostrdb will:
1. Check if the ID exists in the database without fully parsing the event
2. Only validate the event if we don’t have it in the database yet.
Processing 4GB of duplicate contact lists now takes 200ms instead of 6 seconds on an old laptop.
This matters a lot on mobile devices where we don’t want to burn battery when we don’t need to
insane optimization: check id existence before parsing entire json (William Casarin)
pushed to nostrdb:refs/heads/master
http://git.jb55.com/nostrdb/commit/e87228d19ad6965fd143bdf9a962f7d904fc4e33.html
Published at
2023-08-10 05:32:59Event JSON
{
"id": "bc312b9053228bcb756cf82117ab21e855e7f76fb5e2578638e0e06dc781e92a",
"pubkey": "32e1827635450ebb3c5a7d12c1f8e7b2b514439ac10a67eef3d9fd9c5c68e245",
"created_at": 1691645579,
"kind": 1,
"tags": [
[
"q",
"1814b4132221a5e5c1046eda563308decffe709f44b865ecb0d9c8acc6be1c25"
],
[
"p",
"4c96d763eb2fe01910f7e7220b7c7ecdbe1a70057f344b9f79c28af080c3ee30"
]
],
"content": "nostrdb is now much faster than strfry when processing duplicate incoming events. strfry will fully parse and validate an event before checking if it exists in the local DB. nostrdb will:\n\n1. Check if the ID exists in the database without fully parsing the event\n2. Only validate the event if we don’t have it in the database yet.\n\nProcessing 4GB of duplicate contact lists now takes 200ms instead of 6 seconds on an old laptop.\n\nThis matters a lot on mobile devices where we don’t want to burn battery when we don’t need to nostr:note1rq2tgyezyxj7tsgydmd9vvcgmm8luuylgjuxtm9sm8y2e347rsjshgx7gh",
"sig": "bb60b6905a67015caba675d8d222f9db37689e58343b1bf4f2359f63d068f3e68c96e2fcf9ef7a7ce6f051aacd4077e438cda597a957d758c842d162498f6bbb"
}
