Do you process each event to load into neo4j as it is ingested by the relay? And do you have a system to track events that were ingested by the relay but not loaded into neo4j for whatever reason?
My system is broken down into lots of steps that I run separately. I have to do that bc I’ll often ingest a large number of events at once and they come in too fast for neo4j to process them in real time. Example: when a new kind 3 note gets ingested, I have to see if it’s newer than the current one; if so, add new follow relationships and remove any that have been deleted.
straycat / david
npub1u5…rldq3
2025-01-29 04:14:47 UTC
in reply to nevent1q…h7yj
Author Public Key
npub1u5njm6g5h5cpw4wy8xugu62e5s7f6fnysv0sj0z3a8rengt2zqhsxrldq3Published at
2025-01-29 04:14:47 UTCEvent JSON
{
"id": "0265d6864ba2add91df79c3876e6fbe142d2800653f125e8535cb47607edde67",
"pubkey": "e5272de914bd301755c439b88e6959a43c9d2664831f093c51e9c799a16a102f",
"created_at": 1738124087,
"kind": 1,
"tags": [
[
"e",
"5103976ac2c5655adcfd95e9b3e3666bd1cf638d455703d0a823aa17411526e0",
"",
"root"
],
[
"e",
"e28e9abbb3f94a781f4e4b445863f94ae429a105af1f40c5b890cba03e9a5b91",
"",
"reply"
],
[
"p",
"7ed7d5c3abf06fa1c00f71f879856769f46ac92354c129b3ed5562506927e200"
]
],
"content": "Do you process each event to load into neo4j as it is ingested by the relay? And do you have a system to track events that were ingested by the relay but not loaded into neo4j for whatever reason?\n\nMy system is broken down into lots of steps that I run separately. I have to do that bc I’ll often ingest a large number of events at once and they come in too fast for neo4j to process them in real time. Example: when a new kind 3 note gets ingested, I have to see if it’s newer than the current one; if so, add new follow relationships and remove any that have been deleted.",
"sig": "cb7f5394d51311b532ee8ae667bcb717120d4c754bbb88c97d4c834449ebfaf41c803802dd608e972b8927f04c9ac357e5709198f1fde0fefe6a93f510333143"
}