scsibug

author of nostr-rs-relay, operates nostr-pub.wellorder.net

Public Key

npub1xhfxu35se0s63x90v8xr29txr66l5a3m277skshy2zvu3ve0658sla4xw3

NIP-05 Address

scsibug@wellorder.net

NIP-57 Address

outsideice77@walletofsatoshi.com

Profile Code

nprofile1qqsrt5nwg6gvhcdgnzhkrnp4z4npad06wca400gtgtj9pxwgkvha2rcppemhxue69uhkummn9ekx7mp0qyxhwumn8ghj7mn0wvhxcmmv2adnkx

Publishing to

nos.lol

relay.noswhere.com

Author Public Key

npub1xhfxu35se0s63x90v8xr29txr66l5a3m277skshy2zvu3ve0658sla4xw3

Show more details

Last Notes

2023-09-15 23:05:25

- reply

Lol, my relay has reliably exceeded 30TB/month for all of 2023. It is a bit wild and inefficient.

2023-08-10 19:49:39

- reply

I've got a black lightning beanie and a macbook, CTF'ing near the DJ stand.

2023-08-10 19:27:33

For anyone at #DefCon I will be in the SomaFM chill-out lounge for the next hour. Anybody who wants to meet up and grab lunch or talk, send me a DM!

2023-08-08 23:09:53

- reply

Let's do it. Maybe grabbing lunch tomorrow after getting badges?

2023-08-05 11:31:51

Anybody going to be at #bsidesLV or #defcon next week? I will be at both, would be great to have an informal Nostr meetup for anyone in LV.

2023-07-03 16:38:34

- reply

Sorry, this one escaped onto the network, was meant to be local only (and this is a broken example). Reviewing https://github.com/nostr-protocol/nips/pull/635 to see what we should do for escaping control characters other than /n and ", such as the bell character (\b or 0x07).

2023-07-03 16:31:20

This is a test of an event with a bell \b.

2023-05-14 02:11:52

We made it guys, we are on the map! https://anvaka.github.io/map-of-github/#9.34/-29.1725/45.2594

2023-05-06 19:46:08

- reply

If you used my sample docs to setup HAproxy for a relay, check out this patch that ensures Damus requests make it to the correct backend: https://git.sr.ht/~gheartsfield/nostr-rs-relay/commit/1595ec783d1312206c0a1d7c66b5bfa1ff83f3a4

2023-05-06 19:34:32

- reply

Fixed! Minor difference in how Damus sends a Host header (for default ports, damus sends hostname:port, even for default ports) compared to other clients. My HAProxy rules were doing an exact match for the hostname, changed it to a prefix match, and all works!

2023-05-06 17:35:26

Loaner iPad acquired, gonna finally figure out why Damus and wellorder relay can't seem to talk. #[0]

2023-05-04 00:14:22

- reply

What service is hosting that? I am not running on a CDN, but hetzner has free egress (I do 30-50TB/month on my instance for about $40/month).

2023-05-03 20:36:46

- reply

Are you sure that one of those pubkeys doesn't have 40 events more recent than the other?

2023-05-03 20:32:06

- reply

I can't duplicate on nostr-rs-relay/sqlite. This query shows results for both pubkeys:
```
["REQ", "lim", {"authors": ["35d26e4690cbe1a898af61cc3515661eb5fa763b57bd0b42e45099c8b32fd50f", "887645fef0ce0c3c1218d2f5d8e6132a19304cdc57cd20281d082f38cfea0072"], "limit": 10}]
```

2023-05-03 20:22:11

- reply

I agree that would be a bug. The query should sort by time, and show the most recent 40 events taking into account both pubkeys and the age of their respective events. I will try and duplicate it myself.

2023-04-30 19:11:57

Heading back home from bitcoin++; Thanks to all the great speakers, organizers, volunteers, and attendees (best of luck to all for the hackathon) and many new friends. Thanks #[0] for the invite, it was a fantastic experience for me!

2023-04-30 12:57:26

- reply

Thank you, so glad it went well, and I hope it helped demystify how nostr works for people. This crowd is building such wildly cool stuff.

2023-04-26 02:39:49

- reply

Keeping an eye on this, what a great vision.

2023-04-24 20:35:59

- reply

Wild, just noticed that my webserver was a bit busier than usual!

2023-04-23 15:26:44

Are paid relays automatically whitelisting pubkeys for lnurl/wallet providers associated with their paid users?

2023-04-22 19:08:06

nostr-rs-relay 0.8.9 out; includes experimental pay-to-relay support, new jemalloc allocator, and other various improvements. https://git.sr.ht/~gheartsfield/nostr-rs-relay/refs/0.8.9

2023-04-10 20:19:13

I will be giving a talk on Nostr at the Bitcoin++ conference in Austin TX, end of this month, hoping to meet some other nostr people! https://btcplusplus.dev/talks#nostr

2023-04-07 20:37:11

- reply

No longer believe the TLS theory since I have identified Damus user agents connecting for NIP-11 relay info successfully. Have not found any Damus clients even sending an HTTP upgrade request for a websocket, so I am still in the dark. Will try to get my hands on an iPhone sometime and try myself.

2023-04-05 17:56:33

- reply

Will investigate this evening, hoping it will be possible to duplicate with Safari on my Intel Mac... Thinking it is TLS related.

2023-04-05 16:03:48

- reply

I do not know what is broken. I do not have an iPhone to test Damus with.

2023-04-05 02:12:57

- reply

Next time! We will be back for sure.

2023-04-04 19:26:46

- reply

Configuring is easy, just point to a gRPC server endpoint. Implementing the spam filter is left as an exercise for the reader... Big opportunity for projects to do stuff here. Mine isn't open source cause it is a bit too hacky to support at the moment (I have some homebrew jobs that analyze events for a bayes model).

2023-04-04 12:59:26

Very nice too that my relay survived basically a month of being ignored, spam filter worked great.

2023-04-04 12:57:35

Back from my honeymoon to Italy! Milan, Tuscany, Florence, and Monza; My first time to visit Europe, an unforgettable and beautiful start to marriage with my amazing partner for life!

2023-03-30 19:44:36

- reply

And for the record, I was an early bitcoin adopter and then skeptic for years, before getting more excited about it after nostr. So please feel free to have your own opinion of any crypto.

2023-03-21 00:11:03

Heading out to my honeymoon in Italy shortly. 🫂 to everyone attending nostrica in person or virtually, it looked amazing down there! Be back in April!

2023-03-06 23:46:42

- reply

Added support for these in nostr-rs-relay, so if you run that, you can point to an icon in your config file.

2023-03-03 12:38:12

- reply

I run nostr-pub.wellorder.net and would be honored to care for your notes, as well as other stuff.

2023-03-02 03:31:07

Geez; hit 500 megabits/sec upload on my relay. Y'all clients need to chill. I'm sure there is something interesting happening on twitter or something, I dunno. #MarchOffTwitter

2023-03-02 00:36:15

- reply

Tagging #[3]

2023-03-02 00:35:37

- reply

That one is a 156 KB REQ; I seem to get a ton of them. Hopefully iris.to can look into/fix this... otherwise I may have to break this one :/

2023-03-02 00:33:47

iris.to sending some very strange REQs that send stuff like: "authors":[{},{},{},{},{},{},{....

2023-03-01 13:34:58

- reply

On Android, it is as simple as installing Wallet Of Satoshi. Amethyst will find it automatically.

2023-03-01 13:32:55

- reply

My notes (and others) from back in 2021 are still on nostr-pub.wellorder.net. You may be seeing relays that only return a limited number of results for a query (1000), plus clients that don't work well with that (just a guess).

2023-02-28 23:32:33

- reply

Unclebob maintains a cool desktop client, more-speech (clojure).

2023-02-28 23:21:17

Thanks for the zaps, #[0]. Really appreciate the support!

2023-02-27 13:50:10

- reply

#2 and #3 are tied for me.

2023-02-26 16:46:39

Reading up on timely-dataflow (https://github.com/TimelyDataflow/timely-dataflow) today. Would be awesome to have an incremental pagerank/trustrank running against nostr pubkeys.

2023-02-25 23:38:40

- reply

For my relay, I have higher rate limits for nip-05 pubkeys. It is just one signal among many and reduces false-positive spam hits; I would very much like to keep things open for any non-abusive account, regardless of nip-05. I do monitor the rejected events, and am fairly confident I only kick out spam (as defined by me).

2023-02-25 19:40:47

- reply

Right now it is a strong signal that you are legit (almost all spam is _not_ NIP-05 verified). If it is from a legit domain, even more so. NIP-05 domain operators have some motivation to not verify spam accounts. I don't expect to see spam being a problem from nostrpurple.com, for example.

2023-02-24 03:55:27

- reply

Nothing public, but I would encourage you to look at both the gRPC API for nostr-rs-relay and the example code in the repo (only a rust sample, but contributions welcome), and the great work at https://spam.nostr.band/ to provide approaches and data. Feel free to DM me with any questions!

2023-02-23 22:00:54

- reply

I only hope we're having as much fun as the PHP people.

2023-02-23 21:55:44

- reply

Any NIP-05 is a plus. I have a list of 100+NIP-05 domains that have been around long enough to get extra bonus points. If you just post normally, you'll get added to that over time and the spam filter will be even less likely to affect you.

2023-02-23 21:06:02

- reply

For my (free) relay, NIP-05 validation and/or PoW is the best way to ensure your events get persisted. But most non-spammy events make it through just fine.

2023-02-23 21:05:07

- reply

We absolutely are. I'm blocking hundreds of thousands of events a day.

2023-02-21 13:27:51

- reply

If you want a public relay that is happy to be used for development/testing, I have wss://nostr-dev.wellorder.net just for that.

2023-02-21 13:26:25

- reply

Indeed, nostr-rs-relay supports an in-memory mode (SQLite). Just set database.in_memory=true in the config file.

2023-02-18 23:20:34

- reply

IP blocks; block known spammy strings; bayes spam filters, require PoW, require payment, whitelist pubkeys and their follows, and aggressive rate limiting... or some combo of all the above.

2023-02-18 22:35:09

- reply

Ya, need software details, nostr was meant for terminals!

2023-02-18 03:08:37

- reply

Lol, that didn't last long. 0.8.7 has fixes for a couple embarrassing bugs for logging & postgres SQL.

2023-02-17 20:19:15

nostr-rs-relay 0.8.6 now out; with support for expiring events (NIP-40) as well as authentication (NIP-42). Cheers, and thanks to contributors #[0], #[1], #[2], and rorp!

2023-02-16 03:05:16

- reply

Amazing, thanks for sharing!

2023-02-15 21:59:04

- reply

Noticed this too. Hitting my domains that have zero nostr identities associated.

2023-02-15 19:12:32

- reply

Not in WAL mode: readers and writers can proceed without blocking one another. Checkpoints can be an issue for concurrency, but that can be worked around.

2023-02-15 19:06:55

- reply

Plan is most likely to allow gRPC to deny, permit, or permit w/expiration. Need to implement the expiration NIP first, that is going to be a little tricky to not have a performance regression on.

2023-02-15 19:04:49

- reply

SQLite can use many cores, and even multiple processes. There are some gotchas, but generally speaking it can use every core available for queries (especially reads).

2023-02-15 00:50:46

- reply

Scaling just fine right now. To be honest, the goal was always to be able to scale /down/, not necessarily up. But latest release has been pushing up to 200mbits/sec while using a single core, so good enough for many of us.

2023-02-15 00:45:00

- reply

Best group of open source devs I have worked with, keeps me coming back each day to make things as good as I am able to. Shout out to all the relay devs either learning rust with me or teaching me!

2023-02-14 23:32:07

- reply

Very cool. What version is packaged?

2023-02-12 21:55:15

Another major sqlite performance improvement in nostr-rs-relay just pushed to master. Rebuilds tag table so it takes a minute to upgrade, but some of the most expensive queries run 10x faster. feedback from testing welcome!

2023-02-12 03:25:41

- reply

Yes, I think so. No concrete plans yet however. Probably will be more focused on enforcing rate limiting instead of authorizing REQs (although both are useful).

2023-02-11 19:43:58

- reply

Yep! In your language of choice. I made a toy demo server in Rust/tonic, but you could do something in python, go, whatever can support gRPC.

2023-02-11 19:38:35

A toy example gRPC event admission service that permits events with specific kinds: https://git.sr.ht/~gheartsfield/nostr-rs-relay/tree/master/item/nauthz_server_example/src/main.rs

2023-02-11 19:33:24

- reply

Here is my take on this: https://git.sr.ht/~gheartsfield/nostr-rs-relay/tree/master/item/proto/nauthz.proto

2023-02-11 19:30:40

nostr-rs-relay now supports gRPC for filtering events to your relay! Free relays can now fight back against spam. Still experimental, but check out the schema, and build cool stuff: https://git.sr.ht/~gheartsfield/nostr-rs-relay/tree/master/item/proto/nauthz.proto

2023-02-11 15:48:50

- reply

Absolutely. It would be killer to have support for sqlite, postgres, AND lmdb.

2023-02-11 14:14:57

I'm a lightning noob but will need to start testing some pay-to-relay stuff. Would appreciate any sats to further nostr-rs-relay development!

2023-02-11 11:00:30

- reply

I will post my attempt today, just got it working last night.

2023-02-11 10:59:07

- reply

In my grpc implementation I also provide IP, user agent, origin, and NIP-05 address, if one exists. I map all the event fields into proto fields, for tags I may cheat and make that a serialized json string.

2023-02-08 03:59:52

- reply

Right, and adding on more and more spam prevention/detection will imcur other costs, as well as customer support. Thise kinds of value added features will cost far more than running a stock relay I imagine.

2023-02-08 03:53:37

- reply

nostr-pub.wellorder.net runs on a 6c/12t AMD, 64GB RAM, 2x512TB nvme dedicated server with unmetered gigabit connection. Nostr needs 1-2 cores & ~6GB RAM typically, and I do about a TB/day of traffic. Managing spammers is more important than beefy machines.

2023-02-08 03:35:07

- reply

My experience is that CPU is THE bottleneck. Assuming your bandwidth costs are unmetered; which is why I moved to hetzner.

2023-01-22 00:35:34

- reply

Biased, but the latest 0.7.17 nostr-rs-relay is consuming <1 core and over 1k connections just fine, so I am pretty happy with it. (nostr-pub.wellorder.net)

2023-01-16 22:17:01

- reply

Or you can YOLO it and try "chmod 777 data".

2023-01-16 22:16:23

- reply

Directions on https://sr.ht/~gheartsfield/nostr-rs-relay/ demonstrate how to make a mounted directory writeable w/ podman.

2023-01-16 22:15:18

- reply

Sounds like the container can't write to your data folder on the host.

2023-01-05 02:16:10

- reply

Postgres is better by default than Sqlite at query execution for larger datasets. I'm working on indexes and better queries. 99% of CPU is spent doing database stuff, not nostr parsing.

2023-01-04 23:55:53

- reply

I have a hard cap at 900, which I bump against. And yes, you can get the entire event stream with a subscription, there are no limits other than what the client requests.

2023-01-04 23:50:24

- reply

No worries; nostream is awesome!

2023-01-04 23:20:47

- reply

Yes, clients (astral) are prone to requesting a ton of events, often multiple times. I think they could be much more efficient.

2023-01-04 23:19:21

- reply

Unfortunately unsustainable financially. Will likely have to put some bandwidth caps in place to keep it under control.

2023-01-04 23:03:59

wss://nostr-pub.wellorder.net is pumping out >100mbits/sec of nostr traffic right now.

2022-12-28 00:39:09

I'm taking a few days off from nostr relay dev to take a vacation. Will get back into making things faster once we hit 2023!

2022-12-19 06:51:14

- reply

I figure it can scale "big enough" for a decent sized community to use, and hopefully will be more than usable on a $5/month tiny VPS. But I'm also eager for first-hand knowledge of how far SQLite /can/ scale.

2022-12-19 06:47:29

- reply

No plans to support other DBs. Would be open if someone wanted to do the work to make it pluggable; but I am partial to it being the best SQLite relay out there, not necessarily the best for all DB's.