2026-05-29T02:35:39Z https://yabu.me incorrect celebration [TudbuT] https://yabu.me/npub14ghs3rrdn6azjn9ycsl823hmtvxjdev64wqqpm6ww5p5p78sya2sx0r28q https://media.social.tudbut.de/b2c8e61d601b2d103983ff9eff0cb74bc0f35dfe9fc990811053aa603557d5b8.jpg https://media.social.tudbut.de/b2c8e61d601b2d103983ff9eff0cb74bc0f35dfe9fc990811053aa603557d5b8.jpg https://yabu.me/nevent1qqsqc08y4qjc6fz2j75cv4rwd7hec9j7hmehdlj6en5ll4zlfy6glxgzyz4z7zyvdk0t522v5nzrua2xldds6fh9n24cqq80fe6sxs8c7qn42wqlkzp In reply to <a href='/nevent1qqsrrnvlspl4mupejczsmf06xaz87ymjkl3kmgm0w44tkjyrcr9lutc23pu5h'>nevent1q…pu5h</a><br/>_________________________<br/><br/>i apologize for just jumping in here but i want to back up just how literal this destruction is. despite me using an ai blocker, my server is now at a constant 50%+ cpu usage, most of which coming from caddy and thus being unavoidable for me unless i write my own reverse proxy too (not too unlikely i suppose, but either way). <br/> <br/>i am now experiencing up to 300-something requests per second that are confirmed to be coming from llm scrapers, usually hovering around 185 with regular spikes to 250. that means an average of 16 million requests per day. this translates to over 99.7% of requests to my sites coming from scrapers. 2026-04-20T09:42:06Z https://yabu.me/nevent1qqsysj26w3dlpn342zxewrs2v2q74yltmlsr3r8r3a2vdymcmdee3rszyz4z7zyvdk0t522v5nzrua2xldds6fh9n24cqq80fe6sxs8c7qn427sqwpg In reply to <a href='/nevent1qqsp5de6npfslc09f6q3vpwc334z2w3eulsuw2nu6wse3qjtyqpdnyg7xzk32'>nevent1q…zk32</a><br/>_________________________<br/><br/>i see a lot of french people as well 2025-12-22T10:40:58Z https://yabu.me/nevent1qqsyvkrvcf3xwdmfd72nug0tk7zuc3fkdcm7ckawurkaplydmskmgeqzyz4z7zyvdk0t522v5nzrua2xldds6fh9n24cqq80fe6sxs8c7qn42ypqykz as some of you may know i made sth called [bombai](<a href="https://git.tudbut.de/tudbut/bombai">https://git.tudbut.de/tudbut/bombai</a>) (name comes from bomba and ai) thats kinda like anubis or iocaine in purpose. those solutions are kind of &#34;fine&#34; already, but the thing about them is that anubis sucks for regular users too, and isnt always effective, and that iocaine usually relies on lists or similar things. <br/> <br/>scrapers unfortunately come in all shapes and sizes and with new user agents or hidden ones all the time. after using anubis for a while, i got my forgejo downed again and so i went looking. iocaine seems like a good idea, but i want something that is sure to stop my git from going down even if i dont maintain it or the lists are incomplete. <br/> <br/>--- <br/> <br/>what i made now does the following: <br/> <br/>- very configurable detection entirely based on behaviour, without modifying site content <br/> - request counting <br/> - one fail = timeout, continuously resetting if attempts continue (this can be excellently combined with trap paths) <br/> - weighted by path and such <br/> - blobbing entire subnets together if desired (needed for alibaba&#39;s bot for example) <br/> - allows setting up &#34;trap paths&#34; that instantly flag someone for timeout upon visit <br/>- customizable response <br/> - redirection to iocaine or other trap <br/> - **zip bombs** (small ones usually since most scrapers are smart enough to not decompress them fully otherwise - but it makes it cheaper on bandwidth either way) <br/> - maze similar to but less sophisticated than iocaine <br/> - plain http or html response from file <br/> <br/>it is worth mentioning especially explicitly that paths that are expensive for the server to provide (in storage or otherwise), can be thus limited extremely well, and of course most scrapers are blocked even far before the first time they request such a path. <br/> <br/>if interest exists and help is needed setting it up or you just want to chat about it, DO IT I WOULD LOVE THAT. <br/> <br/>if a bot makes it through that is capable of doing any harm, i consider that a bug immediately. make an issue and ill debug either your config or the program itself. <br/> <br/>#opensource #forgejo 2025-12-21T22:04:30Z https://yabu.me/nevent1qqsppsgzu3gkk4eh9r0hy3cjznuur5yt3t0vz29nxy7x2mhl3350gzgzyz4z7zyvdk0t522v5nzrua2xldds6fh9n24cqq80fe6sxs8c7qn42a88gde bombai is being really quite successful. whenever a scraper hits a bomb it slows to a crawl for a good minute (without this, they do 4 requests a second easily, now its closer to 30s or eveb minutes between requests). i am going to remove anubis for now. 2025-12-17T23:37:05Z https://yabu.me/nevent1qqswx55nadqam06le8u65467l696gy63ypq660cvq0gptg26c88ptegzyz4z7zyvdk0t522v5nzrua2xldds6fh9n24cqq80fe6sxs8c7qn420pq5ra btw my nextcloud is back (i hate nextcloud) 2025-10-06T05:15:35Z https://yabu.me/nevent1qqs9reh43vmmvwuqmwzfskz4t8798yg92a9mln4xql3mvfr7vq4atdczyz4z7zyvdk0t522v5nzrua2xldds6fh9n24cqq80fe6sxs8c7qn42qpm2sd In reply to <a href='/nevent1qqs80vr4cfw3f089h7dw079z2s975vqlj8xhe58dy9fjk0jry9ztapggde7wq'>nevent1q…e7wq</a><br/>_________________________<br/><br/>for me its a similar thing: absence of visual (and material) business. <br/>and ive talked to a lot of people who find liminal spaces calming in that way, i believe its more common in autistic people whereas neurotypicals tend towards finding them scary. 2025-01-09T04:47:50Z https://yabu.me/nevent1qqsvudueqaeayqs9422ny90cq2ntdmw6dxkgqdt2kthhr6tmncdhhwczyz4z7zyvdk0t522v5nzrua2xldds6fh9n24cqq80fe6sxs8c7qn42tf7fm4 In reply to <a href='/nevent1qqsz7j0h3vt4ckpsuufq6n3hf7a00su6hck9vx2ccsxqja0cxjzftzqcnfny6'>nevent1q…fny6</a><br/>_________________________<br/><br/>i believe some people do make that connection on their own, but definitely not all. i have talked to people who found liminal spaces naturally pressing 2025-01-09T04:38:20Z https://yabu.me/nevent1qqsz7j0h3vt4ckpsuufq6n3hf7a00su6hck9vx2ccsxqja0cxjzftzqzyz4z7zyvdk0t522v5nzrua2xldds6fh9n24cqq80fe6sxs8c7qn42w3200d In reply to <a href='/nevent1qqs9gwx6uf5meqqkff343gf3hazny5u7tfn93k4f2mswds2cj0jnhaq566gdg'>nevent1q…6gdg</a><br/>_________________________<br/><br/>i have the same experience! i find them so so calming and never even considered that some people might associate them with horror for a long time 2025-01-09T04:36:32Z