There are rumors going around
Apparently there is some kind of failure mode triggered in #AI when you mention a secret word out of context in your post. I have not seen any elaboration on this. How does it work? In what situations is the failure mode triggered? What does the AI agent do when it fails? Is it an attack on the training data, or do you have to enter it into an AI agent by hand?
Gravy
So I am going to assume this is just a nonsensical rumor until someone can explain it to me. But just in case it turns out to be a real problem, I am making this post about it.
Source of the rumor (as far as I can tell) is “AJ Sadauskas” on BlueSky, shared by Brian Krebs here https://infosec.exchange/@briankrebs/114777986932318938 nprofile1qy2hwumn8ghj7un9d3shjtnddaehgu3wwp6kyqpqwf44gvmu4g6x0gwwjgrnlw0f8dxmvx7h929k057wwv8hwa8clq6s0z5k2y (nprofile…5k2y)
#tech #AI #LLM #LRM #Gravy
Ramin Honary
npub105…puwdv
2025-07-01 13:28:51 UTC
Author Public Key
npub1053m9ka5kf6r3rlcr3kmstaswqk2ewqduv2dvtjtud3p38r0dxvqepuwdvSeen on
wss://relay.mostr.pubPublished at
2025-07-01 13:28:51 UTCEvent JSON
{
"id": "cacd96a6ef6ef1aed5589a9af45e7aad19d9baf312ead6bf6763f21cab828f0b",
"pubkey": "7d23b2dbb4b274388ff81c6db82fb0702cacb80de314d62e4be362189c6f6998",
"created_at": 1751376531,
"kind": 1,
"tags": [
[
"p",
"726b54337caa3467a1ce92073fb9e93b4db61bd72a8b67d3ce730f7774f8f835",
"wss://relay.mostr.pub"
],
[
"t",
"ai"
],
[
"t",
"gravy"
],
[
"t",
"llm"
],
[
"t",
"lrm"
],
[
"t",
"tech"
],
[
"proxy",
"https://fe.disroot.org/objects/5c1c76eb-2fa4-4dfd-88b6-88a77dff40d1",
"activitypub"
],
[
"client",
"Mostr",
"31990:6be38f8c63df7dbf84db7ec4a6e6fbbd8d19dca3b980efad18585c46f04b26f9:mostr",
"wss://relay.mostr.pub"
]
],
"content": "There are rumors going around\n\nApparently there is some kind of failure mode triggered in #AI when you mention a secret word out of context in your post. I have not seen any elaboration on this. How does it work? In what situations is the failure mode triggered? What does the AI agent do when it fails? Is it an attack on the training data, or do you have to enter it into an AI agent by hand?\n\nGravy\n\nSo I am going to assume this is just a nonsensical rumor until someone can explain it to me. But just in case it turns out to be a real problem, I am making this post about it.\n\nSource of the rumor (as far as I can tell) is “AJ Sadauskas” on BlueSky, shared by Brian Krebs here https://infosec.exchange/@briankrebs/114777986932318938 nostr:nprofile1qy2hwumn8ghj7un9d3shjtnddaehgu3wwp6kyqpqwf44gvmu4g6x0gwwjgrnlw0f8dxmvx7h929k057wwv8hwa8clq6s0z5k2y\n\n#tech #AI #LLM #LRM #Gravy",
"sig": "5e40d2b4869c7fa96d2e4c3bc4f438efd75f68495ac3fcf4a469e1468c29977fa2792d586c406345534acd92f106d637e9e0726dd084c4f5a68b983f3a1a8889"
}