Nostr notes by Sophos X-Ops

At the Conference for Applied Machine Learning in Information ...

2025-10-24T10:24:29Z

At the Conference for Applied Machine Learning in Information Security (CAMLIS) yesterday, SophosAI researcher Tamás Vörös presented his research on LLM salting, a novel technique to prevent LLM jailbreaks.

Many organizations are increasingly deploying LLMs with minimal customization. This widespread reuse leads to model homogeneity, from chatbots to productivity tools – and creates a security vulnerability.

Jailbreak prompts that bypass refusal mechanisms can be precomputed once and reused across many deployments. This mirrors the classic rainbow table attack, where attackers exploit shared cryptographic targets to reuse precomputed inputs.

These generalized jailbreaks are a problem because many companies have customer-facing LLMs built on top of model classes – meaning that one jailbreak could work against all the instances built on top of a given model.

Taking inspiration from salting – the concept of introducing small per-user variations to break reuse of precomputed inputs – we developed a technique we call ‘LLM salting’: introducing targeted variations in model behavior to invalidate jailbreaks.

Building on recent work [1] identifying a subspace in model activations responsible for refusal behavior, LLM salting is a lightweight fine-tuning procedure that rotates this subspace. This ensures that jailbreaks crafted against an unsalted model don’t succeed on salted ones.

[1] https://arxiv.org/abs/2406.11717

Today, Sophos X-Ops has published Sophos' Annual Threat ...

2025-04-16T17:51:18Z

Today, Sophos X-Ops has published Sophos' Annual Threat Report, with a focus on cybercrime affecting small and medium businesses. There are a number of key takeaways from the incident and detection telemetry from 2024:
First, network edge devices-and VPN appliances in particular-have been the largest single initial access point for cybercriminals over the past year, accounting for over 30 percent of all documented initial access methods. /1

Hi everyone, it's @npub1nze…spjz driving the X-Ops social ...

2025-01-16T17:00:38Z

Hi everyone, it's Andrew 🌻 Brandt 🐇 (npub1nze…spjz) driving the X-Ops social media today to let you know about a story we just published, written by my colleague Gabor Szappanos.

Szapi has done significant research in the past into a #malware family called #Gootloader that (for years, now) uses malicious #SEO techniques to promote compromised websites into Google search results.

This research finally cracks wide open the mystery of how they manage to do that so effectively. It's a long read, but well worth the deep dive.

https://news.sophos.com/en-us/2025/01/16/gootloader-inside-out/ ‎

1/

Today, we've published a report on Sophos MDR's ...

2024-09-10T12:24:30Z

Today, we've published a report on Sophos MDR's investigation into renewed cyberespionage tied to Operation Crimson Palace, an intrusion into a SE Asian government agency that has expanded to other regional public service organizations. A month after the previous campaign appeared to end, the actors behind three threat clusters we tracked renewed their efforts with new tools and tactics to evade blocks Sophos X-Ops had deployed to disrupt them. /1
https://news.sophos.com/en-us/2024/09/10/crimson-palace-new-tools-tactics-targets/