AI Model Guardrails Spark Controversy Among Cybersecurity Researchers
Anthropic's Fable model, a public and limited version of its powerful cybersecurity model Mythos, has sparked controversy among cybersecurity researchers over its restrictive guardrails.
Anthropic's Fable model was released on Tuesday, billing it as a public and limited version of its powerful and much-hyped cybersecurity model Mythos. However, not everyone is happy with the restrictions, and a number of cybersecurity researchers and professionals have aired complaints online.
“[Fable] rejects any request that could be tangentially cyber related. Even innocuous tasks like reading a blog post,” said Valentina “Chompie” Palmiotti, a well-known security researcher who works at IBM X-Force.
When a prompt triggers its guardrails, Fable pauses the chat and says that its “safety measures flagged this message for cybersecurity or biology topics.”
The guardrails were put in place to limit the risk that Fable could be used to develop malware or compromise software — a long-standing concern within Anthropic. The restrictions on biology come from a similar concern around developing biological weapons.
When the AI giant released Mythos in April, it restricted the model to a limited number of companies and organizations in what it called Project Glasswing, an effort to deploy the model to secure critical software and infrastructure. Last week, Anthropic expanded access to Mythos to hundreds of organizations in 15 countries.
But despite the good intentions, many cybersecurity experts are still put off by the haphazard nature of the restrictions. Matt Suiche, a cybersecurity veteran, told TechCrunch that "if you ask it to write secure code, it assumes it is cybersecurity related work instead of software engineering best practices, and you get downgraded.” Fable is programmed to fall back to Claude Opus 4.8 if it hits a guardrail.
“It seems to be keyword based, so anything in the lexical field of ‘cybersecurity’ triggers the guardrails.”
Contact Us
Do you have more information about how hackers are using AI? Or how cybersecurity companies are using AI? We'd love to hear from you. From a non-work device and network, you can contact Lorenzo Franceschi-Bicchierai securely on Signal at +1 917 257 1382, or via Telegram and Keybase @lorenzofb, or email.
“But it is understandable as we are still in the early days and they are still adapting their guardrails. I am sure they are going to evolve over time as Anthropic and other frontier model companies will collaborate more with the current new generation of cybersecurity companies,” said Suiche, who is a member of the technical staff at Tolmo, an AI cybersecurity startup.
Another researcher griped on X that “even asking for a code review” triggers Fable’s guardrails.
Anthropic did not immediately respond to a request for comment.
Apart from guardrails inside its models, Anthropic requires cybersecurity professionals to apply to the Cyber Verification Program. If they get approved, the applicants have fewer limitations on using Claude for cybersecurity work. OpenAI has a similar program called Trusted Access for Cyber.
When you purchase through links in our articles, we may earn a small commission. This doesn’t affect our editorial independence.
Lorenzo Franceschi-Bicchierai
Senior Reporter, Cybersecurity
Lorenzo Franceschi-Bicchierai is a Senior Writer at TechCrunch, where he covers hacking, cybersecurity, surveillance, and privacy.
You can contact or verify outreach from Lorenzo by emailing lorenzo@techcrunch.com, via encrypted message at +1 917 257 1382 on Signal, and @lorenzofb on Keybase/Telegram.
June 18
Los Angeles
Get an inside look at what it takes to scale and succeed from leaders at Mach Industries, Founders Fund, and Shinkei Systems. Through candid fireside chats and high-impact networking, you'll walk away with valuable insights and new connections.
Most Popular
-
The AI layoff wave is becoming a powder keg
-
Amazon CEO reportedly raised Anthropic model concerns before government crackdown
-
The FBI built its own replica small town to simulate real-world cyberattacks
-
Meta's months-old AI unit is a soul-crushing gulag, say the engineers stuck inside it
-
Jeff Bezos's Prometheus raises $12B to build an ‘artificial general engineer' for the physical world
-
Google just fired a warning shot in the AI subscription price wars
