Anthropic takes 8 spots in top 10 most secure LLMs

Anthropic takes 8 spots in top 10 most secure LLMs

Read original source ↗

he promise of AI-driven productivity comes with a catch: every implementation hands over the keys to your company's data and operations to new technology, unlocking a host of security risks.

To help enterprises better determine which models minimize or amplify those risks, Cisco on Monday released its LLM Security Leaderboard, a comprehensive ranking of the top models based on how they respond to adversarial attacks and the associated security risks.

"Data across numerous studies indicate that the adoption of AI into organizations is outpacing security readiness. Cisco’s own AI Readiness Index found 83% of organizations planned to deploy agentic AI, but only 29% felt ready to do so securely," Amy Chang, Head of AI Threat Intelligence & Security Research at Cisco, told The Deep View. "The LLM Security Leaderboard gives leaders and security teams across diverse adoption and maturity stages a concrete starting point to understand how generative AI can be susceptible to different threats."

The leaderboard results were calculated based on rigorous testing that measured single- and multi-turn attacks aimed at eliciting a harmful or malicious response from the model. Anyone can access the results for free, but here is a quick breakdown:

A key advantage of Cisco’s approach is its emphasis on limiting bias. The methodology was posted online to ensure that readers understood exactly how the conclusions were reached and could accurately compare models side by side. Cisco also reassures the public that no extra guardrails or safety measures were used to bolster any models’ performance.

"Many benchmarks focus predominantly on single-turn jailbreaks," said Chang. "Our leaderboard explicitly evaluates multiturn conversational attacks, which better reflect real-world adversarial behavior where attackers attempt to degrade model guardrails over longer conversations."