AppSecNews

AI Security

AI and LLM Security

Test and defend models, prompts, agents and the infrastructure around them.

45 tools profiled

How it differs Tests and guards models, LLM applications and agents against prompt injection, jailbreaks and data leakage. Scanning an AI app's own code is still SAST or SCA.

License
Subcategory
Deployment
Languages
Integrations
Maturity
Signals
Clear

16 tools match

Active CLI Clear all

  • Adversarial Robustness Toolbox (ART)

    Linux Foundation AI & Data

    AI Security

    Python library implementing adversarial attacks and defenses against machine learning models, covering evasion, poisoning, extraction and inference.

    Open source
    Established

  • Agentic Radar

    SplxAI

    AI Security

    Open source CLI that statically analyzes agentic AI codebases and produces a visual map of agents, their tools and the risks in that wiring.

    Open source
    Emerging

  • AI-Infra-Guard

    Tencent

    AI Security

    Open source scanner that fingerprints self hosted AI infrastructure components and matches them against known vulnerabilities, with an MCP server analysis mode.

    Open source
    Emerging

  • Akto

    Akto

    AI Security

    API security platform that builds an API inventory from mirrored traffic and runs automated tests for authorization, injection and data exposure flaws.

    Commercial, free tier
    Growing

  • Augustus

    Praetorian

    AI Security

    Open source prompt injection testing tool released by Praetorian for probing LLM applications with adversarial inputs.

    Open source
    Emerging

  • Cerbos

    Cerbos

    AI Security

    Decoupled authorization engine that evaluates YAML policies over a principal, resource and action and returns an allow or deny decision over an API.

    Open source and commercial
    Established

  • Cisco DefenseClaw

    Cisco

    AI Security

    Open source project from Cisco's AI Defense group addressing security controls for AI agent and LLM application activity.

    Open source
    Emerging

  • DeepTeam

    Confident AI

    AI Security

    Open source Python framework that generates adversarial prompts against an LLM application and scores the responses for vulnerabilities such as bias, PII leakage and excessive agency.

    Open source
    Growing

  • Adversarial Robustness Toolbox (ART)

    Linux Foundation AI & Data

    Python library implementing adversarial attacks and defenses against machine learning models, covering evasion, poisoning, extraction and inference.

    Open source Established
    AI Security

  • Agentic Radar

    SplxAI

    Open source CLI that statically analyzes agentic AI codebases and produces a visual map of agents, their tools and the risks in that wiring.

    Open source Emerging
    AI Security

  • AI-Infra-Guard

    Tencent

    Open source scanner that fingerprints self hosted AI infrastructure components and matches them against known vulnerabilities, with an MCP server analysis mode.

    Open source Emerging
    AI Security

  • Akto

    Akto

    API security platform that builds an API inventory from mirrored traffic and runs automated tests for authorization, injection and data exposure flaws.

    Commercial, free tier Growing
    AI Security

  • Augustus

    Praetorian

    Open source prompt injection testing tool released by Praetorian for probing LLM applications with adversarial inputs.

    Open source Emerging
    AI Security

  • Cerbos

    Cerbos

    Decoupled authorization engine that evaluates YAML policies over a principal, resource and action and returns an allow or deny decision over an API.

    Open source and commercial Established
    AI Security

  • Cisco DefenseClaw

    Cisco

    Open source project from Cisco's AI Defense group addressing security controls for AI agent and LLM application activity.

    Open source Emerging
    AI Security

  • DeepTeam

    Confident AI

    Open source Python framework that generates adversarial prompts against an LLM application and scores the responses for vulnerabilities such as bias, PII leakage and excessive agency.

    Open source Growing
    AI Security

  • FuzzyAI

    CyberArk

    AI Security

    Open source fuzzer that applies a catalog of published jailbreak and prompt injection techniques against local or hosted language model endpoints.

    Open source
    Growing

  • Garak

    NVIDIA

    AI Security

    Command line LLM vulnerability scanner that fires a library of attack probes at a model endpoint and scores the responses with matched detectors.

    Open source
    Growing

  • Giskard

    Giskard

    AI Security

    Python testing library that scans models and LLM applications for security and quality failures, then turns findings into a reusable test suite.

    Freemium
    Growing

  • Guardrails AI

    Guardrails AI

    AI Security

    Python framework that wraps LLM calls in composable validators and decides what to do when a prompt or a response fails one.

    Open source and commercial
    Growing

  • LLM Guard

    Protect AI

    AI Security

    Python library of composable input and output scanners that sanitize prompts and validate model responses entirely within your own environment.

    Open source
    Growing

  • Mindgard

    Mindgard

    AI Security

    Runs a library of AI attacks against your deployed models through their normal interface and reports which ones succeeded.

    Commercial
    Growing

  • Promptfoo

    Promptfoo

    AI Security

    Config driven test and red team harness for LLM applications, running assertions and generated adversarial probes against prompts, models and agents.

    Open source and commercial
    Growing

  • PyRIT

    Microsoft

    AI Security

    Python framework from Microsoft for automating adversarial probing of generative AI systems, with composable attack, transformation and scoring parts.

    Open source
    Growing

  • FuzzyAI

    CyberArk

    Open source fuzzer that applies a catalog of published jailbreak and prompt injection techniques against local or hosted language model endpoints.

    Open source Growing
    AI Security

  • Garak

    NVIDIA

    Command line LLM vulnerability scanner that fires a library of attack probes at a model endpoint and scores the responses with matched detectors.

    Open source Growing
    AI Security

  • Giskard

    Giskard

    Python testing library that scans models and LLM applications for security and quality failures, then turns findings into a reusable test suite.

    Freemium Growing
    AI Security

  • Guardrails AI

    Guardrails AI

    Python framework that wraps LLM calls in composable validators and decides what to do when a prompt or a response fails one.

    Open source and commercial Growing
    AI Security

  • LLM Guard

    Protect AI

    Python library of composable input and output scanners that sanitize prompts and validate model responses entirely within your own environment.

    Open source Growing
    AI Security

  • Mindgard

    Mindgard

    Runs a library of AI attacks against your deployed models through their normal interface and reports which ones succeeded.

    Commercial Growing
    AI Security

  • Promptfoo

    Promptfoo

    Config driven test and red team harness for LLM applications, running assertions and generated adversarial probes against prompts, models and agents.

    Open source and commercial Growing
    AI Security

  • PyRIT

    Microsoft

    Python framework from Microsoft for automating adversarial probing of generative AI systems, with composable attack, transformation and scoring parts.

    Open source Growing
    AI Security
Tick up to 4 tools above.