AppSecNews

AI Security

AI and LLM Security

Test and defend models, prompts, agents and the infrastructure around them.

45 tools profiled

How it differs Tests and guards models, LLM applications and agents against prompt injection, jailbreaks and data leakage. Scanning an AI app's own code is still SAST or SCA.

License
Subcategory
Deployment
Languages
Integrations
Maturity
Signals
Clear

6 tools match

  • Arize AI

    Arize AI

    AI Security

    LLM and ML observability platform that captures application traces and runs evaluations over them, with an open source tracing and evaluation component.

    Open source and commercial
    Established
  • CalypsoAI

    CalypsoAI

    AI Security

    Commercial platform that proxies enterprise LLM traffic through policy scanners and runs automated red teaming against models and applications.

    Commercial
    Growing
  • DeepTeam

    Confident AI

    AI Security

    Open source Python framework that generates adversarial prompts against an LLM application and scores the responses for vulnerabilities such as bias, PII leakage and excessive agency.

    Open source
    Growing
  • Arize AI

    Arize AI

    LLM and ML observability platform that captures application traces and runs evaluations over them, with an open source tracing and evaluation component.

    Open source and commercial Established
    AI Security
  • CalypsoAI

    CalypsoAI

    Commercial platform that proxies enterprise LLM traffic through policy scanners and runs automated red teaming against models and applications.

    Commercial Growing
    AI Security
  • DeepTeam

    Confident AI

    Open source Python framework that generates adversarial prompts against an LLM application and scores the responses for vulnerabilities such as bias, PII leakage and excessive agency.

    Open source Growing
    AI Security
  • FuzzyAI

    CyberArk

    AI Security

    Open source fuzzer that applies a catalog of published jailbreak and prompt injection techniques against local or hosted language model endpoints.

    Open source
    Growing
  • Galileo AI

    Galileo

    AI Security

    Evaluation and observability platform for LLM and agent applications, with purpose built scoring models and an inline guardrail path.

    Commercial
    Growing
  • Promptfoo

    Promptfoo

    AI Security

    Config driven test and red team harness for LLM applications, running assertions and generated adversarial probes against prompts, models and agents.

    Open source and commercial
    Growing
  • FuzzyAI

    CyberArk

    Open source fuzzer that applies a catalog of published jailbreak and prompt injection techniques against local or hosted language model endpoints.

    Open source Growing
    AI Security
  • Galileo AI

    Galileo

    Evaluation and observability platform for LLM and agent applications, with purpose built scoring models and an inline guardrail path.

    Commercial Growing
    AI Security
  • Promptfoo

    Promptfoo

    Config driven test and red team harness for LLM applications, running assertions and generated adversarial probes against prompts, models and agents.

    Open source and commercial Growing
    AI Security
Tick up to 4 tools above.