AppSecNews

AI Security

AI and LLM Security

Test and defend models, prompts, agents and the infrastructure around them.

45 tools profiled

How it differs Tests and guards models, LLM applications and agents against prompt injection, jailbreaks and data leakage. Scanning an AI app's own code is still SAST or SCA.

License
Subcategory
Deployment
Languages
Integrations
Maturity
Signals
Clear

5 tools match

Active Azure Openai Clear all

  • Arthur AI

    Arthur

    AI Security

    Model monitoring and guardrail platform that evaluates LLM inputs and outputs inline for injection, sensitive data and unsupported claims.

    Open source and commercial
    Growing

  • CalypsoAI

    CalypsoAI

    AI Security

    Commercial platform that proxies enterprise LLM traffic through policy scanners and runs automated red teaming against models and applications.

    Commercial
    Growing

  • DeepTeam

    Confident AI

    AI Security

    Open source Python framework that generates adversarial prompts against an LLM application and scores the responses for vulnerabilities such as bias, PII leakage and excessive agency.

    Open source
    Growing

  • FuzzyAI

    CyberArk

    AI Security

    Open source fuzzer that applies a catalog of published jailbreak and prompt injection techniques against local or hosted language model endpoints.

    Open source
    Growing

  • PyRIT

    Microsoft

    AI Security

    Python framework from Microsoft for automating adversarial probing of generative AI systems, with composable attack, transformation and scoring parts.

    Open source
    Growing

  • Arthur AI

    Arthur

    Model monitoring and guardrail platform that evaluates LLM inputs and outputs inline for injection, sensitive data and unsupported claims.

    Open source and commercial Growing
    AI Security

  • CalypsoAI

    CalypsoAI

    Commercial platform that proxies enterprise LLM traffic through policy scanners and runs automated red teaming against models and applications.

    Commercial Growing
    AI Security

  • DeepTeam

    Confident AI

    Open source Python framework that generates adversarial prompts against an LLM application and scores the responses for vulnerabilities such as bias, PII leakage and excessive agency.

    Open source Growing
    AI Security

  • FuzzyAI

    CyberArk

    Open source fuzzer that applies a catalog of published jailbreak and prompt injection techniques against local or hosted language model endpoints.

    Open source Growing
    AI Security

  • PyRIT

    Microsoft

    Python framework from Microsoft for automating adversarial probing of generative AI systems, with composable attack, transformation and scoring parts.

    Open source Growing
    AI Security
Tick up to 4 tools above.