AppSecNews

AI Security

AI and LLM Security

Test and defend models, prompts, agents and the infrastructure around them.

45 tools profiled

How it differs Tests and guards models, LLM applications and agents against prompt injection, jailbreaks and data leakage. Scanning an AI app's own code is still SAST or SCA.

License
Subcategory
Deployment
Languages
Integrations
Maturity
Signals

45 tools

  • Lakera Guard

    Lakera

    AI Security

    Detection API that classifies prompts and model outputs for injection, jailbreak attempts, sensitive data and policy violations before they land.

    Commercial, free tier
    Growing

  • Lasso Security

    Lasso Security

    AI Security

    GenAI security platform covering discovery of AI tools in use, inspection of prompts and responses, and controls on what data reaches a model.

    Commercial
    Emerging

  • LLM Guard

    Protect AI

    AI Security

    Python library of composable input and output scanners that sanitize prompts and validate model responses entirely within your own environment.

    Open source
    Growing

  • Mindgard

    Mindgard

    AI Security

    Runs a library of AI attacks against your deployed models through their normal interface and reports which ones succeeded.

    Commercial
    Growing

  • NeuralTrust

    NeuralTrust

    AI Security

    AI gateway that inspects and enforces policy on LLM traffic, paired with adversarial testing and conversation observability.

    Commercial
    Emerging

  • Noma Security

    Noma Security

    AI Security

    AI security posture management that inventories models, pipelines and agents, scores their risk, and watches them at runtime.

    Commercial
    Growing

  • NVIDIA NeMo Guardrails

    NVIDIA

    AI Security

    Toolkit for defining rails on an LLM conversation using a dedicated modeling language, controlling input, output, topic, retrieval and tool execution.

    Open source
    Growing

  • OpenAI Guardrails

    OpenAI

    AI Security

    Open-source Python package that runs a configured pipeline of safety checks on prompts and model responses, tripping on policy violations.

    Open source
    Emerging

  • Prompt Security

    Prompt Security

    AI Security

    Inspects GenAI traffic across employee tools, homegrown applications and AI coding assistants, applying redaction and blocking policy inline.

    Commercial
    Growing

  • Promptfoo

    Promptfoo

    AI Security

    Config driven test and red team harness for LLM applications, running assertions and generated adversarial probes against prompts, models and agents.

    Open source and commercial
    Growing

  • Prophet AI

    Prophet Security

    AI Security

    AI agent that ingests security alerts, gathers supporting evidence across connected tools, and returns a reasoned verdict for analyst review.

    Commercial
    Emerging

  • Lakera Guard

    Lakera

    Detection API that classifies prompts and model outputs for injection, jailbreak attempts, sensitive data and policy violations before they land.

    Commercial, free tier Growing
    AI Security

  • Lasso Security

    Lasso Security

    GenAI security platform covering discovery of AI tools in use, inspection of prompts and responses, and controls on what data reaches a model.

    Commercial Emerging
    AI Security

  • LLM Guard

    Protect AI

    Python library of composable input and output scanners that sanitize prompts and validate model responses entirely within your own environment.

    Open source Growing
    AI Security

  • Mindgard

    Mindgard

    Runs a library of AI attacks against your deployed models through their normal interface and reports which ones succeeded.

    Commercial Growing
    AI Security

  • NeuralTrust

    NeuralTrust

    AI gateway that inspects and enforces policy on LLM traffic, paired with adversarial testing and conversation observability.

    Commercial Emerging
    AI Security

  • Noma Security

    Noma Security

    AI security posture management that inventories models, pipelines and agents, scores their risk, and watches them at runtime.

    Commercial Growing
    AI Security

  • NVIDIA NeMo Guardrails

    NVIDIA

    Toolkit for defining rails on an LLM conversation using a dedicated modeling language, controlling input, output, topic, retrieval and tool execution.

    Open source Growing
    AI Security

  • OpenAI Guardrails

    OpenAI

    Open-source Python package that runs a configured pipeline of safety checks on prompts and model responses, tripping on policy violations.

    Open source Emerging
    AI Security

  • Prompt Security

    Prompt Security

    Inspects GenAI traffic across employee tools, homegrown applications and AI coding assistants, applying redaction and blocking policy inline.

    Commercial Growing
    AI Security

  • Promptfoo

    Promptfoo

    Config driven test and red team harness for LLM applications, running assertions and generated adversarial probes against prompts, models and agents.

    Open source and commercial Growing
    AI Security

  • Prophet AI

    Prophet Security

    AI agent that ingests security alerts, gathers supporting evidence across connected tools, and returns a reasoned verdict for analyst review.

    Commercial Emerging
    AI Security

  • Protect AI Guardian

    Protect AI

    AI Security

    Scanning gateway for machine learning model files that inspects serialized artifacts for executable payloads and enforces policy on what may be pulled.

    Commercial
    Growing

  • Protecto

    Protecto

    AI Security

    Data privacy layer for AI pipelines that identifies sensitive fields in text and substitutes tokens so models never see the underlying values.

    Commercial
    Emerging

  • PyRIT

    Microsoft

    AI Security

    Python framework from Microsoft for automating adversarial probing of generative AI systems, with composable attack, transformation and scoring parts.

    Open source
    Growing

  • Rebuff

    Protect AI

    AI Security

    Open source prompt injection detector that layers heuristics, a classifier prompt, a vector store of known attacks and canary tokens.

    Open source
    Emerging

  • Runlayer

    Runlayer

    AI Security

    Commercial control layer for AI agent tool access, mediating connections between agents and the systems they act on.

    Commercial
    Emerging

  • Straiker

    Straiker

    AI Security

    Commercial AI security platform pairing automated adversarial testing of AI applications with runtime inspection of prompts and responses.

    Commercial
    Emerging

  • Vectara

    Vectara

    AI Security

    Managed retrieval augmented generation platform whose security relevance is grounding, citation and a hallucination evaluation model applied to responses.

    Commercial
    Established

  • WhyLabs

    WhyLabs

    AI Security

    Observability platform for ML and LLM systems built on lightweight statistical profiles, with drift monitoring and text quality and safety metrics.

    Open source and commercial
    Established

  • WitnessAI

    WitnessAI

    AI Security

    Governance platform that observes AI traffic across an organization, discovers unsanctioned tool use, and applies policy to prompts and responses.

    Commercial
    Growing

  • Xage Security

    Xage Security

    AI Security

    Distributed zero trust access platform for operational and industrial environments, extended to control what machine and AI agent identities may do.

    Commercial
    Established

  • Protect AI Guardian

    Protect AI

    Scanning gateway for machine learning model files that inspects serialized artifacts for executable payloads and enforces policy on what may be pulled.

    Commercial Growing
    AI Security

  • Protecto

    Protecto

    Data privacy layer for AI pipelines that identifies sensitive fields in text and substitutes tokens so models never see the underlying values.

    Commercial Emerging
    AI Security

  • PyRIT

    Microsoft

    Python framework from Microsoft for automating adversarial probing of generative AI systems, with composable attack, transformation and scoring parts.

    Open source Growing
    AI Security

  • Rebuff

    Protect AI

    Open source prompt injection detector that layers heuristics, a classifier prompt, a vector store of known attacks and canary tokens.

    Open source Emerging
    AI Security

  • Runlayer

    Runlayer

    Commercial control layer for AI agent tool access, mediating connections between agents and the systems they act on.

    Commercial Emerging
    AI Security

  • Straiker

    Straiker

    Commercial AI security platform pairing automated adversarial testing of AI applications with runtime inspection of prompts and responses.

    Commercial Emerging
    AI Security

  • Vectara

    Vectara

    Managed retrieval augmented generation platform whose security relevance is grounding, citation and a hallucination evaluation model applied to responses.

    Commercial Established
    AI Security

  • WhyLabs

    WhyLabs

    Observability platform for ML and LLM systems built on lightweight statistical profiles, with drift monitoring and text quality and safety metrics.

    Open source and commercial Established
    AI Security

  • WitnessAI

    WitnessAI

    Governance platform that observes AI traffic across an organization, discovers unsanctioned tool use, and applies policy to prompts and responses.

    Commercial Growing
    AI Security

  • Xage Security

    Xage Security

    Distributed zero trust access platform for operational and industrial environments, extended to control what machine and AI agent identities may do.

    Commercial Established
    AI Security
Tick up to 4 tools above.