AppSecNews

AI Security

AI and LLM Security

Test and defend models, prompts, agents and the infrastructure around them.

45 tools profiled

How it differs Tests and guards models, LLM applications and agents against prompt injection, jailbreaks and data leakage. Scanning an AI app's own code is still SAST or SCA.

License
Subcategory
Deployment
Languages
Integrations
Maturity
Signals
Clear

10 tools match

Active Hugging Face Clear all

  • Garak

    NVIDIA

    AI Security

    Command line LLM vulnerability scanner that fires a library of attack probes at a model endpoint and scores the responses with matched detectors.

    Open source
    Growing

  • Giskard

    Giskard

    AI Security

    Python testing library that scans models and LLM applications for security and quality failures, then turns findings into a reusable test suite.

    Freemium
    Growing

  • Guardrails AI

    Guardrails AI

    AI Security

    Python framework that wraps LLM calls in composable validators and decides what to do when a prompt or a response fails one.

    Open source and commercial
    Growing

  • HiddenLayer AISec

    HiddenLayer

    AI Security

    Commercial platform that scans serialized model files for embedded code and watches inference traffic for extraction and evasion behavior.

    Commercial
    Growing

  • LLM Guard

    Protect AI

    AI Security

    Python library of composable input and output scanners that sanitize prompts and validate model responses entirely within your own environment.

    Open source
    Growing

  • Garak

    NVIDIA

    Command line LLM vulnerability scanner that fires a library of attack probes at a model endpoint and scores the responses with matched detectors.

    Open source Growing
    AI Security

  • Giskard

    Giskard

    Python testing library that scans models and LLM applications for security and quality failures, then turns findings into a reusable test suite.

    Freemium Growing
    AI Security

  • Guardrails AI

    Guardrails AI

    Python framework that wraps LLM calls in composable validators and decides what to do when a prompt or a response fails one.

    Open source and commercial Growing
    AI Security

  • HiddenLayer AISec

    HiddenLayer

    Commercial platform that scans serialized model files for embedded code and watches inference traffic for extraction and evasion behavior.

    Commercial Growing
    AI Security

  • LLM Guard

    Protect AI

    Python library of composable input and output scanners that sanitize prompts and validate model responses entirely within your own environment.

    Open source Growing
    AI Security

  • Mindgard

    Mindgard

    AI Security

    Runs a library of AI attacks against your deployed models through their normal interface and reports which ones succeeded.

    Commercial
    Growing

  • Noma Security

    Noma Security

    AI Security

    AI security posture management that inventories models, pipelines and agents, scores their risk, and watches them at runtime.

    Commercial
    Growing

  • NVIDIA NeMo Guardrails

    NVIDIA

    AI Security

    Toolkit for defining rails on an LLM conversation using a dedicated modeling language, controlling input, output, topic, retrieval and tool execution.

    Open source
    Growing

  • Protect AI Guardian

    Protect AI

    AI Security

    Scanning gateway for machine learning model files that inspects serialized artifacts for executable payloads and enforces policy on what may be pulled.

    Commercial
    Growing

  • PyRIT

    Microsoft

    AI Security

    Python framework from Microsoft for automating adversarial probing of generative AI systems, with composable attack, transformation and scoring parts.

    Open source
    Growing

  • Mindgard

    Mindgard

    Runs a library of AI attacks against your deployed models through their normal interface and reports which ones succeeded.

    Commercial Growing
    AI Security

  • Noma Security

    Noma Security

    AI security posture management that inventories models, pipelines and agents, scores their risk, and watches them at runtime.

    Commercial Growing
    AI Security

  • NVIDIA NeMo Guardrails

    NVIDIA

    Toolkit for defining rails on an LLM conversation using a dedicated modeling language, controlling input, output, topic, retrieval and tool execution.

    Open source Growing
    AI Security

  • Protect AI Guardian

    Protect AI

    Scanning gateway for machine learning model files that inspects serialized artifacts for executable payloads and enforces policy on what may be pulled.

    Commercial Growing
    AI Security

  • PyRIT

    Microsoft

    Python framework from Microsoft for automating adversarial probing of generative AI systems, with composable attack, transformation and scoring parts.

    Open source Growing
    AI Security
Tick up to 4 tools above.