AI Security
Test and defend models, prompts, agents and the infrastructure around them.
45 tools profiled
How it differs Tests and guards models, LLM applications and agents against prompt injection, jailbreaks and data leakage. Scanning an AI app's own code is still SAST or SCA.
Praetorian
Open source prompt injection testing tool released by Praetorian for probing LLM applications with adversarial inputs.
Confident AI
Open source Python framework that generates adversarial prompts against an LLM application and scores the responses for vulnerabilities such as bias, PII leakage and excessive agency.
NVIDIA
Command line LLM vulnerability scanner that fires a library of attack probes at a model endpoint and scores the responses with matched detectors.
Promptfoo
Config driven test and red team harness for LLM applications, running assertions and generated adversarial probes against prompts, models and agents.
Microsoft
Python framework from Microsoft for automating adversarial probing of generative AI systems, with composable attack, transformation and scoring parts.
Praetorian
Open source prompt injection testing tool released by Praetorian for probing LLM applications with adversarial inputs.
Confident AI
Open source Python framework that generates adversarial prompts against an LLM application and scores the responses for vulnerabilities such as bias, PII leakage and excessive agency.
NVIDIA
Command line LLM vulnerability scanner that fires a library of attack probes at a model endpoint and scores the responses with matched detectors.
Promptfoo
Config driven test and red team harness for LLM applications, running assertions and generated adversarial probes against prompts, models and agents.
Microsoft
Python framework from Microsoft for automating adversarial probing of generative AI systems, with composable attack, transformation and scoring parts.