Skip to content

garak

by NVIDIA

Open-source NVIDIA scanner that probes LLMs for jailbreaks, prompt injection, leakage and toxicity.

  • Self-hosted
  • Small business
  • Mid-size
  • Enterprise
  • Open source
  • Free tier

From garak's own website and public documents, updated 4 Nov 2026. Not a hands-on review: I add a verdict only to products I use myself.

What is garak?

garak, short for Generative AI Red-teaming and Assessment Kit, is an open-source LLM vulnerability scanner from NVIDIA. It probes LLM-backed applications for failures such as hallucination, data leakage, prompt injection, toxicity and jailbreaks.

Probes are grouped by family, including dan, encoding, promptinject, lmrc, snowball, xss and malwaregen, and each probe names recommended detectors. Supported targets include Hugging Face, OpenAI, Replicate, Cohere, Groq, llama.cpp, NVIDIA NIM, AWS Bedrock, LiteLLM and REST endpoints. It installs from PyPI, and a source install needs Python 3.11 to 3.14.

The licence is Apache-2.0 and the repository shows about 9.9k stars.

Best forSecurity and ML teams that want a free, scriptable LLM vulnerability scanner

garak features

  • Probe families

    Includes dan, encoding, promptinject, lmrc, snowball, xss and malwaregen.

  • Detectors

    Each probe names recommended detectors that score the output.

  • Many targets

    Hugging Face, OpenAI, Cohere, Groq, NIM, Bedrock, LiteLLM and REST.

  • REST generator

    Can test any application that exposes a REST endpoint.

  • Command line

    Use --list_probes and --list_detectors to see what is available.

  • PyPI install

    Install with python -m pip install -U garak.

garak integrations

  • Hugging Face
  • OpenAI
  • Replicate
  • Cohere
  • Groq
  • AWS Bedrock
  • LiteLLM
  • NVIDIA NIM

From the vendor's own integration list or documentation.

garak pricing

Starting price

Free (open source)

  • Pricing modelFlat fee
  • Free tierYes
  • Free trialNo

Current prices on the vendor's site · Checked 4 Nov 2026. Prices change often; the vendor's page wins.

Security and compliance

Certifications
None listed on a public trust page
EU data residency
Not documented

Where it fits (NIST CSF 2.0)

  1. Govern (not covered)
  2. Identify
  3. Protect
  4. Detect (not covered)
  5. Respond (not covered)
  6. Recover (not covered)

Independent audits

No public independent audit found.

Good to know before you buy

  • Command-line tool: reading and acting on results needs technical staff.
  • The README gives no detector catalogue; use the list commands to see what a probe checks.

garak alternatives

Commercial platform for continuous AI red teaming and attack-led security of AI systems and agents.

Agent security platform with AI-SPM, runtime detection and response, access control and red teaming.

promptfoo

Promptfoo (now part of OpenAI)

Open-source CLI and library to evaluate and red-team LLM apps, agents and RAG systems in CI.

PyRIT

Microsoft

Open-source Microsoft AI Red Team toolkit for scanning and attacking generative AI systems.

garak vs Mindgardgarak vs Noma Securitygarak vs promptfoo

Frequently asked questions

What is garak?

Open-source NVIDIA scanner that probes LLMs for jailbreaks, prompt injection, leakage and toxicity.

How much does garak cost?

garak starts at Free (open source), according to its pricing page (checked 4 Nov 2026).

Is there a free version of garak?

Yes. garak has a free plan or tier; check the pricing page for its limits.

What are the alternatives to garak?

Products in the same category include Mindgard, Noma Security, promptfoo, PyRIT.

Where is garak based?

The company behind garak is based in United States.

Have you tested garak?

Not yet. This page lists published facts only. When I test it, my verdict will appear at the top.

Sources (2), checked 4 Nov 2026
  1. github.com/NVIDIA/garak
  2. reference.garak.ai

Spotted something out of date? Tell me through the contact page and I will fix it.

By using this site, you agree to the Privacy Policy.