Garak: A Framework for Security Probing Large Language Models

Leon Derczynski, Erick Galinkin, Jeffrey Martin, Subho Majumdar, Nanna Inie

Abstract

Presents garak, an open-source framework for systematically probing LLM vulnerabilities including prompt injection, data leakage, and toxicity generation.

Categories

Tags

Framework Mappings

Cite This Resource

@article{llmsec202400018,
  title = {Garak: A Framework for Security Probing Large Language Models},
  author = {Leon Derczynski and Erick Galinkin and Jeffrey Martin and Subho Majumdar and Nanna Inie},
  year = {2024},
  journal = {arXiv preprint},
  url = {https://arxiv.org/abs/2406.11036},
}