Skip to content
Search
paperJanuary 2024ReviewedOpen access

Tensor Trust: Interpretable Prompt Injection Attacks from an Online Game

Sam Toyer, Olivia Watkins, Ethan Adrian Mendes, Justin Svegliato, Luke Bailey, Tiffany Wang, Isaac Ong, Karim Elmaaroufi, Pieter Abbeel, Trevor Darrell, Alan Ritter, Stuart Russell

ICLR 2024

View resourcePDF

Abstract

Uses data from an online game (Tensor Trust) where players compete to craft prompt injections and defenses, creating a large dataset of human-generated attacks.

Categories

Prompt InjectionBenchmarks & Evaluation
#game-based#dataset#interpretable

Framework mappings

OWASP Top 10 for LLM Applications
  • LLM01Prompt Injection
MITRE ATLAS
  • AML.T0051LLM Prompt Injection

Cite

@inproceedings{toyer2024tensor,
  title = {{Tensor Trust: Interpretable Prompt Injection Attacks from an Online Game}},
  author = {Sam Toyer and Olivia Watkins and Ethan Adrian Mendes and Justin Svegliato and Luke Bailey and Tiffany Wang and Isaac Ong and Karim Elmaaroufi and Pieter Abbeel and Trevor Darrell and Alan Ritter and Stuart Russell},
  year = {2024},
  month = jan,
  booktitle = {ICLR 2024},
  eprint = {2311.01011},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2311.01011}
}