paperJune 2025Unreviewed

The PIEE Cycle: A Structured Framework for Red Teaming Large Language Models in Clinical Decision-Making

Maissa Trabilsy, Srinivagasam Prabha, C. A. Gomez-Cabello, S. A. Haider, Ariana Genovese, S. Borna, Nadia G. Wood, N. Gopala, Cui Tao, AJ Forte

Bioengineering

View resource

Abstract

The increasing integration of large language models (LLMs) into healthcare presents significant opportunities, but also critical risks related to patient safety, accuracy, and ethical alignment. Despite these concerns, no standardized framework exists for systematically evaluating and stress testing LLM behavior in clinical decision-making. The PIEE cycle—Planning and Preparation, Information Gathering and Prompt Generation, Execution, and Evaluation—is a structured red-teaming framework develop

Framework mappings

NIST AI Risk Management Framework

MEASUREMeasure

Suggested from the entry's categories.

Cite

@article{trabilsy2025piee,
  title = {{The PIEE Cycle: A Structured Framework for Red Teaming Large Language Models in Clinical Decision-Making}},
  author = {Maissa Trabilsy and Srinivagasam Prabha and C. A. Gomez-Cabello and S. A. Haider and Ariana Genovese and S. Borna and Nadia G. Wood and N. Gopala and Cui Tao and AJ Forte},
  year = {2025},
  month = jun,
  journal = {Bioengineering},
  doi = {10.3390/bioengineering12070706},
  url = {https://www.semanticscholar.org/paper/1417c22f2e479509f8b3a179b784b945498b71a2}
}