Red Teaming Large Language Models for Healthcare
Red Teaming Large Language Models for Healthcare
We present the design process and findings of the pre-conference workshop at the Machine Learning for Healthcare Conference (2024) entitled Red Teaming Large Language Models for Healthcare, which took place on August 15, 2024. Conference participants, comprising a mix of computational and clinical expertise, attempted to discover vulnerabilities -- realistic clinical prompts for which a large language model (LLM) outputs a response that could cause clinical harm. Red-teaming with clinicians enables the identification of LLM vulnerabilities that may not be recognised by LLM developers lacking clinical expertise. We report the vulnerabilities found, categorise them, and present the results of a replication study assessing the vulnerabilities across all LLMs provided.
Allan Pang、Aviraj Newatia、Anshul Pattoo、Ajay Shah、Syed Azhar Shah、Syed Ahmar Shah、Bogdana Rakova、Balagopal Unnikrishnan、Rafael Schulman、Sameer Peesapati、Saba Sadatamin、Diana Prepelita、Babak Taati、Stephanie Williams、Rahul G Krishnan、Vahid Balazadeh、Michael Cooper、David Pellow、Atousa Assadi、Jennifer Bell、Jim Fackler、Gabriel Funingana、Spencer Gable-Cook、Anirudh Gangadhar、Abhishek Jaiswal、Sumanth Kaja、Christopher Khoury、Randy Lin、Kaden McKeen、Sara Naimimohasses、Khashayar Namdar
医学现状、医学发展医学研究方法
Allan Pang,Aviraj Newatia,Anshul Pattoo,Ajay Shah,Syed Azhar Shah,Syed Ahmar Shah,Bogdana Rakova,Balagopal Unnikrishnan,Rafael Schulman,Sameer Peesapati,Saba Sadatamin,Diana Prepelita,Babak Taati,Stephanie Williams,Rahul G Krishnan,Vahid Balazadeh,Michael Cooper,David Pellow,Atousa Assadi,Jennifer Bell,Jim Fackler,Gabriel Funingana,Spencer Gable-Cook,Anirudh Gangadhar,Abhishek Jaiswal,Sumanth Kaja,Christopher Khoury,Randy Lin,Kaden McKeen,Sara Naimimohasses,Khashayar Namdar.Red Teaming Large Language Models for Healthcare[EB/OL].(2025-05-01)[2025-05-28].https://arxiv.org/abs/2505.00467.点此复制
评论