2023
BioPlanner: Automatic Evaluation of LLMs on Protocol Planning in Biology
Odhran ODonoghue, Aleksandar Shtedritski, John Ginger, Ralph Abboud, Ali Essam Ghareeb, Samuel G Rodriques
EMNLP 2023long main
The ability to automatically generate accurate protocols for scientific experiments would represent a major step towards the automation of science. Large Language Models (LLMs) have impressive capabilities on a wide range of tasks, such as question answering and the generation of coherent text and c…