Large Language Models as Planning Domain Generators (Student Abstract)
James Oswald, Kavitha Srinivas, Harsha Kokel, Junkyu Lee, Michael Katz, Shirin Sohrabi
Abstract
The creation of planning models, and in particular domain models, is among the last bastions of tasks that require exten- sive manual labor in AI planning; it is desirable to simplify this process for the sake of making planning more accessi- ble. To this end, we investigate whether large language mod- els (LLMs) can be used to generate planning domain models from textual descriptions. We propose a novel task for this as well as a means of automated evaluation for generated do- mains by comparing the sets of plans for domain instances. Finally, we perform an empirical analysis of 7 large language models, including coding and chat models across 9 different planning domains. Our results show that LLMs, particularly larger ones, exhibit some level of proficiency in generating correct planning domains from natural language descriptions
BibTeX
@article{Oswald_Srinivas_Kokel_Lee_Katz_Sohrabi_2024, title={Large Language Models as Planning Domain Generators (Student Abstract)}, volume={38}, url={https://ojs.aaai.org/index.php/AAAI/article/view/30491}, DOI={10.1609/aaai.v38i21.30491}, abstractNote={The creation of planning models, and in particular domain
models, is among the last bastions of tasks that require exten-
sive manual labor in AI planning; it is desirable to simplify
this process for the sake of making planning more accessi-
ble. To this end, we investigate whether large language mod-
els (LLMs) can be used to generate planning domain models
from textual descriptions. We propose a novel task for this
as well as a means of automated evaluation for generated do-
mains by comparing the sets of plans for domain instances.
Finally, we perform an empirical analysis of 7 large language
models, including coding and chat models across 9 different
planning domains. Our results show that LLMs, particularly
larger ones, exhibit some level of proficiency in generating
correct planning domains from natural language descriptions}, number={21}, journal={Proceedings of the AAAI Conference on Artificial Intelligence}, author={Oswald, James and Srinivas, Kavitha and Kokel, Harsha and Lee, Junkyu and Katz, Michael and Sohrabi, Shirin}, year={2024}, month={Mar.}, pages={23604-23605} }