Interactive Plot Manipulation using Natural Language
Yihan Wang, Yutong Shao, Ndapa Nakashole
Abstract
We present an interactive Plotting Agent, a system that enables users to directly manipulate plots using natural language instructions within an interactive programming environment. The Plotting Agent maps language to plot updates. We formulate this problem as a slot-based task-oriented dialog problem, which we tackle with a sequence-to-sequence model. This plotting model while accurate in most cases, still makes errors, therefore, the system allows a feedback mode, wherein the user is presented with a top-k list of plots, among which the user can pick the desired one. From this kind of feedback, we can then, in principle, continuously learn and improve the system. Given that plotting is widely used across data-driven fields, we believe our demonstration will be of interest to both practitioners such as data scientists broadly defined, and researchers interested in natural language interfaces.
BibTeX
@inproceedings{wang-etal-2021-interactive,
title = "Interactive Plot Manipulation using Natural Language",
author = "Wang, Yihan and
Shao, Yutong and
Nakashole, Ndapa",
editor = "Sil, Avi and
Lin, Xi Victoria",
booktitle = "Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies: Demonstrations",
month = jun,
year = "2021",
address = "Online",
publisher = "Association for Computational Linguistics",
url = "https://aclanthology.org/2021.naacl-demos.11/",
doi = "10.18653/v1/2021.naacl-demos.11",
pages = "92--98"
}