SLATE: A Sequence Labeling Approach for Task Extraction from Free-form Inked Content
Apurva Gandhi, Ryan Serrao, Biyi Fang, Gilbert Antonius, Jenna Hong, Tra My Nguyen, Sheng Yi, Ehi Nosakhare
Abstract
We present SLATE, a sequence labeling approach for extracting tasks from free-form content such as digitally handwritten (or “inked”) notes on a virtual whiteboard. Our approach allows us to create a single, low-latency model to simultaneously perform sentence segmentation and classification of these sentences into task/non-task sentences. SLATE greatly outperforms a baseline two-model (sentence segmentation followed by classification model) approach, achieving a task F1 score of 84.4%, a sentence segmentation (boundary similarity) score of 88.4% and three times lower latency compared to the baseline. Furthermore, we provide insights into tackling challenges of performing NLP on the inking domain. We release both our code and dataset for this novel task.
BibTeX
@inproceedings{gandhi-etal-2022-slate,
title = "{SLATE}: A Sequence Labeling Approach for Task Extraction from Free-form Inked Content",
author = "Gandhi, Apurva and
Serrao, Ryan and
Fang, Biyi and
Antonius, Gilbert and
Hong, Jenna and
Nguyen, Tra My and
Yi, Sheng and
Nosakhare, Ehi and
Shaffer, Irene and
Srinivasan, Soundararajan",
editor = "Li, Yunyao and
Lazaridou, Angeliki",
booktitle = "Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing: Industry Track",
month = dec,
year = "2022",
address = "Abu Dhabi, UAE",
publisher = "Association for Computational Linguistics",
url = "https://aclanthology.org/2022.emnlp-industry.21/",
doi = "10.18653/v1/2022.emnlp-industry.21",
pages = "206--217"
}