← Search

Ian G Harris

2 accepted papers

2024

LinguaLinked: Distributed Large Language Model Inference on Mobile Devices

ACL 2024system demonstrations

Deploying Large Language Models (LLMs) locally on mobile devices presents a significant challenge due to their extensive memory requirements. In this paper, we introduce LinguaLinked, a system for decentralized, distributed LLM inference on mobile devices. LinguaLinked enables collaborative executio…

Cited by 11SourcePDFScholar
2022

GraphMemDialog: Optimizing End-to-End Task-Oriented Dialog Systems Using Graph Memory Networks

AAAI 2022technical

Effectively integrating knowledge into end-to-end task-oriented dialog systems remains a challenge. It typically requires incorporation of an external knowledge base (KB) and capture of the intrinsic semantics of the dialog history. Recent research shows promising results by using Sequence-to-Sequen…

Cited by 18SourcePDFScholar