← Search

Junchen Zhao

3 accepted papers

2024

LinguaLinked: Distributed Large Language Model Inference on Mobile Devices

ACL 2024system demonstrations

Deploying Large Language Models (LLMs) locally on mobile devices presents a significant challenge due to their extensive memory requirements. In this paper, we introduce LinguaLinked, a system for decentralized, distributed LLM inference on mobile devices. LinguaLinked enables collaborative executio…

Cited by 6SourcePDFScholar
2023

PCMID: Multi-Intent Detection through Supervised Prototypical Contrastive Learning

EMNLP 2023long findings

Intent detection is a major task in Natural Language Understanding (NLU) and is the component of dialogue systems for interpreting users’ intentions based on their utterances. Many works have explored detecting intents by assuming that each utterance represents only a single intent. Such systems hav…

Cited by 0SourceScholar