← Search

Yuhang Yao

5 accepted papers

2024

ScaleLLM: A Resource-Frugal LLM Serving Framework by Optimizing End-to-End Efficiency

EMNLP 2024industry

Large language models (LLMs) have surged in popularity and are extensively used in commercial applications, where the efficiency of model serving is crucial for the user experience. Most current research focuses on optimizing individual sub-procedures, e.g. local inference and communication, however…

Cited by 7SourcePDFScholar
2024

TensorOpera Router: A Multi-Model Router for Efficient LLM Inference

EMNLP 2024industry

With the rapid growth of Large Language Models (LLMs) across various domains, numerous new LLMs have emerged, each possessing domain-specific expertise. This proliferation has highlighted the need for quick, high-quality, and cost-effective LLM query response methods. Yet, no single LLM exists to ef…

Cited by 10SourcePDFScholar
2023

FedGCN: Convergence-Communication Tradeoffs in Federated Training of Graph Convolutional Networks

NeurIPS 2023poster

Methods for training models on graphs distributed across multiple clients have recently grown in popularity, due to the size of these graphs as well as regulations on keeping data where it is generated. However, the cross-client edges naturally exist among clients. Thus, distributed methods for trai…

2023

Wyze Rule: Federated Rule Dataset for Rule Recommendation Benchmarking

NeurIPS 2023poster

In the rapidly evolving landscape of smart home automation, the potential of IoT devices is vast. In this realm, rules are the main tool utilized for this automation, which are predefined conditions or triggers that establish connections between devices, enabling seamless automation of specific proc…

2021

Interpretable Clustering on Dynamic Graphs with Recurrent Graph Neural Networks

AAAI 2021technical

We study the problem of clustering nodes in a dynamic graph, where the connections between nodes and nodes' cluster memberships may change over time, e.g., due to community migration. We first propose a dynamic stochastic block model that captures these changes, and a simple decay-based clustering a…