← Search

Alan Zhu

3 accepted papers

2026

How to Train Your Advisor: Steering Black-Box LLMs with Advisor Models

ICML 2026poster

Frontier language models are deployed as black-box services, where model weights cannot be modified and customization is limited to prompting. We introduce Advisor Models, a method to train small open-weight models to generate dynamic, per-instance natural language advice that improves the capabilit…

Cited by 0SourceScholar
2024

Accelerating Iterative Retrieval-augmented Language Model Serving with Speculation

ICML 2024poster

This paper introduces RaLMSpec, a framework that accelerates iterative retrieval-augmented language model (RaLM) with *speculative retrieval* and *batched verification*. RaLMSpec further introduces several important systems optimizations, including prefetching, optimal speculation stride scheduler,…

Cited by 3SourcePDFScholar
2024

TreeScope: An Agricultural Robotics Dataset for LiDAR-Based Mapping of Trees in Forests and Orchards

ICRA 2024poster

Data collection for forestry, timber, and agriculture relies on manual techniques which are labor-intensive and time-consuming. We seek to demonstrate that robotics offers improvements over these techniques and can accelerate agricultural research, beginning with semantic segmentation and diameter e…

Cited by 11SourcecodeScholar