← Search

Yuxuan Yao

7 accepted papers

2026

Prompt Reinjection: Alleviating Prompt Forgetting in Multimodal Diffusion Transformers

ICML 2026poster

Multimodal Diffusion Transformers (MMDiTs) for text-to-image generation maintain separate text and image branches, with bidirectional information flow between text tokens and visual latents throughout denoising. In this setting, we observe a prompt forgetting phenomenon: the semantics of the prompt …

Cited by 0SourceScholar
2025

Activation-Guided Consensus Merging for Large Language Models

NeurIPS 2025poster

Recent research has increasingly focused on reconciling the reasoning capabilities of System 2 with the efficiency of System 1. While existing training-based and prompt-based approaches face significant challenges in terms of efficiency and stability, model merging emerges as a promising strategy to…

Cited by 0SourceScholar
2025

Determine-Then-Ensemble: Necessity of Top-k Union for Large Language Model Ensembling

ICLR 2025spotlight

Large language models (LLMs) exhibit varying strengths and weaknesses across different tasks, prompting recent studies to explore the benefits of ensembling models to leverage their complementary advantages. However, existing LLM ensembling methods often overlook model compatibility and struggle wit…

Cited by 4SourcePDFScholar
2025

LoRE-Merging: Exploring Low-Rank Estimation For Large Language Model Merging

EMNLP 2025

While most current approaches rely on further training techniques, such as fine-tuning or reinforcement learning, to enhance model capacities, model merging stands out for its ability of improving models without requiring any additional training. In this paper, we propose a unified framework for mod

Cited by 0SourcePDFScholar
2024

MR-Ben: A Meta-Reasoning Benchmark for Evaluating System-2 Thinking in LLMs

NeurIPS 2024poster

Large language models (LLMs) have shown increasing capability in problem-solving and decision-making, largely based on the step-by-step chain-of-thought reasoning processes. However, evaluating these reasoning abilities has become increasingly challenging. Existing outcome-based benchmarks are begin…

Cited by 14SourcePDFScholar
2023

Fine-grained Conversational Decoding via Isotropic and Proximal Search

EMNLP 2023short main

General-purpose text decoding approaches are usually adopted for dialogue response generation. Although the quality of the generated responses can be improved with dialogue-specific encoding methods, conversational decoding methods are still under-explored. Inspired by SimDRC that a good dialogue fe…

Cited by 0SourcecodeScholar