← Search

Hongtu Zhu

19 accepted papers

2026

CDE: Curiosity-Driven Exploration for Efficient Reinforcement Learning in Large Language Models

ICLR 2026poster

Reinforcement Learning with Verifiable Rewards (RLVR) is a powerful paradigm for enhancing the reasoning ability of Large Language Models (LLMs). Yet current RLVR methods often explore poorly, leading to premature convergence and entropy collapse. Moreover, they tend to produce poorly calibrated pol…

Cited by 0SourcecodeScholar
2026

Designing Time Series Experiments in A/B Testing with Transformer Reinforcement Learning

ICLR 2026poster

A/B testing has become a gold standard for modern technological companies to conduct policy evaluation. Yet, its application to time series experiments, where treatments are sequentially assigned over time, remains challenging. Existing designs suffer from two limitations: (i) they do not fully leve…

Cited by 0SourceScholar
2026

MMedAgent-RL: Optimizing Multi-Agent Collaboration for Multimodal Medical Reasoning

ICLR 2026poster

Medical Large Vision-Language Models (Med-LVLMs) have shown strong potential in multimodal diagnostic tasks. However, existing single-agent models struggle to generalize across diverse medical specialties, limiting their performance. Recent efforts introduce multi-agent collaboration frameworks insp…

Cited by 0SourceScholar
2026

Mixtures of geodesic factor analyzers on Riemannian homogeneous spaces

ICML 2026poster

This paper introduces Mixtures of Geodesic Factor Analyzers (MGFA) on Riemannian homogeneous spaces. MGFA uses a geodesic factor model within each mixture component, providing greater expressiveness than mixtures of Riemannian radial distributions and enabling clustering of manifold-valued data with…

Cited by 0SourceScholar
2026

Parallel-Probe: Towards Efficient Parallel Thinking via 2D Probing

ICML 2026poster

Parallel thinking has emerged as a promising paradigm for reasoning, yet it imposes significant computational burdens. Existing efficiency methods primarily rely on local, per-trajectory signals and lack principled mechanisms to exploit global dynamics across parallel branches. We introduce 2D probi…

Cited by 0SourceScholar
2026

Robust Sequential Experimental Design for A/B Testing

ICML 2026poster

Experimental design has emerged as a powerful approach for improving the sample efficiency of A/B testing, yet existing designs rely critically on correctly specified models. We study robust sequential experimental design under model misspecification and develop a unified framework that covers both …

Cited by 0SourceScholar
2025

Enhancing Prediction Performance through Influence Measure

ICLR 2025poster

In the field of machine learning, the pursuit of accurate models is ongoing. A key aspect of improving prediction performance lies in identifying which data points in the training set should be excluded and which high-quality, potentially unlabeled data points outside the training set should be inco…

Cited by 0SourcePDFScholar
2025

LIFTED: Multimodal Clinical Trial Outcome Prediction via Large Language Models and Mixture-of-Experts

EMNLP 2025

Clinical trials are pivotal yet costly processes, often spanning multiple years and requiring substantial expenses, motivating predictive models to identify likely-to-fail drugs early and save resources. Recent approaches leverage deep learning to integrate multimodal data for clinical outcome predi

Cited by 0SourcePDFScholar
2025

MMedPO: Aligning Medical Vision-Language Models with Clinical-Aware Multimodal Preference Optimization

ICML 2025poster

The advancement of Large Vision-Language Models (LVLMs) has propelled their application in the medical field. However, Medical LVLMs (Med-LVLMs) encounter factuality challenges due to modality misalignment, where the models prioritize textual knowledge over visual input, leading to hallucinations th…

2025

Unraveling the Interplay between Carryover Effects and Reward Autocorrelations in Switchback Experiments

ICML 2025poster

A/B testing has become the gold standard for modern technological industries for policy evaluation. Motivated by the widespread use of switchback experiments in A/B testing, this paper conducts a comprehensive comparative analysis of various switchback designs in Markovian environments. Unlike many…

Cited by 0SourcePDFScholar
2024

CARES: A Comprehensive Benchmark of Trustworthiness in Medical Vision Language Models

NeurIPS 2024poster

Artificial intelligence has significantly impacted medical applications, particularly with the advent of Medical Large Vision Language Models (Med-LVLMs), sparking optimism for the future of automated and personalized healthcare. However, the trustworthiness of Med-LVLMs remains unverified, posing s…

2024

Combining Experimental and Historical Data for Policy Evaluation

ICML 2024poster

This paper studies policy evaluation with multiple data sources, especially in scenarios that involve one experimental dataset with two arms, complemented by a historical dataset generated under a single control arm. We propose novel data integration methods that linearly integrate base policy value…

2024

RULE: Reliable Multimodal RAG for Factuality in Medical Vision Language Models

EMNLP 2024main

The recent emergence of Medical Large Vision Language Models (Med-LVLMs) has enhanced medical diagnosis. However, current Med-LVLMs frequently encounter factual issues, often generating responses that do not align with established medical facts. Retrieval-Augmented Generation (RAG), which utilizes e…

2023

Controlling Neural Style Transfer with Deep Reinforcement Learning

IJCAI 2023poster

Controlling the degree of stylization in the Neural Style Transfer (NST) is a little tricky since it usually needs hand-engineering on hyper-parameters. In this paper, we propose the first deep Reinforcement Learning (RL) based architecture that splits one-step style transfer into a step-wise proces…

Cited by 1SourcePDFScholar
2023

K-Nearest-Neighbor Local Sampling Based Conditional Independence Testing

NeurIPS 2023poster

Conditional independence (CI) testing is a fundamental task in statistics and machine learning, but its effectiveness is hindered by the challenges posed by high-dimensional conditioning variables and limited data samples. This article introduces a novel testing approach to address these challenges…

Cited by 2SourcePDFScholar
2023

Nearest-Neighbor Sampling Based Conditional Independence Testing

AAAI 2023technical

The conditional randomization test (CRT) was recently proposed to test whether two random variables X and Y are conditionally independent given random variables Z. The CRT assumes that the conditional distribution of X given Z is known under the null hypothesis and then it is compared to the distrib…

2023

Optimal Treatment Allocation for Efficient Policy Evaluation in Sequential Decision Making

NeurIPS 2023poster

A/B testing is critical for modern technological companies to evaluate the effectiveness of newly developed products against standard baselines. This paper studies optimal designs that aim to maximize the amount of information obtained from online experiments to estimate treatment effects accurately…

Cited by 7SourcePDFScholar
2019

Graph-Based Semi-Supervised Learning with Non-ignorable Non-response

NeurIPS 2019poster

Graph-based semi-supervised learning is a very powerful tool in classification tasks, while in most existing literature the labelled nodes are assumed to be randomly sampled. When the labelling status depends on the unobserved node response, ignoring the missingness can lead to significant estimatio…