← Search

He Zhu

41 accepted papers

2026

A$^2$FM: An Adaptive Agent Foundation Model for Tool-Aware Hybrid Reasoning

ICLR 2026poster

Large language models split into two families: reasoning-centric LLMs, which strengthen internal chain-of-thought reasoning but cannot invoke external tools, and agentic LLMs, which learn to interact with environments and leverage tools but often lag in deep reasoning. This divide arises from fundam…

Cited by 0SourcecodeScholar
2026

ACADREASON: Exploring the Limits of Reasoning Models with Academic Research Problems

ICLR 2026poster

In recent years, the research focus of large language models (LLMs) and agents has shifted increasingly from demonstrating novel capabilities to complex reasoning and tackling challenging tasks. However, existing evaluations focus mainly on math/code contests or general tasks, while existing multi-d…

Cited by 0SourcecodeScholar
2026

EVOLVING ROLLOUTS: Harnessing Historical Experience for Web Agent Evolution in Reinforcement Learning

ICML 2026poster

Agentic reinforcement learning (RL) for web search is prohibitively expensive due to long context lengths and costly environment interactions, and this inefficiency is further exacerbated by GRPO-based optimization, which discards learning signals from entire rollout groups with zero reward variance…

Cited by 0SourceScholar
2026

Flash-Searcher: Fast and Effective Web Agents via DAG-Based Parallel Execution

ICLR 2026poster

Large language models (LLMs) have demonstrated remarkable capabilities in complex reasoning tasks when equipped with external tools. However, current frameworks predominantly rely on sequential processing, leading to inefficient execution particularly for tasks requiring extensive tool interaction.…

Cited by 0SourcecodeScholar
2026

MemEvolve: Meta-Evolution of Agent Memory Systems

ICML 2026poster

Self-evolving memory systems are rapidly reshaping the evolutionary paradigm of large language model (LLM)-based agents. Prior work has predominantly relied on manually engineered memory architectures to store trajectories, distill experience, and synthesize reusable tools, enabling agents to evolve…

Cited by 0SourceScholar
2026

NL2Repo-Bench: Towards Long-Horizon Repository Generation Evaluation of Coding Agents

ICML 2026poster

Recent advances in coding agents suggest rapid progress toward autonomous software development, yet existing benchmarks primarily evaluate short-horizon behaviors such as localized code generation, scaffolded completion, or repository repair, leaving it unclear whether agents can sustain coherent re…

Cited by 0SourceScholar
2026

OmniEVA: Embodied Versatile Planner via Task-Adaptive 3D-Grounded and Embodiment-aware Reasoning

ICLR 2026poster

Recent advances in multimodal large language models (MLLMs) have opened new opportunities for embodied intelligence, enabling multimodal understanding, reasoning, and interaction, as well as continuous spatial decision-making. Nevertheless, current MLLM-based embodied systems face two critical limit…

Cited by 0SourceScholar
2026

Personalized Longitudinal Medical Report Generation via Temporally-Aware Federated Adaptation

CVPR 2026

Automatic medical report generation from multimodal longitudinal imaging is crucial for clinical diagnosis but remains challenging due to privacy constraints and evolving disease dynamics. While federated learning (FL) enables decentralized model training without data sharing, its extension to longi

Cited by 0SourcecodeScholar
2026

Preference-based Policy Optimization from Sparse-reward Offline Dataset

ICLR 2026poster

Offline reinforcement learning (RL) holds the promise of training effective policies from static datasets without the need for costly online interactions. However, offline RL faces key limitations, most notably the challenge of generalizing to unseen or infrequently encountered state-action pairs. W…

Cited by 0SourceScholar
2026

S2D: Sparse to Dense Lifting for 3D Reconstruction with Minimal Inputs

CVPR 2026

Explicit 3D representations have already become an essential medium for 3D simulation and understanding. However, the most commonly used point cloud and 3D Gaussian Splatting (3DGS) each suffer from non-photorealistic rendering and significant degradation under sparse inputs. In this paper, we intro

Cited by 0SourceScholar
2026

Seele: A Unified Acceleration Framework for Real-Time Gaussian Splatting on Mobile Devices

CVPR 2026

3D Gaussian Splatting (3DGS) has become a crucial rendering technique for many real-time applications. How- ever, the limited hardware resources on today's mobile platforms hinder these applications, as they struggle to achieve real-time performance. In this paper, we propose SEELE, a general framew

Cited by 0SourcecodeScholar
2026

Towards Personalized Deep Research: Benchmarks and Evaluations

ICLR 2026poster

Deep Research Agents (DRAs) can autonomously conduct complex investigations and generate comprehensive reports, demonstrating strong real-world potential. However, existing evaluations mostly rely on close-ended benchmarks, while open-ended deep research benchmarks remain scarce and typically neglec…

Cited by 0SourcecodeScholar
2025

FANNO: Augmenting High-Quality Instruction Data with Open-Sourced LLMs Only

ACL 2025finding

Instruction tuning stands as a crucial advancement in leveraging large language models (LLMs) for enhanced task performance. However, the annotation of instruction datasets has traditionally been expensive and laborious, often relying on manual annotations or costly proprietary LLMs. Recent works ex…

2025

FastLGS: Speeding Up Language Embedded Gaussians with Feature Grid Mapping

AAAI 2025technical

The semantically interactive radiance field has always been an appealing task for its potential to facilitate user-friendly and automated real-world 3D scene understanding applications. However, it is a challenging task to achieve high quality, efficiency and zero-shot ability at the same time with…

Cited by 7SourcePDFScholar
2025

Grounding 3D Object Affordance with Language Instructions, Visual Observations and Interactions

CVPR 2025poster

Grounding 3D object affordance is a task that locates objects in 3D space where they can be manipulated, which links perception and action for embodied intelligence. For example, for an intelligent robot, it is necessary to accurately ground the affordance of an object and grasp it according to huma…

Cited by 0SourcePDFScholar
2025

LayAlign: Enhancing Multilingual Reasoning in Large Language Models via Layer-Wise Adaptive Fusion and Alignment Strategy

NAACL 2025findings

Despite being pretrained on multilingual corpora, large language models (LLMs) exhibit suboptimal performance on low-resource languages. Recent approaches have leveraged multilingual encoders alongside LLMs by introducing trainable parameters connecting the two models. However, these methods typical…

2025

M2RC-EVAL: Massively Multilingual Repository-level Code Completion Evaluation

ACL 2025long

Repository-level code completion has drawn great attention in software engineering, and several benchmarks have been introduced. However, existing repository-level code completion benchmarks usually focus on a limited number of languages (<5), which cannot evaluate the general code intelligence abil…

2025

Multi-view Reconstruction via SfM-guided Monocular Depth Estimation

CVPR 2025poster

This paper aims to reconstruct the scene geometry from multi-view images with strong robustness and high quality. Previous learning-based methods incorporate neural networks into the multi-view stereo matching and have shown impressive reconstruction results. However, due to the reliance on matching…

2025

OAgents: An Empirical Study of Building Effective Agents

EMNLP 2025

Recently, Agentic AI has become an increasingly popular field of research. However, we argue that current practices on agent research are far from standard, rigorous scientific research, which makes it hard to conduct apples-to-apples comparisons among and against existing methods. As a result, it i

2025

Redundancy-Aware Test-Time Graph Out-of-Distribution Detection

NeurIPS 2025poster

Distributional discrepancy between training and test data can lead models to make inaccurate predictions when encountering out-of-distribution (OOD) samples in real-world applications. Although existing graph OOD detection methods leverage data-centric techniques to extract effective representations…

Cited by 0SourceScholar
2025

Structural Entropy Guided Unsupervised Graph Out-Of-Distribution Detection

AAAI 2025technical

With the emerging of huge amount of unlabeled data, unsupervised out-of-distribution (OOD) detection is vital for ensuring the reliability of graph neural networks (GNNs) by identifying OOD samples from in-distribution (ID) ones during testing, where encountering novel or unknown data is inevitable.…

2025

Tag-Instruct: Controlled Instruction Complexity Enhancement through Structure-based Augmentation

ACL 2025finding

High-quality instruction data is crucial for developing large language models (LLMs), yet existing approaches struggle to effectively control instruction complexity. We present Tag-Instruct, a novel framework that enhances instruction complexity through structured semantic compression and controlled…

2025

ToolExpNet: Optimizing Multi-Tool Selection in LLMs with Similarity and Dependency-Aware Experience Networks

ACL 2025finding

Tool learning enhances Large Language Models’ (LLMs) dynamic interaction with external tools, improving their ability to solve complex problems. However, current empirical methods, which primarily focus on isolated tools learning, still struggle with accurate multi-tool selection due to issues like…

Cited by 0SourcePDFScholar
2024

Enhancing Closed-Loop Performance in Learning-Based Vehicle Motion Planning by Integrating Rule-Based Insights

RA-L 2024

This letter introduces an innovative vehicle motion planning method that leverages the integration of rule-based insights to significantly improve closed-loop performance within a learning-based framework. We first employ rule-based methods to heuristically search and generate a diverse set of traje

Cited by 2SourceScholar
2024

Exploring the Edges of Latent State Clusters for Goal-Conditioned Reinforcement Learning

NeurIPS 2024poster

Exploring unknown environments efficiently is a fundamental challenge in unsupervised goal-conditioned reinforcement learning. While selecting exploratory goals at the frontier of previously explored states is an effective strategy, the policy during training may still have limited capability of rea…

2024

HHGNN: Heterogeneous Hypergraph Neural Network for Traffic Agents Trajectory Prediction in Grouping Scenarios

ICRA 2024poster

In many intelligent transportation systems, predicting the future motion of heterogeneous traffic participants is a fundamental but challenging task due to various factors encompassing the agents’ dynamic states, interactions with neighboring agents and surrounding traffic infrastructures, and their…

Cited by 3SourceScholar
2024

HILL: Hierarchy-aware Information Lossless Contrastive Learning for Hierarchical Text Classification

NAACL 2024long

Existing self-supervised methods in natural language processing (NLP), especially hierarchical text classification (HTC), mainly focus on self-supervised contrastive learning, extremely relying on human-designed augmentation rules to generate contrastive samples, which can potentially corrupt or dis…

2024

OTVIC: A Dataset with Online Transmission for Vehicle-to-Infrastructure Cooperative 3D Object Detection

IROS 2024poster

Vehicle-to-infrastructure cooperative 3D object detection (VIC3D) is a task that leverages both vehicle and roadside sensors to jointly perceive the surrounding environment. However, considering the high speed of vehicles, the real-time requirements, and the limitations of communication bandwidth, r…

Cited by 1SourceScholar
2024

Prompt-Based Personalized Federated Learning for Medical Visual Question Answering

ICASSP 2024accepted

We present a novel prompt-based personalized federated learning (pFL) method to address data heterogeneity and privacy concerns in traditional medical visual question answering (VQA) methods. Specifically, we regard medical datasets from different organs as clients and use pFL to train personalized…

Cited by 0SourceScholar
2024

SAM-guided Graph Cut for 3D Instance Segmentation

ECCV 2024poster

"∗ Equal contribution † Corresponding authors This paper addresses the challenge of 3D instance segmentation by simultaneously leveraging 3D geometric and multi-view image information. Many previous works have applied deep learning techniques to 3D point clouds for instance segmentation. However, th…

Cited by 18SourcePDFScholar
2023

HiTIN: Hierarchy-aware Tree Isomorphism Network for Hierarchical Text Classification

ACL 2023long

Hierarchical text classification (HTC) is a challenging subtask of multi-label classification as the labels form a complex hierarchical structure. Existing dual-encoder methods in HTC achieve weak performance gains with huge memory overheads and their structure encoders heavily rely on domain knowle…

2023

Instructing Goal-Conditioned Reinforcement Learning Agents with Temporal Logic Objectives

NeurIPS 2023poster

Goal-conditioned reinforcement learning (RL) is a powerful approach for learning general-purpose skills by reaching diverse goals. However, it has limitations when it comes to task-conditioned policies, where goals are specified by temporally extended instructions written in the Linear Temporal Logi…

Cited by 13SourcePDFScholar
2023

Prompt Makes mask Language Models Better Adversarial Attackers

ICASSP 2023accepted

Generating high-quality synonymous perturbations is a core challenge for textual adversarial tasks. However, candidates generated from the masked language model often contain many words that are antonyms or irrelevant to the original words, which limit the perturbation space and affect the attack’s…

Cited by 0SourceScholar
2022

Hierarchical Information Matters: Text Classification via Tree Based Graph Neural Network

COLING 2022main

Text classification is a primary task in natural language processing (NLP). Recently, graph neural networks (GNNs) have developed rapidly and been applied to text classification tasks. As a special kind of graph data, the tree has a simpler data structure and can provide rich hierarchical informatio…

Cited by 11SourcePDFScholar