← Search

Long Li

20 accepted papers

2026

Anchored Policy Optimization: Mitigating Exploration Collapse via Support-Constrained Rectification

ICML 2026poster

Reinforcement Learning with Verifiable Rewards (RLVR) is increasingly viewed as a tree pruning mechanism. However, we identify a systemic pathology termed Recursive Space Contraction (RSC), an irreversible collapse driven by the combined dynamics of positive sharpening and negative squeezing, where …

Cited by 0SourceScholar
2026

Count Counts: Motivating Exploration in LLM Reasoning with Count-based Intrinsic Rewards

ICLR 2026poster

Reinforcement Learning (RL) has become a compelling way to strengthen the multi step reasoning ability of Large Language Models (LLMs). However, prevalent RL paradigms still lean on sparse outcome-based rewards and limited exploration, which often drives LLMs toward repetitive and suboptimal reasoni…

Cited by 0SourceScholar
2026

DisPPO: Quantile-Based Distributional Reinforcement Learning for Large Language Models

ICML 2026poster

Reinforcement Learning (RL) has become a cornerstone for enhancing the reasoning capabilities of Large Language Models (LLMs). However, standard actor-critic methods, such as PPO, rely on scalar value functions that estimate only the expectation of cumulative returns. This reduction inherently disca…

Cited by 0SourceScholar
2026

DualTimesField: Rethinking Time Series as Continuous-Time Trends and Events

ICML 2026poster

Effective time series representation is critical for revealing temporal dynamics in many fields. However, existing approaches encounter fundamental limitations. Discrete-time representations struggle with irregular sampling and the tradeoff of fidelity and efficiency, while traditional implicit neur…

Cited by 0SourceScholar
2026

The Choice of Divergence: A Neglected Key to Mitigating Diversity Collapse in Reinforcement Learning with Verifiable Reward

ICLR 2026poster

A central paradox in fine-tuning Large Language Models (LLMs) with Reinforcement Learning with Verifiable Reward (RLVR) is the frequent degradation of multi-attempt performance (Pass@k) despite improvements in single-attempt accuracy (Pass@1). This is often accompanied by catastrophic forgetting, wh…

Cited by 0SourceScholar
2025

Chain of Ideas: Revolutionizing Research Via Novel Idea Development with LLM Agents

EMNLP 2025

Research ideation is crucial for scientific progress, but the exponential increase in scientific literature makes it challenging to stay updated and identify impactful directions. Recent developments in large language models(LLMs) offer a promising avenue to automate this process. However, existing

2025

ECBench: Can Multi-modal Foundation Models Understand the Egocentric World? A Holistic Embodied Cognition Benchmark

CVPR 2025poster

The enhancement of generalization in robots by large vision-language models (LVLMs) is increasingly evident. Therefore, the embodied cognitive abilities of LVLMs based on egocentric videos are of great interest. However, current datasets for embodied video question answering lack comprehensive and s…

2025

EOC-Bench: Can MLLMs Identify, Recall, and Forecast Objects in an Egocentric World?

NeurIPS 2025poster

The emergence of multimodal large language models (MLLMs) has driven breakthroughs in egocentric vision applications. These applications necessitate persistent, context-aware understanding of objects, as users interact with tools in dynamic and cluttered environments. However, existing embodied ben…

Cited by 0SourceScholar
2025

Multi-Chamber Origami Actuator via Dual Fabric Layers for Dexterous Motions

RA-L 2025

Multi-chamber soft actuators have demonstrated significant potential in minimally invasive surgery, robotic manipulation, and wearable devices, due to their high flexibility. However, conventional multi-chamber soft actuators are usually fabricated from soft materials and complex molding techniques,

Cited by 1SourceScholar
2025

PhysDiff: A Physically-Guided Diffusion Model for Multivariate Time Series Anomaly Detection

NeurIPS 2025poster

Unsupervised anomaly detection of multivariate time series remains challenging in complex nonstationary dynamics, due to the high false-positive rates and limited interpretability. We propose PhysDiff, combining physics-guided decomposition with diffusion-based reconstruction, to address these issue…

Cited by 0SourceScholar
2025

ReasonMed: A 370K Multi-Agent Generated Dataset for Advancing Medical Reasoning

EMNLP 2025

Reasoning-based large language models have excelled in mathematics and programming, yet their potential in knowledge-intensive medical question answering remains underexplored and insufficiently validated in clinical contexts. To bridge this gap, we introduce ReasonMed , the largest medical reasonin

2025

To Code or not to Code? Adaptive Tool Integration for Math Language Models via Expectation-Maximization

ACL 2025finding

Recent advances in mathematical problem-solving with language models (LMs) integrate chain-of-thought (CoT) reasoning and code execution to harness their complementary strengths. However, existing hybrid frameworks exhibit a critical limitation: they depend on externally dictated instructions or rig…

2025

VideoRefer Suite: Advancing Spatial-Temporal Object Understanding with Video LLM

CVPR 2025poster

Video Large Language Models (Video LLMs) have recently exhibited remarkable capabilities in general video understanding.However, they mainly focus on holistic comprehension and struggle with capturing fine-grained spatial and temporal details. Besides, the lack of high-quality object-level video ins…

2024

A Facile one-step injection novel composite sensor for robot tactile assistance

IROS 2024poster

Tactile information is the research hotspot of wearable flexible sensors due to its importance and complexity. With the innovation of wearable technology and robotics in healthcare, researchers are increasingly integrating wearable flexible sensors on the front end of robots to reproduce the hand ta…

Cited by 0SourceScholar
2024

CI-STHPAN: Pre-trained Attention Network for Stock Selection with Channel-Independent Spatio-Temporal Hypergraph

AAAI 2024technical

Quantitative stock selection is one of the most challenging FinTech tasks due to the non-stationary dynamics and complex market dependencies. Existing studies rely on channel mixing methods, exacerbating the issue of distribution shift in financial time series. Additionally, complex model structures…

Cited by 17SourcePDFScholar
2024

CONDA: Condensed Deep Association Learning for Co-Salient Object Detection.

ECCV 2024poster

"Inter-image association modeling is crucial for co-salient object detection. Despite satisfactory performance, previous methods still have limitations on sufficient inter-image association modeling. Because most of them focus on image feature optimization under the guidance of heuristically calcula…

2024

How Do Humans Write Code? Large Models Do It the Same Way Too

EMNLP 2024main

Program-of-Thought (PoT) replaces natural language-based Chain-of-Thought (CoT) as the most popular method in Large Language Models (LLMs) mathematical reasoning tasks by utilizing external tool calls to circumvent computational errors. However, our evaluation of the GPT-4 and Llama series reveals t…

2023

Discriminative Co-Saliency and Background Mining Transformer for Co-Salient Object Detection

CVPR 2023poster

Most previous co-salient object detection works mainly focus on extracting co-salient cues via mining the consistency relations across images while ignoring the explicit exploration of background regions. In this paper, we propose a Discriminative co-saliency and background Mining Transformer framew…

2022

A Ball Joint With Continuously Adjustable Load Capacity Based on Positive Pressure Method

RA-L 2022

Research on the variable load capacity method is crucial in promoting the application of soft robots. However, the effects on the performance of current structures are still limited. This letter proposes a ball joint with continuously adjustable load capacity based on the principle of friction with

Cited by 3SourceScholar
2021

Weakly Supervised Video Salient Object Detection

CVPR 2021poster

Significant performance improvement has been achieved for fully-supervised video salient object detection with the pixel-wise labeled training datasets, which are timeconsuming and expensive to obtain. To relieve the burden of data annotation, we present the first weakly supervised video salient obj…

Cited by 93PDFcodeScholar