← Search

Jian Hu

25 accepted papers

2026

BroRL: Scaling Reinforcement Learning via Broadened Exploration

ICML 2026poster

Reinforcement Learning with Verifiable Rewards (RLVR) has emerged as a key ingredient for unlocking complex reasoning capabilities in large language models. Recent work ProRL \citep{liu2025prorl} has shown promise in scaling RL by increasing the number of training steps. However, performance plateau…

Cited by 0SourceScholar
2026

Golden Goose: A Simple Trick to Synthesize Unlimited RLVR Tasks from Unverifiable Internet Text

ICML 2026poster

Reinforcement Learning with Verifiable Rewards (RLVR) has become a cornerstone for unlocking complex reasoning in Large Language Models (LLMs). Yet, scaling up RL is bottlenecked by limited existing verifiable data, where improvements increasingly saturate over prolonged training. To overcome this, …

Cited by 0SourceScholar
2026

Tricks or Traps? A Deep Dive into RL for LLM Reasoning

ICLR 2026poster

Reinforcement learning (RL) for LLM reasoning has rapidly emerged as a prominent research area, marked by a significant surge in related studies on both algorithmic innovations and practical applications. Despite this progress, several critical challenges remain, including the absence of standardize…

Cited by 0SourcecodeScholar
2025

ProRL: Prolonged Reinforcement Learning Expands Reasoning Boundaries in Large Language Models

NeurIPS 2025poster

Recent advances in reasoning-centric language models have highlighted reinforcement learning (RL) as a promising method for aligning models with verifiable rewards. However, it remains contentious whether RL truly expands a model’s reasoning capabilities or merely amplifies high-reward outputs alrea…

Cited by 0SourcecodeScholar
2025

Uncertainty-quantified Rollout Policy Adaptation for Unlabelled Cross-domain Video Temporal Grounding

NeurIPS 2025poster

Video Temporal Grounding (TG) aims to temporally locate video segments matching a natural language description (a query) in a long video. While Vision-Language Models (VLMs) are effective at holistic semantic matching, they often struggle with fine-grained temporal localisation. Recently, Group Rela…

Cited by 0SourceScholar
2024

Co-Axial Slender Tubular robot (CAST): Towards Robotized Operation for Transorbital Neurosurgery with Minimal Invasiveness

ICRA 2024poster

Transorbital Neuro Surgery (TNS) offers a novel treatment towards the lesion inside skull pursuing minimal invasiveness. Most conventional TNS tools are rigid and straight, limiting the dexterity and accessibility in passing a small port. Bendable and steerable surgical tools provides an alternative…

Cited by 0SourceScholar
2024

Design and Modeling of a Multi-DoF Magnetic Continuum Robot With Diverse Deformation Modes

RA-L 2024

Magnetically-actuated continuum robots (MCRs) have the potential to be miniaturized to submillimeter sizes. However, their limited deformation modes hinder their ability to navigate through narrow and tortuous lumens. In this letter, we introduce a novel 2-degrees of freedom (DoF) MCR with diverse d

Cited by 9SourceScholar
2024

Design and Visual Servoing Control of a Hybrid Dual-Segment Flexible Neurosurgical Robot for Intraventricular Biopsy

ICRA 2024poster

Traditional rigid endoscopes have challenges in flexibly treating tumors located deep in the brain, and low operability and fixed viewing angles limit its development. This study introduces a novel dual-segment flexible robotic endoscope MicroNeuro, designed to perform biopsies with dexterous surgic…

Cited by 3SourceScholar
2024

Inverse Kinematics Embedded Network for Robust Patient Anatomy Avatar Reconstruction From Multimodal Data

RA-L 2024

Patient modelling has a wide range of applications in medicine and healthcare, such as clinical teaching, surgery navigation and automatic robotized scanning. While patients are typically covered or occluded in medical scenes, directly regressing human meshes from single RGB images is challenging. T

Cited by 5SourceScholar
2024

Leveraging Hallucinations to Reduce Manual Prompt Dependency in Promptable Segmentation

NeurIPS 2024poster

Promptable segmentation typically requires instance-specific manual prompts to guide the segmentation of each desired object. To minimize such a need, task-generic promptable segmentation has been introduced, which employs a single task-generic prompt to segment various images of different objects i…

2024

Multi-Interface Strain Transfer Modeling for Flexible Endoscope Shape Sensing

RA-L 2024

Robot-assisted minimally invasive surgery (MIS) using flexible endoscopy has emerged as a groundbreaking technology for improving traditional surgical approaches. However, a major challenge in advancing this technology is the lack of shape sensing, which leads to inaccurate navigation and control of

Cited by 9SourceScholar
2024

Optical-Waveguide Based 3-Axial Tactile Sensor for Minimally Invasive Surgical Instruments

RA-L 2024

Force feedback is of importance in Minimally Invasive Surgery (MIS) as it reduces surgical risks and enhances surgical safety. However, equipping force sensing to the tip of surgical instruments presents challenges due to their diminutive dimensions and often curved shapes. To address this issue, a

Cited by 4SourceScholar
2024

Relax Image-Specific Prompt Requirement in SAM: A Single Generic Prompt for Segmenting Camouflaged Objects

AAAI 2024technical

Camouflaged object detection (COD) approaches heavily rely on pixel-level annotated datasets. Weakly-supervised COD (WSCOD) approaches use sparse annotations like scribbles or points to reduce annotation efforts, but this can lead to decreased accuracy. The Segment Anything Model (SAM) shows remar…

2024

Vertebrae-based Global X-ray to CT Registration for Thoracic Surgeries

IROS 2024poster

X-ray to CT registration is an essential technique to provide on-site guidance for clinicians and medical robots by aligning preoperative information with intraoperative images. Current methods focus on local registration with small capture ranges and necessitate a manual initial alignment before pr…

Cited by 0SourcecodeScholar
2023

An Ultra-Fast Intrinsic Contact Sensing Method for Medical Instruments With Arbitrary Shape

RA-L 2023

Intraoperative contact sensing has the potential to reduce the risk of surgical errors and enhance manipulation capabilities for medical robots, particularly in contact force control. Current intrinsic force sensing (IFS) methods are limited in application to medical instruments with arbitrary shape

Cited by 6SourceScholar
2022

Attribute-Conditioned Face Swapping Network for Low-Resolution Images

ICASSP 2022accepted

Deep learning based face swapping technologies have opened new frontiers for entertainment industries while pose novel threats to identity security. Applying face swapping to real-world products, as well as defending against its misuse, rely on the capacity to generate high quality face swapped imag…

Cited by 0SourceScholar
2022

Learning Unbiased Transferability for Domain Adaptation by Uncertainty Modeling

ECCV 2022poster

"Domain adaptation (DA) aims to transfer knowledge learned from a labeled source domain to an unlabeled or a less labeled but related target domain. Ideally, the source and target distributions should be aligned to each other equally to achieve unbiased knowledge transfer. However, due to the signif…

2022

Polymer-Based Optical Waveguide Triaxial Tactile Sensing for 3-Dimensional Curved Shell

RA-L 2022

To realize dexterous robotic manipulation and enhance the human-machine interaction, nowadays increasing efforts have been made towards multi-dimensional force sensing. However, there are still bottlenecks in integrating these sensors into robots because of the limitation on conformability to comple

Cited by 17SourceScholar
2020

A Vision-Based Soft Somatosensory System for Distributed Pressure and Temperature Sensing

RA-L 2020

Emulating a human-like somatosensory system in instruments such as robotic hands and surgical grippers has the potential to revolutionize these domains. Using a combination of different sensing modalities is problematic due to the limited space and incompatibility of these sensing principles. Theref

Cited by 14SourceScholar
2020

Discriminative Partial Domain Adversarial Network

ECCV 2020poster

Domain adaptation (DA) has been a fundamental building block for Transfer Learning (TL) which assumes that source and target domain share the same label space. A more general and realistic setting is that the label space of target domain is a subset of the source domain, as termed by Partial domain…

Cited by 37SourcePDFScholar