← Search

Xiaoyu Zhu

5 accepted papers

2026

On Robustness and Chain-of-Thought Consistency of RL-Finetuned VLMs

ICML 2026poster

Reinforcement learning (RL) fine-tuning is now widely used to improve LLM reasoning, and recent work has begun extending it to vision-language models (VLMs). While RL-tuned VLMs can improve visual reasoning benchmark performance, they can still suffer from weak visual grounding, hallucinations, and …

Cited by 0SourceScholar
2025

GeoScene: Temporal 3D Semantic Scene Completion with Geometric Correlation between Images

IROS 2025

Semantic Scene Completion (SSC) aims to reconstruct the entire 3D scene in terms of both occupancy and semantics, serving as a fundamental task for autonomous driving and robotic systems. Camera-based methods have seen significant advancements due to their low cost and rich visual cues. However, pre

Cited by 0SourceScholar
2023

STMT: A Spatial-Temporal Mesh Transformer for MoCap-Based Action Recognition

CVPR 2023poster

We study the problem of human action recognition using motion capture (MoCap) sequences. Unlike existing techniques that take multiple manual steps to derive standardized skeleton representations as model input, we propose a novel Spatial-Temporal Mesh Transformer (STMT) to directly model the mesh s…

2021

Point, Disambiguate and Copy: Incorporating Bilingual Dictionaries for Neural Machine Translation

ACL 2021long

This paper proposes a sophisticated neural architecture to incorporate bilingual dictionaries into Neural Machine Translation (NMT) models. By introducing three novel components: Pointer, Disambiguator, and Copier, our method PDC achieves the following merits inherently compared with previous effort…

2021

Weakly Supervised 3D Semantic Segmentation Using Cross-Image Consensus and Inter-Voxel Affinity Relations

ICCV 2021poster

We propose a novel weakly supervised approach for 3D semantic segmentation on volumetric images. Unlike most existing methods that require voxel-wise densely labeled training data, our weakly-supervised CIVA-Net is the first model that only needs image-level class labels as guidance to learn accurat…

Cited by 20PDFcodeScholar