← Search

Ruiqi Xian

8 accepted papers

2025

On the Vulnerability of LLM/VLM-Controlled Robotics

IROS 2025

In this work, we highlight vulnerabilities in robotic systems integrating large language models (LLMs) and vision-language models (VLMs) due to input modality sensitivities. While LLM/VLM-controlled robots show impressive performance across various tasks, their reliability under slight input variati

Cited by 13SourcecodeScholar
2025

VLM-GroNav: Robot Navigation Using Physically Grounded Vision-Language Models in Outdoor Environments

ICRA 2025

We present a novel autonomous robot navigation algorithm for outdoor environments that is capable of handling diverse terrain traversability conditions. Our approach, VLM-GroNav, uses vision-language models (VLMs) and integrates them with physical grounding that is used to assess intrinsic terrain p

Cited by 7SourceScholar
2024

AGL-Net: Aerial-Ground Cross-Modal Global Localization with Varying Scales

IROS 2024poster

We present AGL-NET, a novel learning-based method for global localization using LiDAR point clouds and satellite maps. AGL-Net tackles two critical challenges: bridging the representation gap between image and points modalities for robust feature matching, and handling inherent scale discrepancies b…

Cited by 1SourcecodeScholar
2024

AutoHallusion: Automatic Generation of Hallucination Benchmarks for Vision-Language Models

EMNLP 2024finding

Large vision-language models (LVLMs) are prone to hallucinations, where certain contextual cues in an image can trigger the language module to produce overconfident and incorrect reasoning about abnormal or hypothetical objects. While some benchmarks have been developed to investigate LVLM hallucina…

2024

HallusionBench: An Advanced Diagnostic Suite for Entangled Language Hallucination and Visual Illusion in Large Vision-Language Models

CVPR 2024poster

We introduce "HallusionBench" a comprehensive benchmark designed for the evaluation of image-context reasoning. This benchmark presents significant challenges to advanced large visual-language models (LVLMs) such as GPT-4V(ision) Gemini Pro Vision Claude 3 and LLaVA-1.5 by emphasizing nuanced unders…

2024

SCP: Soft Conditional Prompt Learning for Aerial Video Action Recognition

IROS 2024poster

We present a new learning approach, Soft Conditional Prompt Learning (SCP), which leverages the strengths of prompt learning for aerial video action recognition. Our approach is designed to predict the action of each agent by helping the models focus on the descriptions or instructions associated wi…

Cited by 1SourceScholar
2023

AZTR: Aerial Video Action Recognition with Auto Zoom and Temporal Reasoning

ICRA 2023poster

We propose a novel approach for aerial video action recognition. Our method is designed for videos captured using UAVs and can run on edge or mobile devices. We present a learning-based approach that uses customized auto zoom to automatically identify the human target and scale it appropriately. Thi…

Cited by 18SourceScholar