← Search

Xinyu Xiao

8 accepted papers

2025

Merge then Realign: Simple and Effective Modality-Incremental Continual Learning for Multimodal LLMs

EMNLP 2025

Recent advances in Multimodal Large Language Models (MLLMs) have enhanced their versatility as they integrate a growing number of modalities. Considering the heavy cost of training MLLMs, it is efficient to reuse the existing ones and extend them to more modalities through Modality-incremental Conti

Cited by 0SourcePDFScholar
2025

Privacy-Preserving V2X Collaborative Perception Integrating Unknown Collaborators

AAAI 2025technical

Vehicle-to-everything (V2X) collaborative perception has recently gained increasing attention in autonomous driving due to its ability to enhance scene understanding by integrating information from other collaborators, e.g. vehicles or infrastructure. Existing algorithms usually share deep features…

Cited by 0SourcePDFScholar
2025

RayFusion: Ray Fusion Enhanced Collaborative Visual Perception

NeurIPS 2025poster

Collaborative visual perception methods have gained widespread attention in the autonomous driving community in recent years due to their ability to address sensor limitation problems. However, the absence of explicit depth information often makes it difficult for camera-based perception systems, e.…

Cited by 0SourceScholar
2025

Towards Building Human-like Smart Agents in Modern 3D Video Games (Student Abstract)

AAAI 2025technical

In recent years, reinforcement learning has been widely applied in the field of games. However, most studies focus on assisting agents to achieve victory, with less attention paid to whether the agents exhibit human-like characteristics. In order to build human-like agents with high performance, we…

Cited by 0SourcePDFScholar
2025

Unified Video Generation via Next-Set Prediction in Continuous Domain

ICCV 2025poster

Existing video generation strategies can be categorized into two categories, i.e., the diffusion and autoregressive (AR) methods. While AR methods achieves high efficiency by predicting the next token based on known visual cues, they generally fall short of diffusion models in terms of video quality…

Cited by 0SourcePDFScholar
2024

IFTR: An Instance-Level Fusion Transformer for Visual Collaborative Perception

ECCV 2024poster

"Multi-agent collaborative perception has emerged as a widely recognized technology in the field of autonomous driving in recent years. However, current collaborative perception predominantly relies on LiDAR point clouds, with significantly less attention given to methods using camera images. This s…

2021

Reinforcement Stacked Learning with Semantic-Associated Attention for Visual Question Answering

ICASSP 2021accepted

The task of visual question answering (VQA) is to generate an answer for a question according to the content of an image being asked. In this process, the critical problems of effectively embedding the question feature and image feature as well as transforming the features to the prediction of answe…

Cited by 0SourceScholar
2019

DetNAS: Backbone Search for Object Detection

NeurIPS 2019poster

Object detectors are usually equipped with backbone networks designed for image classification. It might be sub-optimal because of the gap between the tasks of image classification and object detection. In this work, we present DetNAS to use Neural Architecture Search (NAS) for the design of better…