← Search

Ruyi Xu

4 accepted papers

2026

StreamingVLM: Real-Time Understanding for Infinite Video Streams

ICLR 2026poster

Vision-language models (VLMs) could power real-time assistants and autonomous agents, but they face a critical challenge: understanding near-infinite video streams without escalating latency and memory usage. Processing entire videos with full attention leads to quadratic computational costs and poo…

Cited by 0SourcecodeScholar
2025

Training-Free Industrial Defect Generation with Diffusion Models

ICCV 2025poster

Anomaly generation has become essential in addressing the scarcity of defective samples in industrial anomaly inspection. However, existing training-based methods fail to handle complex anomalies and multiple defects simultaneously, especially when only a single anomaly sample is available per defec…

2025

XAttention: Block Sparse Attention with Antidiagonal Scoring

ICML 2025poster

Long-Context Transformer Models (LCTMs) are vital for real-world applications but suffer high computational costs due to attention's quadratic complexity. Block-sparse attention mitigates this by focusing computation on critical regions, yet existing methods struggle with balancing accuracy and effi…

2024

LLaVA-UHD: an LMM Perceiving any Aspect Ratio and High-Resolution Images

ECCV 2024poster

"Visual encoding constitutes the basis of large multimodal models (LMMs) in understanding the visual world. Conventional LMMs process images in fixed sizes and limited resolutions, while recent explorations in this direction are limited in adaptivity, efficiency, and even correctness. In this work,…