← Search

Xuesong Niu

9 accepted papers

2026

Mod-Adapter: Tuning-Free and Versatile Multi-concept Personalization via Modulation Adapter

ICLR 2026poster

Personalized text-to-image generation aims to synthesize images of user-provided concepts in diverse contexts. Despite recent progress in multi-concept personalization, most are limited to object concepts and struggle to customize abstract concepts (e.g., pose, lighting). Some methods have begun ex…

Cited by 0SourcecodeScholar
2024

F-HOI: Toward Fine-grained Semantic-Aligned 3D Human-Object Interactions

ECCV 2024poster

"Existing 3D human object interaction (HOI) datasets and models simply align global descriptions with the long HOI sequence, while lacking a detailed understanding of intermediate states and the transitions between states. In this paper, we argue that fine-grained semantic alignment, which utilizes…

Cited by 10SourcePDFScholar
2024

Multi-modal Situated Reasoning in 3D Scenes

NeurIPS 2024poster

Situation awareness is essential for understanding and reasoning about 3D scenes in embodied AI agents. However, existing datasets and benchmarks for situated understanding suffer from severe limitations in data modality, scope, diversity, and scale. To address these limitations, we propose Multi…

2024

SceneVerse: Scaling 3D Vision-Language Learning for Grounded Scene Understanding

ECCV 2024poster

"3D vision-language (3dvl) grounding, which aims to align language with 3D physical environments, stands as a cornerstone in developing embodied agents. In comparison to recent advancements in the 2D domain, grounding language in 3D scenes faces two significant challenges: (i) the scarcity of paired…

Cited by 71SourcePDFScholar
2024

Unifying 3D Vision-Language Understanding via Promptable Queries

ECCV 2024poster

"A unified model for 3D vision-language (3D-VL) understanding is expected to take various scene representations and perform a wide range of tasks in a 3D scene. However, a considerable gap exists between existing methods and such a unified model, due to the independent application of representation…

Cited by 23SourcePDFScholar
2020

Face Anti-Spoofing with Human Material Perception

ECCV 2020poster

Face anti-spoofing (FAS) plays a vital role in securing the face recognition systems from presentation attacks. Most existing FAS methods capture various cues (e.g., texture, depth and reflection) to distinguish the live faces from the spoofing faces. All these cues are based on the discrepancy amon…

Cited by 193SourcePDFScholar
2020

Video-based Remote Physiological Measurement via Cross-verified Feature Disentangling

ECCV 2020poster

Remote physiological measurements, e.g., remote photoplethysmography (rPPG) based heart rate (HR), heart rate variability (HRV) and respiration frequency (RF) measuring, are playing more and more important roles under the application scenarios where contact measurement is inconvenient or impossible.…

2019

Local Relationship Learning With Person-Specific Shape Regularization for Facial Action Unit Detection

CVPR 2019poster

Encoding individual facial expressions via action units (AUs) coded by the Facial Action Coding System (FACS) has been found to be an effective approach in resolving the ambiguity issue among different expressions. While a number of methods have been proposed for AU detection, robust AU detection in…

Cited by 171PDFScholar
2019

Multi-label Co-regularization for Semi-supervised Facial Action Unit Recognition

NeurIPS 2019poster

Facial action units (AUs) recognition is essential for emotion analysis and has been widely applied in mental state analysis. Existing work on AU recognition usually requires big face dataset with accurate AU labels. However, manual AU annotation requires expertise and can be time-consuming. In this…