← Search

Runyi Yu

10 accepted papers

2026

Switch: Learning Agile Skills Switching for Humanoid Robots

ICRA 2026poster

Recent advancements in whole-body control through deep reinforcement learning have enabled humanoid robots to achieve remarkable progress in real-world challenging locomotion skills. However, existing approaches often struggle with flexible transitions between distinct skills, creating safety concer…

2025

Go to Zero: Towards Zero-shot Motion Generation with Million-scale Data

ICCV 2025poster

Generating diverse and natural human motion sequences based on textual descriptions constitutes a fundamental and challenging research area within the domains of computer vision, graphics, and robotics. Despite significant advancements in this field, current methodologies often face challenges regar…

2025

InstructAvatar: Text-Guided Emotion and Motion Control for Avatar Generation

AAAI 2025technical

Recent talking avatar generation models have made strides in achieving realistic and accurate lip synchronization with the audio, but often fall short in controlling and conveying detailed expressions and emotions of the avatar, making the generated video less vivid and controllable. In this paper,…

2025

SkillMimic: Learning Basketball Interaction Skills from Demonstrations

CVPR 2025highlight

Traditional reinforcement learning methods for human-object interaction (HOI) rely on labor-intensive, manually designed skill rewards that do not generalize well across different interactions. We introduce SkillMimic, a unified data-driven framework that fundamentally changes how agents learn inter…

2024

GAIA: Zero-shot Talking Avatar Generation

ICLR 2024poster

Zero-shot talking avatar generation aims at synthesizing natural talking videos from speech and a single portrait image. Previous methods have relied on domain-specific heuristics such as warping-based motion representation and 3D Morphable Models, which limit the naturalness and diversity of the ge…

Cited by 21SourcePDFScholar
2024

Local Action-Guided Motion Diffusion Model for Text-to-Motion Generation

ECCV 2024poster

"Text-to-motion generation requires not only grounding local actions in language but also seamlessly blending these individual actions to synthesize diverse and realistic global motions. However, existing motion generation methods primarily focus on the direct synthesis of global motions while negle…

2023

ACSeg: Adaptive Conceptualization for Unsupervised Semantic Segmentation

CVPR 2023highlight

Recently, self-supervised large-scale visual pre-training models have shown great promise in representing pixel-level semantic relationships, significantly promoting the development of unsupervised dense prediction tasks, e.g., unsupervised semantic segmentation (USS). The extracted relationship amo…

Cited by 50SourcePDFScholar
2023

LaPE: Layer-adaptive Position Embedding for Vision Transformers with Independent Layer Normalization

ICCV 2023poster

Position information is critical for Vision Transformers (VTs) due to the permutation-invariance of self-attention operations. A typical way to introduce position information is adding the absolute Position Embedding (PE) to patch embedding before entering VTs. However, this approach operates the sa…

Cited by 10PDFcodeScholar
2022

Locality Guidance for Improving Vision Transformers on Tiny Datasets

ECCV 2022poster

"While the Vision Transformer (VT) architecture is becoming trendy in computer vision, pure VT models perform poorly on tiny datasets. To address this issue, this paper proposes the locality guidance for improving the performance of VTs on tiny datasets. We first analyze that the local information,…