← Search

Li Siyao

6 accepted papers

2024

Duolando: Follower GPT with Off-Policy Reinforcement Learning for Dance Accompaniment

ICLR 2024poster

We introduce a novel task within the field of human motion generation, termed dance accompaniment, which necessitates the generation of responsive movements from a dance partner, the "follower", synchronized with the lead dancer’s movements and the underlying musical rhythm. Unlike existing solo or…

Cited by 19SourcePDFScholar
2023

Deep Geometrized Cartoon Line Inbetweening

ICCV 2023poster

We aim to address a significant but understudied problem in the anime industry, namely the inbetweening of cartoon line drawings. Inbetweening involves generating intermediate frames between two black-and-white line drawings and is a time-consuming and expensive process that can benefit from automat…

Cited by 17PDFcodeScholar
2022

AnimeRun: 2D Animation Visual Correspondence from Open Source 3D Movies

NeurIPS 2022accept

Visual correspondence of 2D animation is the core of many applications and deserves careful study. Existing correspondence datasets for 2D cartoon suffer from simple frame composition and monotonic movements, making them insufficient to simulate real animations. In this work, we present a new 2D an…

2022

Bailando: 3D Dance Generation by Actor-Critic GPT With Choreographic Memory

CVPR 2022oral

Driving 3D characters to dance following a piece of music is highly challenging due to the spatial constraints applied to poses by choreography norms. In addition, the generated dance sequence also needs to maintain temporal coherency with different music genres. To tackle these challenges, we propo…

Cited by 217PDFcodeScholar
2021

Deep Animation Video Interpolation in the Wild

CVPR 2021poster

In the animation industry, cartoon videos are usually produced at low frame rate since hand drawing of such frames is costly and time-consuming. Therefore, it is desirable to develop computational models that can automatically interpolate the in-between animation frames. However, existing video inte…

Cited by 121PDFcodeScholar