3 accepted papers
We tackle the task of long-form music generation, particularly the challenging \textbf{lyrics-to-song} problem, by introducing \textbf{YuE (乐)}, a family of open-source music generation foundation models. Specifically, YuE scales to trillions of tokens and generates up to five minutes of music while…
Generating gestures from human speech has gained tremendous progress in animating virtual avatars. While the existing methods enable synthesizing gestures cooperated by people self-talking, they overlook the practicality of concurrent gesture modeling with two-person interactive conversations. Moreo…
Existing video domain adaptation methods focus on addressing closed set problems. However, it is nearly impossible to guarantee different domains share exactly the same set of categories in realistic scenarios. Hence, open set video domain adaptation (OSVDA) problem, which involves unknown categorie…