← Search

Guoqiang Wei

8 accepted papers

2024

Boximator: Generating Rich and Controllable Motions for Video Synthesis

ICML 2024poster

Generating rich and controllable motion is a pivotal challenge in video synthesis. We propose *Boximator*, a new approach for fine-grained motion control. Boximator introduces two constraint types: *hard box* and *soft box*. Users select objects in the conditional frame using hard boxes and then use…

Cited by 50SourcePDFScholar
2024

Make Pixels Dance: High-Dynamic Video Generation

CVPR 2024poster

Creating high-dynamic videos such as motion-rich actions and sophisticated visual effects poses a significant challenge in the field of artificial intelligence. Unfortunately current state-of-the-art video generation methods primarily focusing on text-to-video generation tend to produce video clips…

Cited by 102SourcePDFScholar
2024

Mask-Based Modeling for Neural Radiance Fields

ICLR 2024spotlight

Most Neural Radiance Fields (NeRFs) exhibit limited generalization capabilities,which restrict their applicability in representing multiple scenes using a single model. To address this problem, existing generalizable NeRF methods simply condition the model on image features. These methods still stru…

2024

What Matters in Training a GPT4-Style Language Model with Multimodal Inputs?

NAACL 2024long

Recent advancements in GPT-4V have displayed remarkable multi-modal capabilities in processing image inputs and following open-ended instructions. Despite these advancements, there is considerable scope for enhancing open-source multi-modal LLMs, especially in terms of multi-modal understanding accu…

2021

MetaAlign: Coordinating Domain Alignment and Classification for Unsupervised Domain Adaptation

CVPR 2021poster

For unsupervised domain adaptation (UDA), to alleviate the effect of domain shift, many approaches align the source and target domains in the feature space by adversarial learning or by explicitly aligning their statistics. However, the optimization objective of such domain alignment is generally no…

Cited by 137PDFScholar
2021

ToAlign: Task-Oriented Alignment for Unsupervised Domain Adaptation

NeurIPS 2021poster

Unsupervised domain adaptive classifcation intends to improve the classifcation performance on unlabeled target domain. To alleviate the adverse effect of domain shift, many approaches align the source and target domains in the feature space. However, a feature is usually taken as a whole for alignm…