← Search

Siyu Zou

4 accepted papers

2026

FUSE: Fine-Grained and Semantic-Aware Learning for Unified Image Understanding and Generation

AAAI 2026technical

Recent unified models have demonstrated that the reasoning capacity of Multimodal Large Language Models (MLLMs) can be leveraged to facilitate diffusion-based image generation with impressive flexibility and performance. However, approaches that rely heavily on MLLMs for high-level semantic encoding

Cited by 0SourcePDFScholar
2024

Towards Efficient Diffusion-Based Image Editing with Instant Attention Masks

AAAI 2024technical

Diffusion-based Image Editing (DIE) is an emerging research hot-spot, which often applies a semantic mask to control the target area for diffusion-based editing. However, most existing solutions obtain these masks via manual operations or off-line processing, greatly reducing their efficiency. In th…

2022

HMD-former: a Transformer-based Human Mesh Deformer with Inter-layer Semantic Consistency

ICRA 2022poster

We present a transformer-based network, Human Mesh Deformer (HMD-former), to tackle the problem of 3D human mesh reconstruction from a single RGB image. HMD-former applies a pre-trained CNN to extract image grid features and a transformer decoder to gradually warp the template 3D mesh to the deforme…

Cited by 1SourcecodeScholar
2022

PA-AWCNN: Two-stream Parallel Attention Adaptive Weight Network for RGB-D Action Recognition

ICRA 2022poster

Due to overly relying on appearance information or adopting direct static feature fusion, most of the existing action recognition methods based on multi-modality have poor robustness and insufficient consideration of modality differences. To address these problems, we propose a two-stream adaptive w…

Cited by 6SourcecodeScholar