← Search

jian ma

24 accepted papers

2026

CG-Floor: Centroid-Guided Diffusion for Large-Scale Floorplan Generation

CVPR 2026

Large-scale floorplan generation is critical for virtual space planning and architectural simulation. Although existing methods have shown success in generating small-scale floorplans with simple room shapes, they struggle to handle complex room connections and irregular room shapes that arise in la

Cited by 0SourceScholar
2026

InterCoser: Interactive 3D Character Creation with Disentangled Fine-Grained Features

AAAI 2026technical

This paper aims to interactively generate and edit disentangled 3D characters based on precise user instructions. Existing methods generate and edit 3D characters via rough and simple editing guidance and entangled representations, making it difficult to achieve precise and comprehensive control ove

Cited by 0SourcePDFScholar
2026

Pluggable Pruning with Contiguous Layer Distillation for Diffusion Transformers

CVPR 2026

Diffusion Transformers (DiTs) have shown exceptional performance in image generation, yet their large parameter counts incur high computational costs, impeding deployment in resource-constrained settings. To address this, we propose Pluggable Pruning with Contiguous Layer Distillation (PPCL), a flex

Cited by 0SourcecodeScholar
2026

Proteo-R1: Thinking Foundation Models for De Novo Protein Binder Design

ICML 2026poster

Recent advances in generative diffusion and flow-matching models have revolutionized molecular design, enabling the creation of novel proteins, small molecules, and RNA sequences with unprecedented fidelity. Yet, these models remain intuitive rather than intelligent—they generate without reasoning. …

Cited by 0SourceScholar
2026

X2Edit: Revisiting Arbitrary-Instruction Image Editing Through Self-Constructed Data and Task-Aware Representation Learning

AAAI 2026technical

Existing open-source datasets for arbitrary-instruction image editing remain suboptimal, while a plug-and-play editing module compatible with community-prevalent generative models is notably absent. In this paper, we first introduce the X2Edit Dataset, a comprehensive dataset covering 14 diverse edi

Cited by 0SourcePDFScholar
2025

GlyphDraw2: Automatic Generation of Complex Glyph Posters with Diffusion Models and Large Language Models

AAAI 2025technical

Posters serve an essential function in marketing and advertising by improving visual communication and brand visibility, thus significantly contributing to industrial design. With the latest developments in controllable T2I diffusion models, research interest has surged in text rendering within synt…

2025

RESCUE: Crowd Evacuation Simulation via Controlling SDM-United Characters

ICCV 2025poster

Crowd evacuation simulation is critical for enhancing public safety, and demanded for realistic virtual environments. Current mainstream evacuation models overlook the complex human behaviors that occur during evacuation, such as pedestrian collisions, interpersonal interactions, and variations in b…

Cited by 0SourcePDFScholar
2025

Repurposing AlphaFold3-like Protein Folding Models for Antibody Sequence and Structure Co-design

NeurIPS 2025poster

Diffusion models hold great potential for accelerating antibody design, but their performance is so far limited by the number of antibody-antigen complexes used for model training. Meanwhile, AlphaFold3-like protein folding models, pre-trained on a large corpus of crystal structures, have acquired a…

Cited by 3SourceScholar
2025

X2I: Seamless Integration of Multimodal Understanding into Diffusion Transformer via Attention Distillation

ICCV 2025poster

Text-to-image (T2I) models are well known for their ability to produce highly realistic images, while multimodal large language models (MLLMs) are renowned for their proficiency in understanding and integrating multiple modalities. However, currently there is no straightforward and efficient framewo…

2024

AEGIS-Net: Attention-Guided Multi-Level Feature Aggregation for Indoor Place Recognition

ICASSP 2024accepted

We present AEGIS-Net, a novel indoor place recognition model that takes in RGB point clouds and generates global place descriptors by aggregating lower-level color, geometry features and higher-level implicit semantic features. However, rather than simple feature concatenation, self-attention module…

Cited by 0SourceScholar
2024

Compositional Text-to-Image Synthesis with Attention Map Control of Diffusion Models

AAAI 2024technical

Recent text-to-image (T2I) diffusion models show outstanding performance in generating high-quality images conditioned on textual prompts. However, they fail to semantically align the generated images with the prompts due to their limited compositional capabilities, leading to attribute leakage, ent…

2024

End-to-end Learnable Clustering for Intent Learning in Recommendation

NeurIPS 2024poster

Intent learning, which aims to learn users' intents for user understanding and item recommendation, has become a hot research spot in recent years. However, existing methods suffer from complex and cumbersome alternating optimization, limiting performance and scalability. To this end, we propose a n…

2024

Identify Then Recommend: Towards Unsupervised Group Recommendation

NeurIPS 2024poster

Group Recommendation (GR), which aims to recommend items to groups of users, has become a promising and practical direction for recommendation systems. This paper points out two issues of the state-of-the-art GR models. (1) The pre-defined and fixed number of user groups is inadequate for real-time…

2024

MS2SL: Multimodal Spoken Data-Driven Continuous Sign Language Production

ACL 2024findings

Sign language understanding has made significant strides; however, there is still no viable solution for generating sign sequences directlyfrom entire spoken content, e.g., text or speech. In this paper, we propose a unified framework for continuous sign language production, easing communication bet…

Cited by 3SourcePDFScholar
2024

Mutual Learning for Acoustic Matching and Dereverberation via Visual Scene-driven Diffusion

ECCV 2024poster

"Visual acoustic matching (VAM) is pivotal for enhancing the immersive experience, and the task of dereverberation is effective in improving audio intelligibility. Existing methods treat each task independently, overlooking the inherent reciprocity between them. Moreover, these methods depend on pai…

Cited by 1SourcePDFScholar
2024

PEA-Diffusion: Parameter-Efficient Adapter with Knowledge Distillation in non-English Text-to-Image Generation

ECCV 2024poster

"Text-to-image diffusion models are well known for their ability to generate realistic images based on textual prompts. However, the existing works have predominantly focused on English, lacking support for non-English text-to-image models. The most commonly used translation methods cannot solve the…

2024

Rocket Landing Control with Random Annealing Jump Start Reinforcement Learning

IROS 2024

Rocket recycling is a crucial pursuit in aerospace technology, aimed at reducing costs and environmental impact in space exploration. The primary focus centers on rocket landing control, involving the guidance of a nonlinear under-actuated rocket with limited fuel in real-time. This challenging task

Cited by 6SourceScholar
2022

EPIC-KITCHENS VISOR Benchmark: VIdeo Segmentations and Object Relations

NeurIPS 2022accept

We introduce VISOR, a new dataset of pixel annotations and a benchmark suite for segmenting hands and active objects in egocentric video. VISOR annotates videos from EPIC-KITCHENS, which comes with a new set of challenges not encountered in current video segmentation datasets. Specifically, we need…

2021

MQBench: Towards Reproducible and Deployable Model Quantization Benchmark

NeurIPS 2021poster

Model quantization has emerged as an indispensable technique to accelerate deep learning inference. Although researchers continue to push the frontier of quantization algorithms, existing quantization work is often unreproducible and undeployable. This is because researchers do not choose consiste…

Cited by 62SourcecodeScholar
2018

Covariate Adjusted Precision Matrix Estimation via Nonconvex Optimization

ICML 2018oral

We propose a nonconvex estimator for the covariate adjusted precision matrix estimation problem in the high dimensional regime, under sparsity constraints. To solve this estimator, we propose an alternating gradient descent algorithm with hard thresholding. Compared with existing methods along this…

Cited by 18SourcePDFScholar
2018

Image-Based PM2.5 Estimation and its Application on Depth Estimation

ICASSP 2018accepted

Air pollution is still a big threat to human health particularly for developing countries. It is highly demanding to measure air quality with daily-used devices such as smartphones. On the other hand, it is difficult to estimate the scene depth under the foul weather using traditional vision-based m…

Cited by 0SourceScholar
2018

Minimax Reconstruction Risk of Convolutional Sparse Dictionary Learning

AISTATS 2018poster

Sparse dictionary learning (SDL) has become a popular method for learning parsimonious representations of data, a fundamental problem in machine learning and signal processing. While most work on SDL assumes a training dataset of independent and identically distributed (IID) samples, a variant known…

Cited by 0SourcePDFScholar
2017

Speeding Up Latent Variable Gaussian Graphical Model Estimation via Nonconvex Optimization

NeurIPS 2017poster

We study the estimation of the latent variable Gaussian graphical model (LVGGM), where the precision matrix is the superposition of a sparse matrix and a low-rank matrix. In order to speed up the estimation of the sparse plus low-rank components, we propose a sparsity constrained maximum likelihood…

Cited by 28SourcePDFScholar