← Search

Zhipeng Zhou

20 accepted papers

2026

PointNSP: Autoregressive 3D Point Cloud Generation with Next-Scale Level-of-Detail Prediction

CVPR 2026

Autoregressive point cloud generation has long lagged behind diffusion-based approaches in quality. The performance gap stems from the fact that autoregressive models impose an artificial ordering on inherently unordered point sets, forcing shape generation to proceed as a sequence of local predicti

Cited by 4SourcecodeScholar
2025

Continual Optimization with Symmetry Teleportation for Multi-Task Learning

NeurIPS 2025poster

Multi-task learning (MTL) is a widely explored paradigm that enables the simultaneous learning of multiple tasks using a single model. Despite numerous solutions, the key issues of optimization conflict and task imbalance remain under-addressed, limiting performance. Unlike existing optimization-bas…

Cited by 0SourceScholar
2025

Exploring Tradeoffs through Mode Connectivity for Multi-Task Learning

NeurIPS 2025poster

Nowadays deep models are required to be versatile due to the increasing realistic needs. Multi-task learning (MTL) offers an efficient way for this purpose to learn multiple tasks simultaneously with a single model. However, prior MTL solutions often focus on resolving conflicts and imbalances durin…

Cited by 0SourceScholar
2024

Hybrid Directional Graph Neural Network for Molecules

ICLR 2024spotlight

Equivariant message passing neural networks have emerged as the prevailing approach for predicting chemical properties of molecules due to their ability to leverage translation and rotation symmetries, resulting in a strong inductive bias. However, the equivariant operations in each layer can impose…

2023

Class-Conditional Sharpness-Aware Minimization for Deep Long-Tailed Recognition

CVPR 2023poster

It's widely acknowledged that deep learning models with flatter minima in its loss landscape tend to generalize better. However, such property is under-explored in deep long-tailed recognition (DLTR), a practical problem where the model is required to generalize equally well across all classes when…

2023

CostFormer:Cost Transformer for Cost Aggregation in Multi-view Stereo

IJCAI 2023poster

The core of Multi-view Stereo(MVS) is the matching process among reference and source pixels. Cost aggregation plays a significant role in this process, while previous methods focus on handling it via CNNs. This may inherit the natural limitation of CNNs that fail to discriminate repetitive or incor…

Cited by 18SourcePDFScholar
2023

PointDC: Unsupervised Semantic Segmentation of 3D Point Clouds via Cross-Modal Distillation and Super-Voxel Clustering

ICCV 2023poster

Semantic segmentation of point clouds usually requires exhausting efforts of human annotations, hence it attracts wide attention to a challenging topic of learning from unlabeled or weaker form of annotations. In this paper, we take the first attempt for fully unsupervised semantic segmentation of p…

Cited by 10PDFcodeScholar
2022

An Efficient Training Approach for Very Large Scale Face Recognition

CVPR 2022poster

Face recognition has achieved significant progress in deep learning era due to the ultra-large-scale and welllabeled datasets. However, training on the outsize datasets is time-consuming and takes up a lot of hardware resource. Therefore, designing an efficient training approach is indispensable. Th…

Cited by 39PDFcodeScholar
2022

MogFace: Towards a Deeper Appreciation on Face Detection

CVPR 2022poster

Benefiting from the pioneering design of generic object detectors, significant achievements have been made in the field of face detection. Typically, the architectures of the backbone, feature pyramid layer, and detection head module within the face detector all assimilate the excellent experience f…

Cited by 36PDFcodeScholar
2022

Scaled ReLU Matters for Training Vision Transformers

AAAI 2022technical

Vision transformers (ViTs) have been an alternative design paradigm to convolutional neural networks (CNNs). However, the training of ViTs is much harder than CNNs, as it is sensitive to the training parameters, such as learning rate, optimizer and warmup epoch. The reasons for training difficulty a…

Cited by 46SourcePDFScholar
2021

Digging Into Uncertainty in Self-Supervised Multi-View Stereo

ICCV 2021poster

Self-supervised Multi-view stereo (MVS) with a pretext task of image reconstruction has achieved significant progress recently. However, previous methods are built upon intuitions, lacking comprehensive explanations about the effectiveness of the pretext task in self-supervised MVS. To this end, we…

Cited by 70PDFcodeScholar
2021

Investigate Indistinguishable Points in Semantic Segmentation of 3D Point Cloud

AAAI 2021technical

This paper investigates the indistinguishable points (difficult to predict label) in semantic segmentation for large-scale 3D point clouds. The indistinguishable points consist of those located in complex boundary, points with similar local textures but different categories, and points in isolate sm…

2021

Learning Geometry-Disentangled Representation for Complementary Understanding of 3D Object Point Cloud

AAAI 2021technical

In 2D image processing, some attempts decompose images into high and low frequency components for describing edge and smooth parts respectively. Similarly, the contour and flat area of 3D objects, such as the boundary and seat area of a chair, describe different but also complementary geometries. Ho…

2021

PC-HMR: Pose Calibration for 3D Human Mesh Recovery from 2D Images/Videos

AAAI 2021technical

The end-to-end Human Mesh Recovery (HMR) approach has been successfully used for 3D body reconstruction. However, most HMR-based frameworks reconstruct human body by directly learning mesh parameters from images or videos, while lacking explicit guidance of 3D human pose in visual data. As a result,…

Cited by 43SourcePDFScholar
2021

Reinforcement Learning for Orientation Estimation Using Inertial Sensors with Performance Guarantee

ICRA 2021poster

This paper presents a deep reinforcement learning (DRL) algorithm for orientation estimation using inertial sensors combined with a magnetometer. Lyapunov’s method in control theory is employed to prove the convergence of orientation estimation errors. The estimator gains and a Lyapunov function are…

Cited by 8SourceScholar
2021

Self-supervised Multi-view Stereo via Effective Co-Segmentation and Data-Augmentation

AAAI 2021technical

Recent studies have witnessed that self-supervised methods based on view synthesis obtain clear progress on multi-view stereo (MVS). However, existing methods rely on the assumption that the corresponding points among different views share the same color, which may not always be true in practice. Th…

2020

SmallBigNet: Integrating Core and Contextual Views for Video Classification

CVPR 2020poster

Temporal convolution has been widely used for video classification. However, it is performed on spatio-temporal contexts in a limited view, which often weakens its capacity of learning video representation. To alleviate this problem, we propose a concise and novel SmallBig network, with the cooperat…

Cited by 125PDFcodeScholar