← Search

Zhengyang Shen

10 accepted papers

2023

Neural ePDOs: Spatially Adaptive Equivariant Partial Differential Operator Based Networks

ICLR 2023top-25%

Endowing deep learning models with symmetry priors can lead to a considerable performance improvement. As an interesting bridge between physics and deep learning, the equivariant partial differential operators (PDOs) have drawn much researchers' attention recently. However, to ensure the PDOs transl…

Cited by 8SourcePDFScholar
2023

Spectral Graphormer: Spectral Graph-Based Transformer for Egocentric Two-Hand Reconstruction using Multi-View Color Images

ICCV 2023poster

We propose a novel transformer-based framework that reconstructs two high fidelity hands from multi-view RGB images. Unlike existing hand pose estimation methods, where one typically trains a deep network to regress hand model parameters from single RGB image, we consider a more challenging problem…

Cited by 4PDFScholar
2022

PDO-s3DCNNs: Partial Differential Operator Based Steerable 3D CNNs

ICML 2022spotlight

Steerable models can provide very general and flexible equivariance by formulating equivariance requirements in the language of representation theory and feature fields, which has been recognized to be effective for many vision tasks. However, deriving steerable models for 3D rotations is much more…

2021

Accurate Point Cloud Registration with Robust Optimal Transport

NeurIPS 2021poster

This work investigates the use of robust optimal transport (OT) for shape matching. Specifically, we show that recent OT solvers improve both optimization-based and deep learning methods for point cloud registration, boosting accuracy at an affordable computational cost. This manuscript starts with…

2021

Efficient Equivariant Network

NeurIPS 2021poster

Convolutional neural networks (CNNs) have dominated the field of Computer Vision and achieved great success due to their built-in translation equivariance. Group equivariant CNNs (G-CNNs) that incorporate more equivariance can significantly improve the performance of conventional CNNs. However, G-CN…

2021

PDO-eS2CNNs: Partial Differential Operator Based Equivariant Spherical CNNs

AAAI 2021technical

Spherical signals exist in many applications, e.g., planetary data, LiDAR scans and digitalization of 3D objects, calling for models that can process spherical data effectively. It does not perform well when simply projecting spherical data into the 2D plane and then using planar convolution neural…

Cited by 16SourcePDFScholar
2020

Adversarial Data Augmentation via Deformation Statistics

ECCV 2020poster

Deep learning models have been successful in computer vision and medical image analysis. However, training these models frequently requires large labeled image sets whose creation is often very time and labor intensive, for example, in the context of 3D segmentations. Approaches capable of training…

Cited by 12SourcePDFScholar
2020

PDO-eConvs: Partial Differential Operator Based Equivariant Convolutions

ICML 2020poster

Recent research has shown that incorporating equivariance into neural network architectures is very helpful, and there have been some works investigating the equivariance of networks under group actions. However, as digital images and feature maps are on the discrete meshgrid, corresponding equivari…

2019

Region-specific Diffeomorphic Metric Mapping

NeurIPS 2019poster

We introduce a region-specific diffeomorphic metric mapping (RDMM) registration approach. RDMM is non-parametric, estimating spatio-temporal velocity fields which parameterize the sought-for spatial transformation. Regularization of these velocity fields is necessary. In contrast to existing non-par…