← Search

Chengqi Deng

4 accepted papers

2026

mHC: Manifold-Constrained Hyper-Connections

ICML 2026spotlight

Recently, studies exemplified by Hyper-Connections (HC) have extended the ubiquitous residual connection paradigm established over the past decade by expanding the residual stream width and diversifying connectivity patterns. While yielding substantial performance gains, this diversification fundame…

Cited by 0SourceScholar
2024

DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Models

ACL 2024long

In the era of large language models, Mixture-of-Experts (MoE) is a promising architecture for managing computational costs when scaling up model parameters. However, conventional MoE architectures like GShard, which activate the top-K out of N experts, face challenges in ensuring expert specializati…

2022

Sparse Fuse Dense: Towards High Quality 3D Detection With Depth Completion

CVPR 2022oral

Current LiDAR-only 3D detection methods inevitably suffer from the sparsity of point clouds. Many multi-modal methods are proposed to alleviate this issue, while different representations of images and point clouds make it difficult to fuse them, resulting in suboptimal performance. In this paper, w…

Cited by 251PDFcodeScholar
2020

Pitchnet: Unsupervised Singing Voice Conversion with Pitch Adversarial Network

ICASSP 2020accepted

Singing voice conversion is to convert a singer's voice to another one's voice without changing singing content. Recent work shows that unsupervised singing voice conversion can be achieved with an autoencoder-based approach [1]. However, the converted singing voice can be easily out of key, showing…

Cited by 0SourceScholar