← Search

Shengji Tang

6 accepted papers

2026

Beyond Gemini-3-Pro: Revisiting LLM Routing and Aggregation at Scale

ICML 2026poster

Large Language Models (LLMs) have rapidly advanced, with Gemini-3-Pro setting a new performance milestone. In this work, we explore collective intelligence as an alternative to monolithic scaling, and demonstrate that open-source LLMs' collaboration can surpass Gemini-3-Pro. We first revisit LLM rou…

Cited by 0SourceScholar
2025

HiSplat: Hierarchical 3D Gaussian Splatting for Generalizable Sparse-View Reconstruction

ICLR 2025poster

Reconstructing 3D scenes from multiple viewpoints is a fundamental task in stereo vision. Recently, advances in generalizable 3D Gaussian Splatting have enabled high-quality novel view synthesis for unseen scenes from sparse input views by feed-forward predicting per-pixel Gaussian parameters withou…

2024

Boosting Residual Networks with Group Knowledge

AAAI 2024technical

Recent research understands the residual networks from a new perspective of the implicit ensemble model. From this view, previous methods such as stochastic depth and stimulative training have further improved the performance of the residual network by sampling and training of its subnets. However,…

2024

Enhanced Sparsification via Stimulative Training

ECCV 2024poster

"Sparsification-based pruning has been an important category in model compression. Existing methods commonly set sparsity-inducing penalty terms to suppress the importance of dropped weights, which is regarded as the suppressed sparsification paradigm. However, this paradigm inactivates the dropped…

2024

S2HPruner: Soft-to-Hard Distillation Bridges the Discretization Gap in Pruning

NeurIPS 2024poster

Recently, differentiable mask pruning methods optimize the continuous relaxation architecture (soft network) as the proxy of the pruned discrete network (hard network) for superior sub-architecture search. However, due to the agnostic impact of the discretization process, the hard network struggles…

Cited by 0SourcePDFScholar
2022

Stimulative Training of Residual Networks: A Social Psychology Perspective of Loafing

NeurIPS 2022accept

Residual networks have shown great success and become indispensable in today’s deep models. In this work, we aim to re-investigate the training process of residual networks from a novel social psychology perspective of loafing, and further propose a new training strategy to strengthen the performanc…