← Search

Zhicheng Cai

4 accepted papers

2026

Beyond Euclidean Clipping: Overcoming Exploration Collapse in LLM RL via Riemannian Isometric Policy Optimization

ICML 2026poster

Reinforcement learning (RL) has become a dominant paradigm for enhancing LLMs' reasoning capabilities. However, RL algorithms with PPO-Clip are inherently limited by exploration collapse. Subsequent works remain primarily heuristic and fail to identify the essential cause of PPO-Clip’s failure. This…

Cited by 0SourceScholar
2026

Split-Layer: Enhancing Implicit Neural Representation by Maximizing the Dimensionality of Feature Space

AAAI 2026technical

Implicit neural representation (INR) models signals as continuous functions using neural networks, offering efficient and differentiable optimization for inverse problems across diverse disciplines. However, the representational capacity of INR—defined by the range of functions the neural network ca

Cited by 0SourcePDFScholar
2025

Enigmata: Scaling Logical Reasoning in Large Language Models with Synthetic Verifiable Puzzles

NeurIPS 2025spotlight

Large Language Models (LLMs), such as OpenAI’s o1 and DeepSeek’s R1, excel at advanced reasoning tasks like math and coding via Reinforcement Learning with Verifiable Rewards (RLVR), but still struggle with puzzles solvable by humans without domain knowledge. We introduce ENIGMATA, the first compreh…

Cited by 0SourcecodeScholar
2024

Batch Normalization Alleviates the Spectral Bias in Coordinate Networks

CVPR 2024poster

Representing signals using coordinate networks dominates the area of inverse problems recently and is widely applied in various scientific computing tasks. Still there exists an issue of spectral bias in coordinate networks limiting the capacity to learn high-frequency components. This problem is ca…

Cited by 9SourcePDFScholar