← Search

Ruizhe Wang

5 accepted papers

2026

Beyond Sunk Costs: Boosting LLM Pre-training Efficiency via Orthogonal Growth of Mixture-of-Experts

ICML 2026poster

As the computational demands for pre-training Large Language Models (LLMs) continue to surge, the need for efficient training paradigms becomes critical. Despite the vast resources already invested in existing pre-trained checkpoints, these assets often remain under-leveraged due to architectural li…

Cited by 0SourceScholar
2025

Optimizing Large Language Model Training Using FP4 Quantization

ICML 2025poster

The growing computational demands of training large language models (LLMs) necessitate more efficient methods. Quantized training presents a promising solution by enabling low-bit arithmetic operations to reduce these costs. While FP8 precision has demonstrated feasibility, leveraging FP4 remains a…

Cited by 8SourcePDFScholar
2021

Sequential Attacks on Kalman Filter-based Forward Collision Warning Systems

AAAI 2021technical

Kalman Filter (KF) is widely used in various domains to perform sequential learning or variable estimation. In the context of autonomous vehicles, KF constitutes the core component of many Advanced Driver Assistance Systems (ADAS), such as Forward Collision Warning (FCW). It tracks the states (dista…

Cited by 17SourcePDFScholar