← Search

Nave Assaf

2 accepted papers

2026

Revisiting Efficiency–Accuracy Scaling in Mixture-of-Experts Architectures

ICML 2026poster

Mixture-of-Experts (MoEs) have become a central component of many state-of-the-art open-source and proprietary large language models. Despite their widespread adoption, it remains unclear how close existing MoE architectures are to optimal with respect to inference cost, as measured by accuracy per …

Cited by 0SourceScholar
2025

Puzzle: Distillation-Based NAS for Inference-Optimized LLMs

ICML 2025poster

Large language models (LLMs) offer remarkable capabilities, yet their high inference costs restrict wider adoption. While increasing parameter counts improves accuracy, it also broadens the gap between state-of-the-art capabilities and practical deployability. We present **Puzzle**, a hardware-aware…

Cited by 2SourcePDFScholar