← Search

Hikari Otsuka

2 accepted papers

2026

The Strong Lottery Ticket Hypothesis for Multi-Head Attention Mechanisms

AAAI 2026technical

The strong lottery ticket hypothesis (SLTH) conjectures that high-performing subnetworks, called strong lottery tickets (SLTs), are hidden in randomly initialized neural networks. Although recent theoretical studies have established the SLTH across various neural architectures, the SLTH for transfor

Cited by 0SourcePDFScholar
2026

Towards Quantization-Aware Training for Ultra-Low-Bit Reasoning LLMs

ICLR 2026poster

Large language models (LLMs) have achieved remarkable performance across diverse reasoning tasks, yet their deployment is hindered by prohibitive computational and memory costs. Quantization-aware training (QAT) enables ultra-low-bit compression (<4 bits per weight), but existing QAT methods often d…

Cited by 0SourcecodeScholar