← Search

Elvir Crnčević

2 accepted papers

2026

The Geometry of LLM Quantization: GPTQ as Babai's Nearest Plane Algorithm

ICLR 2026poster

Quantizing the weights of large language models (LLMs) from 16-bit to lower bitwidth is the de facto approach to deploy massive transformers onto more affordable accelerators. While GPTQ emerged as one of the standard methods for one-shot post-training quantization at LLM scale, its inner workings a…

Cited by 0SourcecodeScholar
2024

RoSA: Accurate Parameter-Efficient Fine-Tuning via Robust Adaptation

ICML 2024poster

We investigate parameter-efficient fine-tuning (PEFT) methods that can provide good accuracy under limited computational and memory budgets in the context of large language models (LLMs). We present a new PEFT method called Robust Adaptation (RoSA) inspired by robust principal component analysis tha…