← Search

Hwee Kuan Lee

4 accepted papers

2026

PrefixMemory-Tuning: Modernizing Prefix-Tuning by Decoupling the Prefix from Attention

ICLR 2026poster

Parameter-Efficient Fine-Tuning (PEFT) methods have become crucial for rapidly adapting large language models (LLMs) to downstream tasks. Prefix-Tuning, an early and effective PEFT technique, demonstrated the ability to achieve performance comparable to full fine-tuning with significantly reduced co…

Cited by 0SourcecodeScholar
2024

Exact Conversion of In-Context Learning to Model Weights in Linearized-Attention Transformers

ICML 2024poster

In-Context Learning (ICL) has been a powerful emergent property of large language models that has attracted increasing attention in recent years. In contrast to regular gradient-based learning, ICL is highly interpretable and does not require parameter updates. In this paper, we show that, for linea…

Cited by 0SourcePDFScholar
2020

Enhancing Transformation-Based Defenses Against Adversarial Attacks with a Distribution Classifier

ICLR 2020poster

Adversarial attacks on convolutional neural networks (CNN) have gained significant attention and there have been active research efforts on defense mechanisms. Stochastic input transformation methods have been proposed, where the idea is to recover the image from adversarial attack by random transfo…

Cited by 0SourceScholar