← Search

Parsa Nooralinejad

4 accepted papers

2025

MCNC: Manifold-Constrained Reparameterization for Neural Compression

ICLR 2025poster

The outstanding performance of large foundational models across diverse tasks, from computer vision to speech and natural language processing, has significantly increased their demand. However, storing and transmitting these models poses significant challenges due to their massive size (e.g., 750GB…

2024

BrainWash: A Poisoning Attack to Forget in Continual Learning

CVPR 2024poster

Continual learning has gained substantial attention within the deep learning community offering promising solutions to the challenging problem of sequential learning. Yet a largely unexplored facet of this paradigm is its susceptibility to adversarial attacks especially with the aim of inducing forg…

2024

NOLA: Compressing LoRA using Linear Combination of Random Basis

ICLR 2024poster

Fine-tuning Large Language Models (LLMs) and storing them for each downstream task or domain is impractical because of the massive model size (e.g., 350GB in GPT-3). Current literature, such as LoRA, showcases the potential of low-rank modifications to the original weights of an LLM, enabling effici…

2023

PRANC: Pseudo RAndom Networks for Compacting Deep Models

ICCV 2023poster

We demonstrate that a deep model can be reparametrized as a linear combination of several randomly initialized and frozen deep models in the weight space. During training, we seek local minima that reside within the subspace spanned by these random models (i.e., `basis' networks). Our framework, PRA…

Cited by 12PDFcodeScholar