← Search

Karthik Nandakumar

23 accepted papers

2026

LoFT: Low-Rank Adaptation That Behaves Like Full Fine-Tuning

ICLR 2026poster

Large pre-trained models are commonly adapted to downstream tasks using parameter-efficient fine-tuning methods such as Low-Rank Adaptation (LoRA), which injects small trainable low-rank matrices instead of updating all weights. While LoRA dramatically reduces trainable parameters with little overhe…

Cited by 0SourceScholar
2026

MoSE: Mixture of Slimmable Experts for Efficient and Adaptive Language Models

ICML 2026poster

Mixture-of-Experts (MoE) models scale large language models efficiently by sparsely activating experts, but once an expert is selected, it is executed fully. Hence, the trade-off between accuracy and computation in an MoE model typically exhibits large discontinuities. We propose Mixture of Slimmabl…

Cited by 0SourceScholar
2026

Towards Calibrating Prompt Tuning of Vision- Language Models

CVPR 2026

Prompt tuning of large-scale vision-language models such as CLIP enables efficienttask adaptation without updating model weights. However, it often leads to poorconfidence calibration and unreliable predictive uncertainty. We address thisproblem by proposing a calibration framework that enhances pre

Cited by 0SourcecodeScholar
2025

Aequa: Fair Model Rewards in Collaborative Learning via Slimmable Networks

ICML 2025poster

Collaborative learning enables multiple participants to learn a single global model by exchanging focused updates instead of sharing data. One of the core challenges in collaborative learning is ensuring that participants are rewarded fairly for their contributions, which entails two key sub-problem…

Cited by 0SourcePDFScholar
2025

STEREO: A Two-Stage Framework for Adversarially Robust Concept Erasing from Text-to-Image Diffusion Models

CVPR 2025highlight

The rapid proliferation of large-scale text-to-image diffusion (T2ID) models has raised serious concerns about their potential misuse in generating harmful content. Although numerous methods have been proposed for erasing undesired concepts from T2ID models, they often provide a false sense of secu…

2025

TrojanWave: Exploiting Prompt Learning for Stealthy Backdoor Attacks on Large Audio-Language Models

EMNLP 2025

Prompt learning has emerged as an efficient alternative to full fine-tuning for adapting large audio-language models (ALMs) to downstream tasks. While this paradigm enables scalable deployment via Prompt-as-a-Service frameworks, it also introduces a critical yet underexplored security risk of backdo

2024

Collaborative Learning of Anomalies with Privacy (CLAP) for Unsupervised Video Anomaly Detection: A New Baseline

CVPR 2024poster

nsupervised (US) video anomaly detection (VAD) in surveillance applications is gaining more popularity lately due to its practical real-world applications. Due to the extremely challenging nature of this task where learning is carried out without any annotations privacy-critical collaborative learni…

2024

DiffuseMix: Label-Preserving Data Augmentation with Diffusion Models

CVPR 2024poster

Recently a number of image-mixing-based augmentation techniques have been introduced to improve the generalization of deep neural networks. In these techniques two or more randomly selected natural images are mixed together to generate an augmented image. Such methods may not only omit important por…

Cited by 31SourcePDFScholar
2024

Dirichlet-based Uncertainty Quantification for Personalized Federated Learning with Improved Posterior Networks

IJCAI 2024poster

In modern federated learning, one of the main challenges is to account for inherent heterogeneity and the diverse nature of data distributions for different clients. This problem is often addressed by introducing personalization of the models towards the data distribution of the particular client. H…

Cited by 7SourcePDFScholar
2024

Redefining Contributions: Shapley-Driven Federated Learning

IJCAI 2024poster

Federated learning (FL) has emerged as a pivotal approach in machine learning, enabling multiple participants to collaboratively train a global model without sharing raw data. While FL finds applications in various domains such as healthcare and finance, it is challenging to ensure global model conv…

2023

Byzantine-Tolerant Methods for Distributed Variational Inequalities

NeurIPS 2023poster

Robustness to Byzantine attacks is a necessity for various distributed training scenarios. When the training reduces to the process of solving a minimization problem, Byzantine robustness is relatively well-understood. However, other problem formulations, such as min-max problems or, more generally,…

Cited by 0SourcePDFScholar
2023

CLIP2Protect: Protecting Facial Privacy Using Text-Guided Makeup via Adversarial Latent Search

CVPR 2023poster

The success of deep learning based face recognition systems has given rise to serious privacy concerns due to their ability to enable unauthorized tracking of users in the digital world. Existing methods for enhancing privacy fail to generate naturalistic' images that can protect facial privacy with…

2023

CaPriDe Learning: Confidential and Private Decentralized Learning Based on Encryption-Friendly Distillation Loss

CVPR 2023poster

Large volumes of data required to train accurate deep neural networks (DNNs) are seldom available with any single entity. Often, privacy concerns and stringent data regulations prevent entities from sharing data with each other or with a third-party learning service provider. While cross-silo federa…

2023

Evading Forensic Classifiers With Attribute-Conditioned Adversarial Faces

CVPR 2023poster

The ability of generative models to produce highly realistic synthetic face images has raised security and ethical concerns. As a first line of defense against such fake faces, deep learning based forensic classifiers have been developed. While these forensic models can detect whether a face image i…

2023

FLIP: Cross-domain Face Anti-spoofing with Language Guidance

ICCV 2023poster

Face anti-spoofing (FAS) or presentation attack detection is an essential component of face recognition systems deployed in security-critical applications. Existing FAS methods have poor generalizability to unseen spoof types, camera sensors, and environmental conditions. Recently, vision transforme…

Cited by 57PDFcodeScholar
2023

Single-branch Network for Multimodal Training

ICASSP 2023accepted

With the rapid growth of social media platforms, users are sharing billions of multimedia posts containing audio, images, and text. Researchers have focused on building autonomous systems capable of processing such multimedia data to solve challenging multimodal tasks including cross-modal retrieval…

Cited by 0SourceScholar
2023

Towards Building Text-to-Speech Systems for the Next Billion Users

ICASSP 2023accepted

Deep learning based text-to-speech (TTS) systems have been evolving rapidly with advances in model architectures, training methodologies, and generalization across speakers and languages. However, these advances have not been thoroughly investigated for Indian language speech synthesis. Such investi…

Cited by 0SourceScholar