← Search

Nurbek Tastan

10 accepted papers

2026

LoFT: Low-Rank Adaptation That Behaves Like Full Fine-Tuning

ICLR 2026poster

Large pre-trained models are commonly adapted to downstream tasks using parameter-efficient fine-tuning methods such as Low-Rank Adaptation (LoRA), which injects small trainable low-rank matrices instead of updating all weights. While LoRA dramatically reduces trainable parameters with little overhe…

Cited by 0SourceScholar
2026

MoSE: Mixture of Slimmable Experts for Efficient and Adaptive Language Models

ICML 2026poster

Mixture-of-Experts (MoE) models scale large language models efficiently by sparsely activating experts, but once an expert is selected, it is executed fully. Hence, the trade-off between accuracy and computation in an MoE model typically exhibits large discontinuities. We propose Mixture of Slimmabl…

Cited by 0SourceScholar
2025

Aequa: Fair Model Rewards in Collaborative Learning via Slimmable Networks

ICML 2025poster

Collaborative learning enables multiple participants to learn a single global model by exchanging focused updates instead of sharing data. One of the core challenges in collaborative learning is ensuring that participants are rewarded fairly for their contributions, which entails two key sub-problem…

Cited by 0SourcePDFScholar
2024

Collaborative Learning of Anomalies with Privacy (CLAP) for Unsupervised Video Anomaly Detection: A New Baseline

CVPR 2024poster

nsupervised (US) video anomaly detection (VAD) in surveillance applications is gaining more popularity lately due to its practical real-world applications. Due to the extremely challenging nature of this task where learning is carried out without any annotations privacy-critical collaborative learni…

2024

Redefining Contributions: Shapley-Driven Federated Learning

IJCAI 2024poster

Federated learning (FL) has emerged as a pivotal approach in machine learning, enabling multiple participants to collaboratively train a global model without sharing raw data. While FL finds applications in various domains such as healthcare and finance, it is challenging to ensure global model conv…

2023

CaPriDe Learning: Confidential and Private Decentralized Learning Based on Encryption-Friendly Distillation Loss

CVPR 2023poster

Large volumes of data required to train accurate deep neural networks (DNNs) are seldom available with any single entity. Often, privacy concerns and stringent data regulations prevent entities from sharing data with each other or with a third-party learning service provider. While cross-silo federa…