← Search

Jonathan Svirsky

6 accepted papers

2025

AdaRankGrad: Adaptive Gradient Rank and Moments for Memory-Efficient LLMs Training and Fine-Tuning

ICLR 2025poster

Training and fine-tuning large language models (LLMs) come with challenges related to memory and computational requirements due to the increasing size of the model weights and the optimizer states. To tackle these challenges, various techniques have been developed, such as low-rank adaptation (LoRA)…

Cited by 3SourcePDFScholar
2025

COPER: Correlation-based Permutations for Multi-View Clustering

ICLR 2025spotlight

Combining data from different sources can improve data analysis tasks such as clustering. However, most of the current multi-view clustering methods are limited to specific domains or rely on a suboptimal and computationally intensive two-stage process of representation learning and clustering. We p…

Cited by 0SourcePDFScholar
2021

Differentiable Unsupervised Feature Selection based on a Gated Laplacian

NeurIPS 2021poster

Scientific observations may consist of a large number of variables (features). Selecting a subset of meaningful features is often crucial for identifying patterns hidden in the ambient space. In this paper, we present a method for unsupervised feature selection, and we demonstrate its advantage in c…