← Search

Rohan Jain

3 accepted papers

2026

SparseOpt: Addressing Normalization-induced Gradient Skew in Sparse Training

ICML 2026poster

Dynamic Sparse Training (DST) methods train neural networks by maintaining sparsity while dynamically adapting the network topology. Despite the promise of reduced computation, DST methods converge significantly slower than dense training, often requiring comparable training time to achieve similar …

Cited by 0SourceScholar
2025

Sparse Training from Random Initialization: Aligning Lottery Ticket Masks using Weight Symmetry

ICML 2025poster

The Lottery Ticket Hypothesis (LTH) suggests there exists a sparse LTH mask and weights that achieve the same generalization performance as the dense model while using significantly fewer parameters. However, finding a LTH solution is computationally expensive, and a LTH sparsity mask does not gener…

2024

EROS:Entity-Driven Controlled Policy Document Summarization

COLING 2024main

Privacy policy documents have a crucial role in educating individuals about the collection, usage, and protection of users’ personal data by organizations. However, they are notorious for their lengthy, complex, and convoluted language especially involving privacy-related entities. Hence, they pose…