← Search

Samyak Gupta

4 accepted papers

2024

Catastrophic Jailbreak of Open-source LLMs via Exploiting Generation

ICLR 2024spotlight

The rapid progress in open-source large language models (LLMs) is significantly advancing AI development. Extensive efforts have been made before model release to align their behavior with human values, with the primary goal of ensuring their helpfulness and harmlessness. However, even carefully ali…

2023

Privacy Implications of Retrieval-Based Language Models

EMNLP 2023long main

Retrieval-based language models (LMs) have demonstrated improved interpretability, factuality, and adaptability compared to their parametric counterparts by incorporating retrieved text from external datastores. While it is well known that parametric models are prone to leaking private data, it rema…

Cited by 0SourcecodeScholar
2022

Recovering Private Text in Federated Learning of Language Models

NeurIPS 2022accept

Federated learning allows distributed users to collaboratively train a model while keeping each user’s data private. Recently, a growing body of work has demonstrated that an eavesdropping attacker can effectively recover image data from gradients transmitted during federated learning. However, litt…

2021

Evaluating Gradient Inversion Attacks and Defenses in Federated Learning

NeurIPS 2021oral

Gradient inversion attack (or input recovery from gradient) is an emerging threat to the security and privacy preservation of Federated learning, whereby malicious eavesdroppers or participants in the protocol can recover (partially) the clients' private data. This paper evaluates existing attacks a…