← Search

Aounon Kumar

8 accepted papers

2024

MedSafetyBench: Evaluating and Improving the Medical Safety of Large Language Models

NeurIPS 2024poster

As large language models (LLMs) develop increasingly sophisticated capabilities and find applications in medical settings, it becomes important to assess their medical safety due to their far-reaching implications for personal and public health, patient safety, and human rights. However, there is li…

2024

Robustness of AI-Image Detectors: Fundamental Limits and Practical Attacks

ICLR 2024poster

In light of recent advancements in generative AI models, it has become essential to distinguish genuine content from AI-generated one to prevent the malicious usage of fake materials as authentic ones and vice versa. Various techniques have been introduced for identifying AI-generated images, with w…

2023

Provable Robustness against Wasserstein Distribution Shifts via Input Randomization

ICLR 2023poster

Certified robustness in machine learning has primarily focused on adversarial perturbations with a fixed attack budget for each sample in the input distribution. In this work, we present provable robustness guarantees on the accuracy of a model under bounded Wasserstein shifts of the data distributi…

Cited by 7SourcePDFScholar
2021

Center Smoothing: Certified Robustness for Networks with Structured Outputs

NeurIPS 2021poster

The study of provable adversarial robustness has mostly been limited to classification tasks and models with one-dimensional real-valued outputs. We extend the scope of certifiable robustness to problems with more general and structured outputs like sets, images, language, etc. We model the output s…

2020

Certifying Confidence via Randomized Smoothing

NeurIPS 2020poster

Randomized smoothing has been shown to provide good certified-robustness guarantees for high-dimensional classification problems. It uses the probabilities of predicting the top two most-likely classes around an input point under a smoothing distribution to generate a certified radius for a classifi…

2020

Curse of Dimensionality on Randomized Smoothing for Certifiable Robustness

ICML 2020poster

Randomized smoothing, using just a simple isotropic Gaussian distribution, has been shown to produce good robustness guarantees against $\ell_2$-norm bounded adversaries. In this work, we show that extending the smoothing technique to defend against other attack models can be challenging, especially…

2020

Detection as Regression: Certified Object Detection with Median Smoothing

NeurIPS 2020poster

Despite the vulnerability of object detectors to adversarial attacks, very few defenses are known to date. While adversarial training can improve the empirical robustness of image classifiers, a direct extension to object detection is very expensive. This work is motivated by recent progress on cert…

Cited by 80SourcePDFScholar