← Search

Isha Chaudhary

2 accepted papers

2026

How Catastrophic is Your LLM? Certifying Risk in Conversation

ICLR 2026poster

Large Language Models (LLMs) can produce catastrophic responses in conversational settings that pose serious risks to public safety and security. Existing evaluations often fail to fully reveal these vulnerabilities because they rely on fixed attack prompt sequences, lack statistical guarantees, and…

Cited by 0SourceScholar
2025

Certifying Counterfactual Bias in LLMs

ICLR 2025poster

Large Language Models (LLMs) can produce biased responses that can cause representational harms. However, conventional studies are insufficient to thoroughly evaluate biases across LLM responses for different demographic groups (a.k.a. counterfactual bias), as they do not scale to large number of in…

Cited by 0SourcePDFScholar