← Search

Udari Madhushani Sehwag

6 accepted papers

2026

AdvBDGen: A Robust Framework for Generating Adaptive and Stealthy Backdoors in LLM Alignment

AAAI 2026technical

With the increasing adoption of reinforcement learning with human feedback (RLHF) to align large language models (LLMs), the risk of backdoor installation during the alignment process has grown, potentially leading to unintended and harmful behaviors. Existing backdoor attacks mostly focus on simple

Cited by 0SourcePDFScholar
2026

MoReBench: Evaluating Procedural and Pluralistic Moral Reasoning in Language Models, More than Outcomes

ICLR 2026poster

As AI systems progresses, we rely more on them to make decisions with us and for us. To ensure that such decisions are aligned with human values, it is imperative for us to understand not only what decisions they make but also how they come to those decisions. Reasoning language models, which provid…

Cited by 0SourcecodeScholar
2026

PropensityBench: Evaluating Latent Safety Risks in Large Language Models via an Agentic Approach

ICLR 2026poster

Recent advances in Large Language Models (LLMs) have sparked concerns over their potential to acquire and misuse dangerous capabilities, posing frontier risks to society. Current safety evaluations primarily test for what a model *can* do---its capabilities---without assessing what it *would* do if…

Cited by 0SourcecodeScholar
2025

Collab: Controlled Decoding using Mixture of Agents for LLM Alignment

ICLR 2025poster

Alignment of Large Language models (LLMs) is crucial for safe and trustworthy deployment in applications. Reinforcement learning from human feedback (RLHF) has emerged as an effective technique to align LLMs to human preferences, and broader utilities, but it requires updating billions of model para…

Cited by 1SourcePDFScholar
2025

GenARM: Reward Guided Generation with Autoregressive Reward Model for Test-Time Alignment

ICLR 2025poster

Large Language Models (LLMs) exhibit impressive capabilities but require careful alignment with human preferences. Traditional training-time methods finetune LLMs using human preference datasets but incur significant training costs and require repeated training to handle diverse user preferences. Te…

2025

SORRY-Bench: Systematically Evaluating Large Language Model Safety Refusal

ICLR 2025poster

Evaluating aligned large language models' (LLMs) ability to recognize and reject unsafe user requests is crucial for safe, policy-compliant deployments. Existing evaluation efforts, however, face three limitations that we address with **SORRY-Bench**, our proposed benchmark. **First**, existing meth…