← Search

Raghav Gupta

5 accepted papers

2025

Robust Multi-Objective Preference Alignment with Online DPO

AAAI 2025technical

Multi-objective preference alignment of large language models (LLMs) is critical for developing AI systems that are more configurable, personalizable, helpful, and safe. However, optimizing model outputs to satisfy diverse objectives with variable weights at inference time for truly personalized mod…

Cited by 0SourcePDFScholar
2024

Conditional Language Policy: A General Framework For Steerable Multi-Objective Finetuning

EMNLP 2024finding

Reward-based finetuning is crucial for aligning language policies with intended behaviors (*e.g.*, creativity and safety). A key challenge is to develop steerable language models that trade-off multiple (conflicting) objectives in a flexible and efficient manner. This paper presents Conditional Lang…

Cited by 17SourcePDFScholar
2022

SGD-X: A Benchmark for Robust Generalization in Schema-Guided Dialogue Systems

AAAI 2022technical

Zero/few-shot transfer to unseen services is a critical challenge in task-oriented dialogue research. The Schema-Guided Dialogue (SGD) dataset introduced a paradigm for enabling models to support any service in zero-shot through schemas, which describe service APIs to models in natural language. We…

2022

Show, Don’t Tell: Demonstrations Outperform Descriptions for Schema-Guided Task-Oriented Dialogue

NAACL 2022long

Building universal dialogue systems that operate across multiple domains/APIs and generalize to new ones with minimal overhead is a critical challenge. Recent works have leveraged natural language descriptions of schema elements to enable such systems; however, descriptions only indirectly convey sc…

Cited by 34SourcePDFScholar
2015

Qualitative analysis of POMDPs with temporal logic specifications for robotics applications

ICRA 2015poster

We consider partially observable Markov decision processes (POMDPs), that are a standard framework for robotics applications to model uncertainties present in the real world, with temporal logic specifications. All temporal logic specifications in linear-time temporal logic (LTL) can be expressed as…

Cited by 77SourceScholar