← Search

Harsh Jhamtani

15 accepted papers

2025

LLM Agents for Coordinating Multi-User Information Gathering

ACL 2025finding

This paper introduces PeopleJoin, a benchmark for evaluating LM-mediated collaborative problem solving. Given a user request, PeopleJoin agents must identify teammates who might be able to assist, converse with these teammates to gather information, and finally compile a useful answer or summary for…

2025

Steering Large Language Models between Code Execution and Textual Reasoning

ICLR 2025poster

While a lot of recent research focuses on enhancing the textual reasoning capabilities of Large Language Models (LLMs) by optimizing the multi-agent framework or reasoning chains, several benchmark tasks can be solved with 100\% success through direct coding, which is more scalable and avoids the co…

2024

Interpreting User Requests in the Context of Natural Language Standing Instructions

NAACL 2024findings

Users of natural language interfaces, frequently powered by Large Language Models (LLMs), must often repeat their full set of preferences each time they make a similar request. We describe an approach to LLM-based dialogue modeling in which persistent user constraints and preferences – collectively…

2024

Language-to-Code Translation with a Single Labeled Example

EMNLP 2024main

Tools for translating natural language into code promise natural, open-ended interaction with databases, web APIs, and other software systems. However, this promise is complicated by the diversity and continual development of these systems, each with its own interface and distinct set of features. B…

Cited by 0SourcePDFScholar
2024

Learning to Retrieve Iteratively for In-Context Learning

EMNLP 2024main

We introduce iterative retrieval, a novel framework that empowers retrievers to make iterative decisions through policy optimization. Finding an optimal portfolio of retrieved items is a combinatorial optimization problem, generally considered NP-hard. This approach provides a learned approximation…

Cited by 5SourcePDFScholar
2024

Natural Language Decomposition and Interpretation of Complex Utterances

IJCAI 2024poster

Designing natural language interfaces has historically required collecting supervised data to translate user requests into carefully designed intent representations. This requires enumerating and labeling a long tail of user requests, which is challenging. At the same time, large language models (LL…

Cited by 7SourcePDFScholar
2024

Ontologically Faithful Generation of Non-Player Character Dialogues

EMNLP 2024main

We introduce a language generation dataset grounded in a popular video game. KNUDGE (**KN**owledge Constrained **U**ser-NPC **D**ialogue **GE**neration) requires models to produce trees of dialogue between video game characters that accurately reflect quest and entity specifications stated in natura…

2024

Towards Robust Evaluation of Unlearning in LLMs via Data Transformations

EMNLP 2024finding

Large Language Models (LLMs) have shown to be a great success in a wide range of applications ranging from regular NLP-based use cases to AI agents. LLMs have been trained on a vast corpus of texts from various sources; despite the best efforts during the data pre-processing stage while training the…

2023

The Whole Truth and Nothing But the Truth: Faithful and Controllable Dialogue Response Generation with Dataflow Transduction and Constrained Decoding

ACL 2023findings

In a real-world dialogue system, generated text must be truthful and informative while remaining fluent and adhering to a prescribed style. Satisfying these constraints simultaneously isdifficult for the two predominant paradigms in language generation: neural language modeling and rule-based genera…

2022

Achieving Conversational Goals with Unsupervised Post-hoc Knowledge Injection

ACL 2022long

A limitation of current neural dialog models is that they tend to suffer from a lack of specificity and informativeness in generated responses, primarily due to dependence on training data that covers a limited variety of scenarios and conveys limited knowledge. One way to alleviate this issue is to…

2022

PINEAPPLE: Personifying INanimate Entities by Acquiring Parallel Personification Data for Learning Enhanced Generation

COLING 2022main

A personification is a figure of speech that endows inanimate entities with properties and actions typically seen as requiring animacy. In this paper, we explore the task of personification generation. To this end, we propose PINEAPPLE: Personifying INanimate Entities by Acquiring Parallel Personifi…

2022

Target-Guided Dialogue Response Generation Using Commonsense and Data Augmentation

NAACL 2022findings

Target-guided response generation enables dialogue systems to smoothly transition a conversation from a dialogue context toward a target sentence. Such control is useful for designing dialogue systems that direct a conversation toward specific goals, such as creating non-obtrusive recommendations or…

2021

Investigating Robustness of Dialog Models to Popular Figurative Language Constructs

EMNLP 2021main

Humans often employ figurative language use in communication, including during interactions with dialog systems. Thus, it is important for real-world dialog systems to be able to handle popular figurative language constructs like metaphor and simile. In this work, we analyze the performance of exist…

2021

Unsupervised Enrichment of Persona-grounded Dialog with Background Stories

ACL 2021short

Humans often refer to personal narratives, life experiences, and events to make a conversation more engaging and rich. While persona-grounded dialog models are able to generate responses that follow a given persona, they often miss out on stating detailed experiences or events related to a persona,…