← Search

Sadhana Kumaravel

9 accepted papers

2025

NESTFUL: A Benchmark for Evaluating LLMs on Nested Sequences of API Calls

EMNLP 2025

The resurgence of autonomous agents built using large language models (LLMs) to solve complex real-world tasks has brought increased focus on LLMs’ fundamental ability of tool or function calling. At the core of these agents, an LLM must plan, execute, and respond using external tools, APIs, and cus

2024

API-BLEND: A Comprehensive Corpora for Training and Benchmarking API LLMs

ACL 2024long

There is a growing need for Large Language Models (LLMs) to effectively use tools and external Application Programming Interfaces (APIs) to plan and complete tasks. As such, there is tremendous interest in methods that can acquire sufficient quantities of train and test data that involve calls to to…

2024

CHRONOS: A Schema-Based Event Understanding and Prediction System

AAAI 2024technical

Chronological and Hierarchical Reasoning Over Naturally Occurring Schemas (CHRONOS) is a system that combines language model-based natural language processing with symbolic knowledge representations to analyze and make predictions about newsworthy events. CHRONOS consists of an event-centric informa…

Cited by 1SourcePDFScholar
2024

Granite-Function Calling Model: Introducing Function Calling Abilities via Multi-task Learning of Granular Tasks

EMNLP 2024industry

An emergent research trend explores the use of Large Language Models (LLMs) as the backbone of agentic systems (e.g., SWE-Bench, Agent-Bench). To fulfill LLMs’ potential as autonomous agents, they must be able to identify, call, and interact with a variety of external tools and application program i…

2022

DocAMR: Multi-Sentence AMR Representation and Evaluation

NAACL 2022long

Despite extensive research on parsing of English sentences into Abstract Meaning Representation (AMR) graphs, which are compared to gold graphs via the Smatch metric, full-document parsing into a unified graph representation lacks well-defined representation and evaluation. Taking advantage of a sup…

2021

Circles are like Ellipses, or Ellipses are like Circles? Measuring the Degree of Asymmetry of Static and Contextual Word Embeddings and the Implications to Representation Learning

AAAI 2021technical

Human judgments of word similarity have been a popular method of evaluating the quality of word embedding. But it fails to measure the geometry properties such as asymmetry. For example, it is more natural to say ``Ellipses are like Circles'' than ``Circles are like Ellipses''. Such asymmetry has be…

Cited by 0SourcePDFScholar
2021

Mental Models of AI Agents in a Cooperative Game Setting (Extended Abstract)

IJCAI 2021poster

As more and more forms of AI become prevalent, it becomes increasingly important to understand how people develop mental models of these systems. In this work we study people's mental models of an AI agent in a cooperative word guessing game. We run a study in which people play the game with an AI a…

Cited by 0SourcePDFScholar
2021

Text-based RL Agents with Commonsense Knowledge: New Challenges, Environments and Baselines

AAAI 2021technical

Text-based games have emerged as an important test-bed for Reinforcement Learning (RL) research, requiring RL agents to combine grounded language understanding with sequential decision making. In this paper, we examine the problem of infusing RL agents with commonsense knowledge. Such knowledge woul…

2019

Beyond Backprop: Online Alternating Minimization with Auxiliary Variables

ICML 2019oral

Despite significant recent advances in deep neural networks, training them remains a challenge due to the highly non-convex nature of the objective function. State-of-the-art methods rely on error backpropagation, which suffers from several well-known issues, such as vanishing and exploding gradient…