← Search

Jingtao Cao

2 accepted papers

2024

AppBench: Planning of Multiple APIs from Various APPs for Complex User Instruction

EMNLP 2024main

Large Language Models (LLMs) can interact with the real world by connecting with versatile external APIs, resulting in better problem-solving and task automation capabilities. Previous research primarily either focuses on APIs with limited arguments from a single source or overlooks the complex depe…

2024

VLEU: a Method for Automatic Evaluation for Generalizability of Text-to-Image Models

EMNLP 2024main

Progress in Text-to-Image (T2I) models has significantly advanced the generation of images from textual descriptions. Existing metrics, such as CLIP, effectively measure the semantic alignment between single prompts and their corresponding images. However, they fall short in evaluating a model’s abi…