← Search

Vijay Srinivasan

6 accepted papers

2024

AlpaGasus: Training a Better Alpaca with Fewer Data

ICLR 2024poster

Large language models~(LLMs) strengthen instruction-following capability through instruction-finetuning (IFT) on supervised instruction/response data. However, widely used IFT datasets (e.g., Alpaca's 52k data) surprisingly contain many low-quality instances with incorrect or irrelevant responses, w…

2024

Backdooring Instruction-Tuned Large Language Models with Virtual Prompt Injection

NAACL 2024long

Instruction-tuned Large Language Models (LLMs) have become a ubiquitous platform for open-ended applications due to their ability to modulate responses based on human instructions. The widespread use of LLMs holds significant potential for shaping public perception, yet also risks being maliciously…

2024

Explicit over Implict: Explicit Diversity Conditions for Effective Question Answer Generation

COLING 2024main

Question Answer Generation (QAG) is an effective data augmentation technique to improve the accuracy of question answering systems, especially in low-resource domains. While recent pretrained and large language model-based QAG methods have made substantial progress, they face the critical issue of r…

Cited by 2SourcePDFScholar
2024

Instruction-following Evaluation through Verbalizer Manipulation

NAACL 2024findings

While instruction-tuned models have shown remarkable success in various natural language processing tasks, accurately evaluating their ability to follow instructions remains challenging. Existing benchmarks primarily focus on common instructions that align well with what the model learned during tra…

2022

Explainable Slot Type Attentions to Improve Joint Intent Detection and Slot Filling

EMNLP 2022finding

Joint intent detection and slot filling is a key research topic in natural language understanding (NLU). Existing joint intent and slot filling systems analyze and compute features collectively for all slot types, and importantly, have no way to explain the slot filling model decisions. In this work…

Cited by 6SourcePDFScholar
2022

ISEEQ: Information Seeking Question Generation Using Dynamic Meta-Information Retrieval and Knowledge Graphs

AAAI 2022technical

Conversational Information Seeking (CIS) is a relatively new research area within conversational AI that attempts to seek information from end-users in order to understand and satisfy the users' needs. If realized, such a CIS system has far-reaching benefits in the real world; for example, CIS syste…