← Search

Karthik Raman

4 accepted papers

2024

It’s All Relative! – A Synthetic Query Generation Approach for Improving Zero-Shot Relevance Prediction

NAACL 2024findings

Large language models (LLMs) have shown promising ability to generate synthetic query-document pairs by prompting with as few as 8 demonstrations. This has enabled building better IR models, especially for tasks with no training data. Typically, such synthetic query generation (QGen) approaches cond…

Cited by 8SourcePDFScholar
2024

Take One Step at a Time to Know Incremental Utility of Demonstration: An Analysis on Reranking for Few-Shot In-Context Learning

NAACL 2024long

In-Context Learning (ICL) is an emergent capability of Large Language Models (LLMs). Only a few demonstrations enable LLMs to be used as blackbox for new tasks. Previous studies have shown that using LLMs’ outputs as labels is effective in training models to select demonstrations. Such a label is ex…

2022

QUILL: Query Intent with Large Language Models using Retrieval Augmentation and Multi-stage Distillation

EMNLP 2022industry

Large Language Models (LLMs) have shown impressive results on a variety of text understanding tasks. Search queries though pose a unique challenge, given their short-length and lack of nuance or context. Complicated feature engineering efforts do not always lead to downstream improvements as their p…

Cited by 31SourcePDFScholar
2022

Transforming Sequence Tagging Into A Seq2Seq Task

EMNLP 2022main

Pretrained, large, generative language models (LMs) have had great success in a wide range of sequence tagging and structured prediction tasks. Casting a sequence tagging task as a Seq2Seq one requires deciding the formats of the input and output sequences. However, we lack a principled understandin…