Subhradeep Kayal — accepted AI-conference papers

2025

PersonaLens: A Benchmark for Personalization Evaluation in Conversational AI Assistants

Zheng Zhao, Clara Vania, Subhradeep Kayal, Naila Khan, Shay B Cohen, Emine Yilmaz

ACL 2025finding

Large language models (LLMs) have advanced conversational AI assistants. However, systematically evaluating how well these assistants apply personalization—adapting to individual user preferences while completing tasks—remains challenging. Existing personalization benchmarks focus on chit-chat, non-…

Cited by 0 Source ↗PDF ↗code ↗Scholar ↗

2024

How Far Is Too Far? Studying the Effects of Domain Discrepancy on Masked Language Models

Subhradeep Kayal, Alexander Rakhlin, Ali Dashti, Serguei Stepaniants

COLING 2024main

Pre-trained masked language models, such as BERT, perform strongly on a wide variety of NLP tasks and have become ubiquitous in recent years. The typical way to use such models is to fine-tune them on downstream data. In this work, we aim to study how the difference in domains between the pre-traine…

Cited by 0 Source ↗PDF ↗Scholar ↗