Furkan Şahinuç — accepted AI-conference papers

2024

Efficient Performance Tracking: Leveraging Large Language Models for Automated Construction of Scientific Leaderboards

Furkan Şahinuç, Thy Thy Tran, Yulia Grishina, Yufang Hou, Bei Chen, Iryna Gurevych

EMNLP 2024main

Scientific leaderboards are standardized ranking systems that facilitate evaluating and comparing competitive methods. Typically, a leaderboard is defined by a task, dataset, and evaluation metric (TDM) triple, allowing objective performance assessment and fostering innovation through benchmarking.…

Cited by 1 Source ↗PDF ↗code ↗Scholar ↗

2024

Systematic Task Exploration with LLMs: A Study in Citation Text Generation

Furkan Şahinuç, Ilia Kuznetsov, Yufang Hou, Iryna Gurevych

ACL 2024long

Large language models (LLMs) bring unprecedented flexibility in defining and executing complex, creative natural language generation (NLG) tasks. Yet, this flexibility brings new challenges, as it introduces new degrees of freedom in formulating the task inputs and instructions and in evaluating mod…

Cited by 2 Source ↗PDF ↗code ↗Scholar ↗