← Search

Tayfun Terzi

2 accepted papers

2022

StreamingQA: A Benchmark for Adaptation to New Knowledge over Time in Question Answering Models

ICML 2022spotlight

Knowledge and language understanding of models evaluated through question answering (QA) has been usually studied on static snapshots of knowledge, like Wikipedia. However, our world is dynamic, evolves over time, and our models’ knowledge becomes outdated. To study how semi-parametric QA models and…

2021

Mind the Gap: Assessing Temporal Generalization in Neural Language Models

NeurIPS 2021spotlight

Our world is open-ended, non-stationary, and constantly evolving; thus what we talk about and how we talk about it change over time. This inherent dynamic nature of language contrasts with the current static language modelling paradigm, which trains and evaluates models on utterances from overlappin…