← Search

Karishma Malkan

2 accepted papers

2025

Test of Time: A Benchmark for Evaluating LLMs on Temporal Reasoning

ICLR 2025poster

Large language models (LLMs) have showcased remarkable reasoning capabilities, yet they remain susceptible to errors, particularly in temporal reasoning tasks involving complex temporal logic. Existing research has explored LLM performance on temporal reasoning using diverse datasets and benchmarks.…

Cited by 22SourcePDFScholar
2021

Do Transformer Modifications Transfer Across Implementations and Applications?

EMNLP 2021main

The research community has proposed copious modifications to the Transformer architecture since it was introduced over three years ago, relatively few of which have seen widespread adoption. In this paper, we comprehensively evaluate many of these modifications in a shared experimental setting that…