← Search

Seiji Maekawa

8 accepted papers

2026

Same Content, Different Representations: A Controlled Study for Table QA

ICLR 2026poster

Table Question Answering (Table QA) in real-world settings must operate over both structured databases and semi-structured tables containing textual fields. However, existing benchmarks are tied to fixed data formats and have not systematically examined how representation itself affects model perfor…

Cited by 0SourcecodeScholar
2026

Towards Reliable Benchmarking: A Contamination Free, Controllable Evaluation Framework for Multi-step LLM Function Calling

ICLR 2026poster

As language models gain access to external tools through structured function calls, they become increasingly more capable of solving complex, multi-step tasks. However, existing benchmarks for tool-augmented language models (TaLMs) provide insufficient control over factors such as the number of func…

Cited by 0SourcecodeScholar
2025

Efficient Context Selection for Long-Context QA: No Tuning, No Iteration, Just Adaptive‐k

EMNLP 2025

Retrieval-augmented generation (RAG) and long-context language models (LCLMs) both address context limitations of LLMs in open-domain QA. However, optimal external context to retrieve remains an open problem: fixed retrieval budgets risk wasting tokens or omitting key evidence. Existing adaptive met

Cited by 0SourcePDFScholar
2025

From Single to Multi: How LLMs Hallucinate in Multi-Document Summarization

NAACL 2025findings

Although many studies have investigated and reduced hallucinations in large language models (LLMs) for single-document tasks, research on hallucination in multi-document summarization (MDS) tasks remains largely unexplored. Specifically, it is unclear how the challenges arising from handling multipl…

2025

Holistic Reasoning with Long-Context LMs: A Benchmark for Database Operations on Massive Textual Data

ICLR 2025poster

The rapid increase in textual information means we need more efficient methods to sift through, organize, and understand it all. While retrieval-augmented generation (RAG) models excel in accessing information from large document collections, they struggle with complex tasks that require aggregation…

Cited by 1SourcePDFScholar
2024

Retrieval Helps or Hurts? A Deeper Dive into the Efficacy of Retrieval Augmentation to Language Models

NAACL 2024long

While large language models (LMs) demonstrate remarkable performance, they encounter challenges in providing accurate responses when queried for information beyond their pre-trained memorization. Although augmenting them with relevant external information can mitigate these issues, failure to consid…

2022

Beyond Real-world Benchmark Datasets: An Empirical Study of Node Classification with GNNs

NeurIPS 2022accept

Graph Neural Networks (GNNs) have achieved great success on a node classification task. Despite the broad interest in developing and evaluating GNNs, they have been assessed with limited benchmark datasets. As a result, the existing evaluation of GNNs lacks fine-grained analysis from various charact…

2022

Low-resource Interactive Active Labeling for Fine-tuning Language Models

EMNLP 2022finding

Recently, active learning (AL) methods have been used to effectively fine-tune pre-trained language models for various NLP tasks such as sentiment analysis and document classification. However, given the task of fine-tuning language models, understanding the impact of different aspects on AL methods…

Cited by 16SourcePDFScholar