← Search

Kenshiro Tanaka

2 accepted papers

2025

Token-based Decision Criteria Are Suboptimal in In-context Learning

NAACL 2025long

In-Context Learning (ICL) typically utilizes classification criteria from output probabilities of manually selected label tokens. However, we argue that such token-based classification criteria lead to suboptimal decision boundaries, despite delicate calibrations through translation and constrained…

2025

Understanding Token Probability Encoding in Output Embeddings

COLING 2025main

In this paper, we investigate the output token probability information in the output embedding of language models. We find an approximate common log-linear encoding of output token probabilities within the output embedding vectors and empirically demonstrate that it is accurate and sparse. As a caus…

Cited by 2SourcePDFScholar