← Search

Naoki Yoshinaga

11 accepted papers

2025

Neuron Empirical Gradient: Discovering and Quantifying Neurons’ Global Linear Controllability

ACL 2025long

While feed-forward neurons in pre-trained language models (PLMs) can encode knowledge, past research targeted a small subset of neurons that heavily influence outputs.This leaves the broader role of neuron activations unclear, limiting progress in areas like knowledge editing.We uncover a global lin…

Cited by 0SourcePDFScholar
2024

What Matters in Memorizing and Recalling Facts? Multifaceted Benchmarks for Knowledge Probing in Language Models

EMNLP 2024finding

Language models often struggle with handling factual knowledge, exhibiting factual hallucination issue. This makes it vital to evaluate the models’ ability to recall its parametric knowledge about facts. In this study, we introduce a knowledge probing benchmark, BELIEF(ICL), to evaluate the knowledg…

Cited by 2SourcePDFScholar
2023

A Unified Generative Approach to Product Attribute-Value Identification

ACL 2023findings

Product attribute-value identification (PAVI) has been studied to link products on e-commerce sites with their attribute values (e.g., ⟨Material, Cotton⟩) using product text as clues. Technical demands from real-world e-commerce platforms require PAVI methods to handle unseen values, multi-attribute…

Cited by 12SourcePDFScholar
2022

Entity Embedding Completion for Wide-Coverage Entity Disambiguation

EMNLP 2022finding

Entity disambiguation (ED) is typically solved by learning to classify a given mention into one of the entities in the model’s entity vocabulary by referring to their embeddings. However, this approach cannot address mentions of entities that are not covered by the entity vocabulary. Aiming to enhan…

2022

Simple and Effective Knowledge-Driven Query Expansion for QA-Based Product Attribute Extraction

ACL 2022short

A key challenge in attribute value extraction (AVE) from e-commerce sites is how to handle a large number of attributes for diverse products. Although this challenge is partially addressed by a question answering (QA) approach which finds a value in product data for a given query (attribute), it doe…

2021

Context-aware Decoder for Neural Machine Translation using a Target-side Document-Level Language Model

NAACL 2021long

Although many end-to-end context-aware neural machine translation models have been proposed to incorporate inter-sentential contexts in translation, these models can be trained only in domains where parallel documents with sentential alignments exist. We therefore present a simple method to perform…

Cited by 15SourcePDFScholar
2021

Speculative Sampling in Variational Autoencoders for Dialogue Response Generation

EMNLP 2021finding

Variational autoencoders have been studied as a promising approach to model one-to-many mappings from context to response in chat response generation. However, they often fail to learn proper mappings. One of the reasons for this failure is the discrepancy between a response and a latent variable sa…