← Search

Xingyao Zhang

6 accepted papers

2026

Reasoning Palette: Modulating Reasoning via Latent Contextualization for Controllable Exploration for (V)LMs

CVPR 2026

Exploration capacity shapes both inference-time performance and reinforcement learning (RL) training for large (vision-) language models, as stochastic sampling often yields redundant reasoning paths with little high-level diversity. This paper proposes Reasoning Palette, a novel latent-modulation f

Cited by 0SourceScholar
2024

Grounding Language Models for Visual Entity Recognition

ECCV 2024poster

"We introduce , an Autoregressive model for Visual Entity Recognition. Our model extends an autoregressive Multimodal Large Language Model by employing retrieval augmented constrained generation. It mitigates low performance on out-of-domain entities while excelling in queries that require visual re…

2024

MedAgents: Large Language Models as Collaborators for Zero-shot Medical Reasoning

ACL 2024findings

Large language models (LLMs), despite their remarkable progress across various general domains, encounter significant barriers in medicine and healthcare. This field faces unique challenges such as domain-specific terminologies and reasoning over specialized knowledge. To address these issues, we pr…

2023

Coherent Entity Disambiguation via Modeling Topic and Categorical Dependency

EMNLP 2023long findings

Previous entity disambiguation (ED) methods adopt a discriminative paradigm, where prediction is made based on matching scores between mention context and candidate entities using length-limited encoders. However, these methods often struggle to capture explicit discourse-level dependencies, result…

Cited by 0SourceScholar
2023

Instructed Language Models with Retrievers Are Powerful Entity Linkers

EMNLP 2023long main

Generative approaches powered by large language models (LLMs) have demonstrated emergent abilities in tasks that require complex reasoning abilities. Yet the generative nature still makes the generated content suffer from hallucinations, thus unsuitable for entity-centric tasks like entity linking (…

Cited by 0SourcecodeScholar
2020

A Graph Representation of Semi-structured Data for Web Question Answering

COLING 2020main

The abundant semi-structured data on the Web, such as HTML-based tables and lists, provide commercial search engines a rich information source for question answering (QA). Different from plain text passages in Web documents, Web tables and lists have inherent structures, which carry semantic correla…

Cited by 15SourcePDFScholar