← Search

Jianfei Ma

5 accepted papers

2026

What You Think is What You See: Driving Exploration in VLM Agents via Visual-Linguistic Curiosity

ICML 2026spotlight

To navigate partially observable visual environments, recent VLM agents increasingly internalize world modeling capabilities directly into their policies via explicit CoT reasoning with reinforcement learning (RL). However, mere passive exploitation of reasoning on visited states is insufficient for…

Cited by 0SourceScholar
2025

Learning to Look at the Other Side: A Semantic Probing Study of Word Embeddings in LLMs with Enabled Bidirectional Attention

ACL 2025long

Autoregressive Large Language Models (LLMs) demonstrate exceptional performance in language understanding and generation. However, their application in text embedding tasks has been relatively slow, along with the analysis of their semantic representation in probing tasks, due to the constraints of…

Cited by 0SourcePDFScholar
2025

PhonoThink: Improving Large Language Models’ Reasoning on Chinese Phonological Ambiguities

EMNLP 2025

Effectively resolving phonological ambiguities is crucial for robust natural language processing, as these ambiguities are pervasive in tasks ranging from speech-to-text, spelling correction, to offensive language detection. However, current Large Language Models (LLMs) frequently struggle to resolv

Cited by 0SourcePDFScholar
2024

Discerning Temporal Difference Learning

AAAI 2024technical

Temporal difference learning (TD) is a foundational concept in reinforcement learning (RL), aimed at efficiently assessing a policy's value function. TD(λ), a potent variant, incorporates a memory trace to distribute the prediction error into the historical context. However, this approach often negl…

Cited by 0SourcePDFScholar