Qinyu Zhao*

The First to Know: How Token Distributions Reveal Hidden Knowledge in Large Vision-Language Models?

"Large vision-language models (LVLMs), designed to interpret and respond to human instructions, occasionally generate hallucinated or harmful content due to inappropriate instructions. This study uses linear probing to shed light on the hidden knowledge at the output layers of LVLMs. We demonstrate…