← Search

Jingyuan Huang

7 accepted papers

2025

AI Sees Your Location—But With A Bias Toward The Wealthy World

EMNLP 2025

Visual-Language Models (VLMs) have shown remarkable performance across various tasks, particularly in recognizing geographic information from images. However, VLMs still show regional biases in this task. To systematically evaluate these issues, we introduce a benchmark consisting of 1,200 images pa

2025

Agent Security Bench (ASB): Formalizing and Benchmarking Attacks and Defenses in LLM-based Agents

ICLR 2025poster

Although LLM-based agents, powered by Large Language Models (LLMs), can use external tools and memory mechanisms to solve complex real-world tasks, they may also introduce critical security vulnerabilities. However, the existing literature does not comprehensively evaluate attacks and defenses again…

2025

Asclepius: A Spectrum Evaluation Benchmark for Medical Multi-Modal Large Language Models

ACL 2025long

The significant breakthroughs of Medical Multi-Modal Large Language Models (Med-MLLMs) renovate modern healthcare with robust information synthesis and medical decision support. However, these models are often evaluated on benchmarks that are unsuitable for the Med-MLLMs due to the intricate nature…

2025

Exploring Concept Depth: How Large Language Models Acquire Knowledge and Concept at Different Layers?

COLING 2025main

Large language models (LLMs) have shown remarkable performances across a wide range of tasks. However, the mechanisms by which these models encode tasks of varying complexities remain poorly understood. In this paper, we explore the hypothesis that LLMs process concepts of varying complexities in di…

2025

GCML: Gradient Coherence Guided Meta-Learning for Cross-Domain Emerging Topic Rumor Detection

EMNLP 2025

With the emergence of new topics on social media as sources of rumor propagation, addressing the domain shift between the source and target domain and the target domain samples scarcity remains a crucial task in cross-domain rumor detection. Traditional deep learning-based methods and LLM-based meth

Cited by 0SourcePDFScholar
2025

LLM-based Rumor Detection via Influence Guided Sample Selection and Game-based Perspective Analysis

ACL 2025long

Rumor detection on social media has become an emerging topic. Traditional deep learning-based methods model rumors based on content, propagation structure, or user behavior, but these approaches are constrained by limited modeling capacity and insufficient training corpora. Recent studies have explo…

Cited by 0SourcePDFScholar
2024

Not All Countries Celebrate Thanksgiving: On the Cultural Dominance in Large Language Models

ACL 2024long

This paper identifies a cultural dominance issue within large language models (LLMs) due to the predominant use of English data in model training (e.g., ChatGPT). LLMs often provide inappropriate English-culture-related answers that are not relevant to the expected culture when users ask in non-Engl…

Cited by 62SourcePDFScholar