← Search

Ziyao Wang

11 accepted papers

2026

InfoGeo: Information-Theoretic Object-Centric Learning for Cross-View Generalizable UAV Geo-Localization

ICML 2026poster

Cross-view geo-localization (CVGL) is fundamental for precise navigation in GPS-denied environments, aiming to match ground or UAV imagery with satellite views. While existing approaches rely on global feature alignment, they often suffer from substantial domain shifts induced by varying regional te…

Cited by 0SourceScholar
2026

Position: Invisible Tokens, Visible Bills: The Urgent Need to Audit Hidden Operations in Opaque LLM Services

ICML 2026poster

Modern large language model (LLM) services increasingly rely on complex, often abstract operations, such as multi-step reasoning and multi-agent collaboration, to generate high-quality outputs. While users are billed based on token consumption and API usage, these internal steps are typically not vi…

Cited by 0SourceScholar
2026

UniCompress: Token Compression for Unified Vision-Language Understanding and Generation

CVPR 2026

Unified models aim to support both understanding and generation by encoding images into discrete tokens and processing them alongside text within a single autoregressive framework. This unified design offers architectural simplicity and cross-modal synergy, which facilitates shared parameterization,

Cited by 0SourceScholar
2025

Speculate, then Collaborate: Fusing Knowledge of Language Models during Decoding

ICML 2025poster

Large Language Models (LLMs) often excel in specific domains but fall short in others due to the limitations of their training. Thus, enabling LLMs to solve problems collaboratively by integrating their complementary knowledge promises to improve their performance across domains. To realize this pot…

2025

SymRTLO: Enhancing RTL Code Optimization with LLMs and Neuron-Inspired Symbolic Reasoning

NeurIPS 2025poster

Optimizing Register Transfer Level (RTL) code is crucial for improving the efficiency and performance of digital circuits in the early stages of synthesis. Manual rewriting, guided by synthesis feedback, can yield high-quality results but is time-consuming and error-prone. Most existing compiler-bas…

Cited by 0SourceScholar
2025

Towards counterfactual fairness through auxiliary variables

ICLR 2025poster

The challenge of balancing fairness and predictive accuracy in machine learning models, especially when sensitive attributes such as race, gender, or age are considered, has motivated substantial research in recent years. Counterfactual fairness ensures that predictions remain consistent across coun…

2024

FLoRA: Federated Fine-Tuning Large Language Models with Heterogeneous Low-Rank Adaptations

NeurIPS 2024poster

The rapid development of Large Language Models (LLMs) has been pivotal in advancing AI, with pre-trained LLMs being adaptable to diverse downstream tasks through fine-tuning. Federated learning (FL) further enhances fine-tuning in a privacy-aware manner by utilizing clients' local data through in-si…

2024

FedHyper: A Universal and Robust Learning Rate Scheduler for Federated Learning with Hypergradient Descent

ICLR 2024poster

The theoretical landscape of federated learning (FL) undergoes rapid evolution, but its practical application encounters a series of intricate challenges, and hyperparameter optimization is one of these critical challenges. Amongst the diverse adjustments in hyperparameters, the adaptation of the le…

Cited by 5SourcePDFScholar
2024

SHED: Shapley-Based Automated Dataset Refinement for Instruction Fine-Tuning

NeurIPS 2024poster

The pre-trained Large Language Models (LLMs) can be adapted for many downstream tasks and tailored to align with human preferences through fine-tuning. Recent studies have discovered that LLMs can achieve desirable performance with only a small amount of high-quality data, suggesting that a large po…

2023

UPTON: Preventing Authorship Leakage from Public Text Release via Data Poisoning

EMNLP 2023long findings

Consider a scenario where an author (e.g., activist, whistle-blower) with many public writings wishes to write “anonymously" when attackers may have already built an authorship attribution (AA) model based off of public writings including those of the author. To enable her wish, we ask a question “c…

Cited by 0SourceScholar
2022

An MRC Framework for Semantic Role Labeling

COLING 2022main

Semantic Role Labeling (SRL) aims at recognizing the predicate-argument structure of a sentence and can be decomposed into two subtasks: predicate disambiguation and argument labeling. Prior work deals with these two tasks independently, which ignores the semantic connection between the two tasks. I…