← Search

Tao Zhong

18 accepted papers

2026

CMMCoT: Enhancing Complex Multi-Image Comprehension via Multi-Modal Chain-of-Thought and Memory Augmentation

AAAI 2026technical

While previous multimodal slow-thinking methods have demonstrated remarkable success in single-image understanding scenarios, their effectiveness becomes fundamentally constrained when extended to more complex multi-image comprehension tasks. This limitation stems from their predominant reliance on

Cited by 0SourcePDFScholar
2026

Constraint Matters: Multi-Modal Representation for Reducing Mixed-Integer Linear programming

ICLR 2026poster

Model reduction, which aims to learn a simpler model of the original mixed integer linear programming (MILP), can solve large-scale MILP problems much faster. Most existing model reduction methods are based on variable reduction, which predicts a solution value for a subset of variables. From a dual…

Cited by 0SourcecodeScholar
2026

From Intent to Solver Code: Semantic Alignment in Optimization Modeling

ICML 2026poster

Large language models (LLMs) have opened new paradigms in optimization modeling by enabling the generation of executable solver code from natural language descriptions. Despite this promise, existing approaches typically remain solver-driven: they rely on single-pass forward generation and apply lim…

Cited by 0SourceScholar
2026

Opt-Verifier: Unleashing the Power of LLMs for Optimization Modeling via Dual-Side Verification

ICML 2026poster

Building mathematical optimization models is critical in operations research (OR), while it requires substantial human expertise. Recent advancements have utilized large language models (LLMs) to automate this modeling process. However, existing works often struggle to verify the correctness of the …

Cited by 0SourceScholar
2026

Topology-Preserving Neural Operator Learning via Hodge Decomposition

ICML 2026poster

In this paper, we study solution operators of physical field equations on geometric meshes from a function-space perspective. We reveal that Hodge orthogonality fundamentally resolves spectral interference by isolating unlearnable topological degrees of freedom from learnable geometric dynamics, ena…

Cited by 0SourceScholar
2025

A Survey of Optimization Modeling Meets LLMs: Progress and Future Directions

IJCAI 2025

By virtue of its great utility in solving real-world problems, optimization modeling has been widely employed for optimal decision-making across various sectors, but it requires substantial expertise from operations research professionals. With the advent of large language models (LLMs), new opportu

Cited by 0SourcePDFScholar
2025

BPP-Search: Enhancing Tree of Thought Reasoning for Mathematical Modeling Problem Solving

ACL 2025long

LLMs exhibit advanced reasoning capabilities, offering the potential to transform natural language questions into mathematical models. However, existing open-source datasets in operations research domain lack detailed annotations of the modeling process, such as variable definitions, focusing solely…

2025

Decision Information Meets Large Language Models: The Future of Explainable Operations Research

ICLR 2025poster

Operations Research (OR) is vital for decision-making in many industries. While recent OR methods have seen significant improvements in automation and efficiency through integrating Large Language Models (LLMs), they still struggle to produce meaningful explanations. This lack of clarity raises conc…

2025

Fast and Interpretable Mixed-Integer Linear Program Solving by Learning Model Reduction

AAAI 2025technical

By exploiting the correlation between the structure and the solution of Mixed-Integer Linear Programming (MILP), Machine Learning (ML) has become a promising method for solving large-scale MILP problems. Existing ML-based MILP solvers mainly focus on end-to-end solution learning, which suffers from…

Cited by 2SourcePDFScholar
2025

Grasp2Grasp: Vision-Based Dexterous Grasp Translation via Schrödinger Bridges

NeurIPS 2025poster

We propose a new approach to vision-based dexterous grasp translation, which aims to transfer grasp intent across robotic hands with differing morphologies. Given a visual observation of a source hand grasping an object, our goal is to synthesize a functionally equivalent grasp for a target hand wit…

Cited by 0SourcecodeScholar
2025

LoRE-Merging: Exploring Low-Rank Estimation For Large Language Model Merging

EMNLP 2025

While most current approaches rely on further training techniques, such as fine-tuning or reinforcement learning, to enhance model capacities, model merging stands out for its ability of improving models without requiring any additional training. In this paper, we propose a unified framework for mod

Cited by 0SourcePDFScholar
2024

Adapting to Distribution Shift by Visual Domain Prompt Generation

ICLR 2024poster

In this paper, we aim to adapt a model at test-time using a few unlabeled data to address distribution shifts. To tackle the challenges of extracting domain knowledge from a limited amount of data, it is crucial to utilize correlated information from pre-trained backbones and source domains. Previo…

2024

Chain-of-Experts: When LLMs Meet Complex Operations Research Problems

ICLR 2024poster

Large language models (LLMs) have emerged as powerful techniques for various NLP tasks, such as mathematical reasoning and plan generation. In this paper, we study automatic modeling and programming for complex operation research (OR) problems, so as to alleviate the heavy dependence on domain exper…

Cited by 50SourcePDFScholar
2024

Enhancing LLM Reasoning via Vision-Augmented Prompting

NeurIPS 2024spotlight

Verbal and visual-spatial information processing are two critical subsystems that activate different brain regions and often collaborate together for cognitive reasoning. Despite the rapid advancement of LLM-based reasoning, the mainstream frameworks, such as Chain-of-Thought (CoT) and its variants,…

Cited by 1SourcePDFScholar
2023

Fast-Grasp'D: Dexterous Multi-finger Grasp Generation Through Differentiable Simulation

ICRA 2023poster

Multi-finger grasping relies on high quality training data, which is hard to obtain: human data is hard to transfer and synthetic data relies on simplifying assumptions that reduce grasp quality. By making grasp simulation differentiable, and contact dynamics amenable to gradient-based optimization,…

Cited by 33SourcecodeScholar
2022

Meta-DMoE: Adapting to Domain Shift by Meta-Distillation from Mixture-of-Experts

NeurIPS 2022accept

In this paper, we tackle the problem of domain shift. Most existing methods perform training on multiple source domains using a single model, and the same trained model is used on all unseen target domains. Such solutions are sub-optimal as each target domain exhibits its own specialty, which is not…