← Search

Zhengyuan Shen

8 accepted papers

2025

A Systematic Survey of Automatic Prompt Optimization Techniques

EMNLP 2025

Since the advent of large language models (LLMs), prompt engineering has been a crucial step for eliciting desired responses for various Natural Language Processing (NLP) tasks. However, prompt engineering remains an impediment for end users due to rapid advances in models, tasks, and associated bes

Cited by 0SourcePDFScholar
2025

DiscoverGPT: Multi-task Fine-tuning Large Language Model for Related Table Discovery

NAACL 2025findings

Natural language understanding over tabular data has played a significant role in data discovery tasks such as joinable and unionable table search. State-of-the-art approaches adopt large language models (LLMs) pre-trained over massive text corpora to learn and evaluate the table semantic relatednes…

Cited by 0SourcePDFScholar
2025

Pushing the Limits of All-Atom Geometric Graph Neural Networks: Pre-Training, Scaling, and Zero-Shot Transfer

ICLR 2025poster

The ability to construct transferable descriptors for molecular and biological systems has broad applications in drug discovery, molecular dynamics, and protein analysis. Geometric graph neural networks (Geom-GNNs) utilizing all-atom information have revolutionized atomistic simulations by enabling…

Cited by 3SourcePDFScholar
2024

CoverICL: Selective Annotation for In-Context Learning via Active Graph Coverage

EMNLP 2024main

In-context learning (ICL) adapts Large Language Models (LLMs) to new tasks, without requiring any parameter updates, but few annotated examples as input. In this work, we investigate selective annotation for ICL, where there is a limited budget for annotating examples, similar to low-budget active l…

Cited by 1SourcePDFScholar
2024

Mixed-Type Tabular Data Synthesis with Score-based Diffusion in Latent Space

ICLR 2024oral

Recent advances in tabular data generation have greatly enhanced synthetic data quality. However, extending diffusion models to tabular data is challenging due to the intricately varied distributions and a blend of data types of tabular data. This paper introduces TabSyn, a methodology that synthesi…

2024

OpenTab: Advancing Large Language Models as Open-domain Table Reasoners

ICLR 2024poster

Large Language Models (LLMs) trained on large volumes of data excel at various natural language tasks, but they cannot handle tasks requiring knowledge that has not been trained on previously. One solution is to use a retriever that fetches relevant information to expand LLM's knowledge scope. Howev…

2023

Automatic Table Union Search with Tabular Representation Learning

ACL 2023findings

Given a data lake of tabular data as well as a query table, how can we retrieve all the tables in the data lake that can be unioned with the query table? Table union search constitutes an essential task in data discovery and preparation as it enables data scientists to navigate massive open data rep…

Cited by 20SourcePDFScholar
2023

NameGuess: Column Name Expansion for Tabular Data

EMNLP 2023long main

Recent advances in large language models have revolutionized many sectors, including the database industry. One common challenge when dealing with large volumes of tabular data is the pervasive use of abbreviated column names, which can negatively impact performance on various data search, access, a…

Cited by 0SourcecodeScholar