← Search

Yiyuan Li

6 accepted papers

2024

Learning from Teaching Regularization: Generalizable Correlations Should be Easy to Imitate

NeurIPS 2024poster

Generalization remains a central challenge in machine learning. In this work, we propose *Learning from Teaching* (**LoT**), a novel regularization technique for deep neural networks to enhance generalization. Inspired by the human ability to capture concise and abstract patterns, we hypothesize tha…

2024

OlympicArena: Benchmarking Multi-discipline Cognitive Reasoning for Superintelligent AI

NeurIPS 2024poster

The evolution of Artificial Intelligence (AI) has been significantly accelerated by advancements in Large Language Models (LLMs) and Large Multimodal Models (LMMs), gradually showcasing potential cognitive reasoning abilities in problem-solving and scientific discovery (i.e., AI4Science) once exclus…

2023

Pragmatic Reasoning Unlocks Quantifier Semantics for Foundation Models

EMNLP 2023long main

Generalized quantifiers (e.g., $\textit{few}$, $\textit{most}$) are used to indicate the proportions predicates satisfy (for example, $\textit{some}$ apples are red). One way to interpret quantifier semantics is to explicitly bind these satisfactions with percentage scopes (e.g., 30%-40% of apples a…

Cited by 0SourcecodeScholar
2022

SPE: Symmetrical Prompt Enhancement for Fact Probing

EMNLP 2022main

Pretrained language models (PLMs) have been shown to accumulate factual knowledge during pretraining (Petroni et al. 2019). Recent works probe PLMs for the extent of this knowledge through prompts either in discrete or continuous forms. However, these methods do not consider symmetry of the task: ob…

Cited by 8SourcePDFScholar
2021

Adversarial Scrubbing of Demographic Information for Text Classification

EMNLP 2021main

Contextual representations learned by language models can often encode undesirable attributes, like demographic associations of the users, while being trained for an unrelated target task. We aim to scrub such undesirable attributes and learn fair representations while maintaining performance on the…