← Search

Xutao Wang

3 accepted papers

2024

DiJiang: Efficient Large Language Models through Compact Kernelization

ICML 2024oral

In an effort to reduce the computational load of Transformers, research on linear attention has gained significant momentum. However, the improvement strategies for attention mechanisms typically necessitate extensive retraining, which is impractical for large language models with a vast array of pa…

2024

Multiscale Positive-Unlabeled Detection of AI-Generated Texts

ICLR 2024spotlight

Recent releases of Large Language Models (LLMs), e.g. ChatGPT, are astonishing at generating human-like texts, but they may impact the authenticity of texts. Previous works proposed methods to detect these AI-generated texts, including simple ML classifiers, pretrained-model-based zero-shot methods,…

2023

PUe: Biased Positive-Unlabeled Learning Enhancement by Causal Inference

NeurIPS 2023poster

Positive-Unlabeled (PU) learning aims to achieve high-accuracy binary classification with limited labeled positive examples and numerous unlabeled ones. Existing cost-sensitive-based methods often rely on strong assumptions that examples with an observed positive label were selected entirely at r…