← Search

Zheyuan Bai

3 accepted papers

2025

MoRAgent: Parameter Efficient Agent Tuning with Mixture-of-Roles

ICML 2025poster

Despite recent advancements of fine-tuning large language models (LLMs) to facilitate agent tasks, parameter-efficient fine-tuning (PEFT) methodologies for agent remain largely unexplored. In this paper, we introduce three key strategies for PEFT in agent tasks: 1) Inspired by the increasingly domin…

2024

Multiscale Positive-Unlabeled Detection of AI-Generated Texts

ICLR 2024spotlight

Recent releases of Large Language Models (LLMs), e.g. ChatGPT, are astonishing at generating human-like texts, but they may impact the authenticity of texts. Previous works proposed methods to detect these AI-generated texts, including simple ML classifiers, pretrained-model-based zero-shot methods,…

2024

Rethinking Optimization and Architecture for Tiny Language Models

ICML 2024poster

The power of large language models (LLMs) has been demonstrated through numerous data and computing resources. However, the application of language models on mobile devices is facing huge challenge on the computation and memory costs, that is, tiny language models with high performance are urgently…