AceGPT, Localizing Large Language Models in Arabic
Huang Huang, Fei Yu, Jianqing Zhu, Xuening Sun, Hao Cheng, Song Dingjie, Zhihong Chen, Mosen Alharthi
Abstract
This paper is devoted to the development of a localized Large Language Model (LLM) specifically for Arabic, a language imbued with unique cultural characteristics inadequately addressed by current mainstream models. Significant concerns emerge when addressing cultural sensitivity and local values. To address this, the paper proposes a comprehensive solution that includes further pre-training with Arabic texts, Supervised Fine-Tuning (SFT) utilizing native Arabic instructions, and GPT-4 responses in Arabic, alongside Reinforcement Learning with AI Feedback (RLAIF) employing a reward model attuned to local culture and values. The goal is to cultivate culturally cognizant and value-aligned Arabic LLMs capable of accommodating the diverse, application-specific needs of Arabic-speaking communities. Comprehensive evaluations reveal that the resulting model, dubbed ‘AceGPT’, sets the state-of-the-art standard for open Arabic LLMs across various benchmarks. Codes, data, and models are in https://github.com/FreedomIntelligence/AceGPT.
BibTeX
@inproceedings{huang-etal-2024-acegpt,
title = "{A}ce{GPT}, Localizing Large Language Models in {A}rabic",
author = "Huang, Huang and
Yu, Fei and
Zhu, Jianqing and
Sun, Xuening and
Cheng, Hao and
Dingjie, Song and
Chen, Zhihong and
Alharthi, Mosen and
An, Bang and
He, Juncai and
Liu, Ziche and
Chen, Junying and
Li, Jianquan and
Wang, Benyou and
Zhang, Lian and
Sun, Ruoyu and
Wan, Xiang and
Li, Haizhou and
Xu, Jinchao",
editor = "Duh, Kevin and
Gomez, Helena and
Bethard, Steven",
booktitle = "Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers)",
month = jun,
year = "2024",
address = "Mexico City, Mexico",
publisher = "Association for Computational Linguistics",
url = "https://aclanthology.org/2024.naacl-long.450/",
doi = "10.18653/v1/2024.naacl-long.450",
pages = "8139--8163"
}