2024
JORA: JAX Tensor-Parallel LoRA Library for Retrieval Augmented Fine-Tuning
ACL 2024system demonstrations
The scaling of Large Language Models (LLMs) for retrieval-based tasks, particularly in Retrieval Augmented Generation (RAG), faces significant memory constraints, especially when fine-tuning extensive prompt sequences. Current open-source libraries support full-model inference and fine-tuning across…