2025
Dataverse: Open-Source ETL (Extract, Transform, Load) Pipeline for Large Language Models
NAACL 2025system demonstrations
To address the challenges associated with data processing at scale, we propose Dataverse, a unified open-source Extract-Transform-Load (ETL) pipeline for large language models (LLMs) with a user-friendly design at its core. Easy addition of custom processors with block-based interface in Dataverse a…