2024
MOSEL: Inference Serving Using Dynamic Modality Selection
EMNLP 2024main
Rapid advancements over the years have helped machine learning models reach previously hard-to-achieve goals, sometimes even exceeding human capabilities. However, achieving desired accuracy comes at the cost of larger model sizes and increased computational demands. Thus, serving predictions from t…