Colton Chapin

An Architecture for Accelerated Large-Scale Inference of Transformer-Based Language Models

This work demonstrates the development process of a machine learning architecture for inference that can scale to a large volume of requests. We used a BERT model that was fine-tuned for emotion analysis, returning a probability distribution of emotions given a paragraph. The model was deployed as a…