Jingzhen Ding

Easy and Efficient Transformer: Scalable Inference Solution For Large NLP Model

Recently, large-scale transformer-based models have been proven to be effective over various tasks across many domains. Nevertheless, applying them in industrial production requires tedious and heavy works to reduce inference costs. To fill such a gap, we introduce a scalable inference solution: Eas…