Microsoft Open-Sources ONNX Acceleration for BERT AI Model
Source: infoq.com Microsoft’s Azure Machine Learning team recently open-sourced their contribution to the ONNX Runtime library for improving the performance of the natural language processing (NLP) model BERT. With the optimizations, the model’s inference latency on the SQUAD benchmark sped up 17x. Senior program manager Emma Ning gave an overview of the results in a Read More