Source: Microsoft’s Azure Machine Learning team recently open-sourced their contribution to the ONNX Runtime library for improving the performance of the natural language processing (NLP) model BERT. With the optimizations, the model’s inference latency on the SQUAD benchmark sped up 17x. Senior program manager Emma Ning gave an overview of the results in a Read More

Read More
Artificial Intelligence