Microsoft speeds up PyTorch with DeepSpeed
Source: infoworld.com Microsoft has released DeepSpeed, a new deep learning optimization library for PyTorch, that is designed to reduce memory use and train models with better parallelism on existing hardware. According to a Microsoft Research blog post announcing the new framework, DeepSpeed improves PyTorch model training through a memory optimization technology that increases the number of possible parameters Read More