PyTorch 2.5 Released With Improved Intel GPU Support

PyTorch 2.5 is out today as the latest major update to this widely-used machine learning library.

PyTorch 2.5 improves its Intel GPU support for both client and data center graphics products. PyTorch 2.5 now has initial support for Intel client GPUs on Windows but also enhances the existing PyTorch Intel Linux graphics support too. Some of the highlights include:

- Expanded PyTorch hardware backend support matrix to include both Intel Data Center and Client GPUs.  

- The implementation of SYCL kernels to enhance coverage and execution of Aten operators on Intel GPUs to boost performance in PyTorch eager mode.

- Enhanced Intel GPU backend of torch.compile to improve inference and training performance for a wide range of deep learning workloads.

PyTorch 2.5 also brings various Intel Xeon CPU performance optimizations too.

Some of the other PyTorch 2.5 changes include a NVIDIA cuDNN back-end for SDPA with H100 and newer GPUs, CPU back-end optimizations for TorchInductor, FP16 support on the CPU path for both eager mode and the TorchInductor CPP backend, autoload device extension support, and a variety of other enhancements.

Downloads and more details on the PyTorch 2.5 release via GitHub. New PyTorch benchmarks soon.