TorchTPU: Running PyTorch Natively on TPUs at Google Scale

Source: Google Developers Blog

Overview

TorchTPU is a new engineering stack designed to provide a native, high‑performance experience for running PyTorch workloads on Google’s TPU infrastructure with minimal code changes.

Execution Model

It features an “Eager First” approach with multiple execution modes and utilizes the XLA compiler to optimize distributed training across massive clusters.

Future Roadmap

Moving into 2026, the project aims to further reduce compilation overhead and expand support for dynamic shapes and custom kernels to ensure seamless scalability for the next generation of AI.