Back to Featured
vLLM Official BlogInferact and Google Teams2026-10-20 08:0028 days ago

vLLM releases a TorchTPU backend, enabling vLLM to run on Google Cloud TPUs

Introducing vLLM TorchTPU

AI Briefing

The vLLM team, Inferact, and Google jointly released vLLM TorchTPU (vllm-torchtpu), a new backend plugin for running vLLM on Google Cloud TPU. It reuses vLLM’s existing model code, allowing most existing models to be deployed without modifying their model definitions.

Also reported by 2 other sources

Source: vLLM official blog · vllm.ai

Event follow-up1

View all event coverage

Finished reading the news? Let’s talk about your business.

Leave your contact details, and I’ll get in touch with you personally.

WECHAT

Add me on WeChat

Press and hold or select the WeChat ID below to copy it.