Back to Featured
LMSYS BlogRadixArk, Google and Meta2026-10-20 00:0028 days ago

RadixArk, Google, and Meta jointly open-source SGLang-TorchTPU, enabling SGLang to natively provide production-grade PyTorch inference on TPUs

SGLang-TorchTPU: PyTorch-Native Production Serving on TPUs

AI Briefing

RadixArk’s SGLang team has partnered with Google and Meta to open-source SGLang-TorchTPU. Built on Google’s TorchTPU, it enables the same SGLang engine to serve production workloads on both GPUs and TPUs.

Also reported by 2 other sources

Source: LMSYS Blog · lmsys.org

Event follow-up1

View all event coverage

Finished reading the news? Let’s talk about your business.

Leave your contact details, and I’ll get in touch with you personally.

WECHAT

Add me on WeChat

Press and hold or select the WeChat ID below to copy it.