Back to Featured
Hugging Face Community BlogMarc Sun2026-09-22 08:00September 22

transformers Supports Direct Loading of GGUF Quantized Models, with Local Inference Performance Near That of llama.cpp

Transformers now runs llama.cpp quants

AI Briefing

Hugging Face announced that transformers can now run GGUF quantized models directly. Pass gguf_file to from_pretrained to load GGUF checkpoints from the Hub and reuse ggml’s Metal kernels.

Source: Hugging Face Community Blog · huggingface.co

Event follow-up1

View all event coverage

Finished reading the news? Let’s talk about your business.

Leave your contact details, and I’ll get in touch with you personally.

WECHAT

Add me on WeChat

Press and hold or select the WeChat ID below to copy it.