What GPU do I need to run zai-org/GLM-4.7-FP8?

358.5B parameters, published in F8_E4M3. View on Hugging Face

358.5B
Parameters
F8_E4M3
Native precision
Glm4MoeForCausalLM
Architecture
text-generation
Pipeline

GLM-4.7-FP8 is published by zai-org on Hugging Face, with 20,743 downloads and 125 likes to date. It's a Glm4MoeForCausalLM model built for text-generation, published natively in F8_E4M3.

VRAM required & cheapest live GPU fit

Required VRAM = weight size at each precision, plus a fixed overhead for KV-cache, activations, and fragmentation. Full formula and assumptions: methodology.

Precision
Weight size
Required VRAM
Cheapest live fit
GPUs needed
Est. $/hr (full fit)
FP8 (native)
333.8 GB
400.6 GB
RTX PRO 6000 (runpod)
5
$8.20/hr
INT4 (quantized)
166.9 GB
200.3 GB
A40 (runpod)
5
$2.20/hr

A GPU is only matched to a row if its hardware supports that precision, and the primary recommendation is always a single-GPU fit when one exists.

INT4 caveat: requires a quantized checkpoint actually published for this model, check its Hugging Face page before relying on this row.

Cheapest way to run GLM-4.7-FP8 at its published (F8_E4M3) precision: 5× RTX PRO 6000 on runpod, at $1.64/hr per GPU ($8.20/hr total). Quantizing to FP8 or INT4 (rows above) can cost less, but requires a compatible quantized checkpoint to exist for this model.

Weight-to-VRAM math, the fit rules, and how live prices are normalized: full methodology.

More zai-org models

Ready when you are

Your next GPU already
has your environment on it.

Sign up in 60 seconds. Pay for the GPU minutes you actually use.

© 2026 Aquanode. All rights reserved.

All trademarks, logos and brand names are the property of their respective owners.