What GPU do I need to run dealignai/GLM-5.3-Flash-ABLITERATED-FP8?

321.3B parameters, published in F8_E4M3. View on Hugging Face

Set up GLM-5.3-Fla…-ABLITERATED-FP8
321.3B
Parameters
F8_E4M3
Native precision
Glm5NextForConditionalGeneration
Architecture
text-generation
Pipeline

GLM-5.3-Flash-ABLITERATED-FP8 is published by dealignai on Hugging Face, with 676 downloads and 15 likes to date. It's a Glm5NextForConditionalGeneration model built for text-generation, published natively in F8_E4M3.

VRAM required & cheapest live GPU fit

Required VRAM = weight size at each precision, plus a fixed overhead for KV-cache, activations, and fragmentation. Full formula and assumptions: methodology.

Precision
Weight size
Required VRAM
Cheapest live fit
GPUs needed
Est. $/hr (full fit)
FP8 (native)
299.3 GB
359.1 GB
L40 (runpod)
8
$5.52/hr
INT4 (quantized)
149.6 GB
179.6 GB
RTX 3090 (simplepod)
8
$1.28/hr

A GPU is only matched to a row if its hardware supports that precision, and the primary recommendation is always a single-GPU fit when one exists.

INT4 requires a quantized checkpoint actually published for this model, check its Hugging Face page before relying on this row.

Cheapest way to run GLM-5.3-Flash-ABLITERATED-FP8 at its published (F8_E4M3) precision: 8× L40 on runpod, at $0.690/hr per GPU ($5.52/hr total). Quantizing to FP8 or INT4 (rows above) can cost less, but requires a compatible quantized checkpoint to exist for this model.

Weight-to-VRAM math, the fit rules, and how live prices are normalized: full methodology.

More dealignai models

Ready when you are

Your next GPU already
has your environment on it.

Sign up in 60 seconds. Pay for the GPU minutes you actually use.

© 2026 Aquanode. All rights reserved.

All trademarks, logos and brand names are the property of their respective owners.