What GPU do I need to run ibm-research/PowerLM-3b?

3.5B parameters, published in F32. View on Hugging Face

3.5B
Parameters
F32
Native precision
GraniteForCausalLM
Architecture
text-generation
Pipeline

PowerLM-3b is published by ibm-research on Hugging Face, with 200,564 downloads and 21 likes to date. It's a GraniteForCausalLM model built for text-generation, published natively in F32.

VRAM required & cheapest live GPU fit

Required VRAM = weight size at each precision, plus a fixed overhead for KV-cache, activations, and fragmentation. Full formula and assumptions: methodology.

Precision
Weight size
Required VRAM
Cheapest live fit
GPUs needed
Est. $/hr (full fit)
FP32
13.1 GB
15.7 GB
V100 (simplepod)
1
$0.060/hr
FP8 (quantized)
3.3 GB
3.9 GB
RTX 4070 Super (simplepod)
1
$0.090/hr
INT4 (quantized)
1.6 GB
2.0 GB
RTX 3070 (simplepod)
1
$0.050/hr

A GPU is only matched to a row if its hardware supports that precision, and the primary recommendation is always a single-GPU fit when one exists.

INT4 caveat: requires a quantized checkpoint actually published for this model — check its Hugging Face page before relying on this row.

Cheapest way to run PowerLM-3b at its published (F32) precision: 1× V100 on simplepod, at $0.060/hr per GPU ($0.060/hr total). Quantizing to FP8 or INT4 (rows above) can cost less, but requires a compatible quantized checkpoint to exist for this model.

Weight-to-VRAM math, the fit rules, and how live prices are normalized: full methodology.

More ibm-research models

Ready when you are

Stop paying for
idle GPUs.

Sign up in 60 seconds. Pay only for the GPU minutes you actually use.

© 2026 Aquanode. All rights reserved.

All trademarks, logos and brand names are the property of their respective owners.