What GPU do I need to run swiss-ai/Apertus-70B-Instruct-2509?

70.6B parameters, published in BF16. View on Hugging Face

70.6B
Parameters
BF16
Native precision
ApertusForCausalLM
Architecture
text-generation
Pipeline

Apertus-70B-Instruct-2509 is published by swiss-ai on Hugging Face, with 29,139 downloads and 194 likes to date. It's a ApertusForCausalLM model built for text-generation, published natively in BF16.

VRAM required & cheapest live GPU fit

Required VRAM = weight size at each precision, plus a fixed overhead for KV-cache, activations, and fragmentation. Full formula and assumptions: methodology.

Precision
Weight size
Required VRAM
Cheapest live fit
GPUs needed
Est. $/hr (full fit)
BF16
131.5 GB
157.8 GB
RTX 3090 (simplepod)
7
$1.12/hr
FP8 (quantized)
65.8 GB
78.9 GB
RTX PRO 6000 (runpod)
1
$1.64/hr
cheaper alt.
RTX 5060 Ti (simplepod)
5
$0.500/hr
INT4 (quantized)
32.9 GB
39.5 GB
A40 (runpod)
1
$0.440/hr
cheaper alt.
RTX 3070 (simplepod)
5
$0.250/hr

A GPU is only matched to a row if its hardware supports that precision, and the primary recommendation is always a single-GPU fit when one exists.

INT4 caveat: requires a quantized checkpoint actually published for this model, check its Hugging Face page before relying on this row.

Cheapest way to run Apertus-70B-Instruct-2509 at its published (BF16) precision: 7× RTX 3090 on simplepod, at $0.160/hr per GPU ($1.12/hr total). Quantizing to FP8 or INT4 (rows above) can cost less, but requires a compatible quantized checkpoint to exist for this model.

Weight-to-VRAM math, the fit rules, and how live prices are normalized: full methodology.

More swiss-ai models

Ready when you are

Your next GPU already
has your environment on it.

Sign up in 60 seconds. Pay for the GPU minutes you actually use.

© 2026 Aquanode. All rights reserved.

All trademarks, logos and brand names are the property of their respective owners.