AI models that fit on a 24 GB GPU

Open models that fit in 24 GB of VRAM: 263 as published, 53 at FP8 and 123 at INT4. Each model is listed on the smallest tier it fits at that precision, so anything smaller is on the 16 GB page or below.

GPUs with 24 GB

Cards whose datasheet VRAM puts them in this tier, up to the next tier at 32 GB. Prices are the lowest live data-center on-demand rate per GPU.

GPUVRAMFrom per GPU hour
L424 GB$0.490/hr
RTX 309024 GB$0.550/hr
RTX 409024 GB$0.869/hr
RTX A500024 GB$0.297/hr

Fits as published

Models whose published weights, plus the flat overhead, fit this much memory with no quantization.

Text models

The 40 most downloaded of 189.

ModelParametersPublished asVRAM needed
Qwen3-8B8.2BBF1618.3 GB
Qwen2.5-7B-Instruct7.6BBF1617.0 GB
Llama-3.1-8B-Instruct8.0BBF1617.9 GB
Qwen2.5-Coder-7B-Instruct7.6BBF1617.0 GB
Meta-Llama-3-8B-Instruct8.0BBF1617.9 GB
Mistral-7B-Instruct-v0.27.2BBF1616.2 GB
granite-4.1-8b8.8BBF1619.7 GB
DeepSeek-R1-0528-Qwen3-8B8.2BBF1618.3 GB
gemma-2-9b-it9.2BBF1620.7 GB
Meta-Llama-3-8B8.0BBF1617.9 GB
Apertus-8B-Instruct-25098.1BBF1618.0 GB
Qwen2.5-7B7.6BBF1617.0 GB
Llama-3.1-8B8.0BBF1617.9 GB
Qwen2.5-Coder-7B7.6BBF1617.0 GB
falcon-7b7.2BBF1616.1 GB
NVIDIA-Nemotron-Nano-9B-v28.9BBF1619.9 GB
Qwen3-8B-Base8.2BBF1618.3 GB
Qwen2-7B-Instruct7.6BBF1617.0 GB
saiga_llama3_8b8.0BBF1617.9 GB
Hermes-3-Llama-3.1-8B8.0BBF1617.9 GB
DeepSeek-R1-Distill-Llama-8B8.0BBF1617.9 GB
gemma4-e4b-claims-comparison7.9BBF1617.7 GB
DeepSeek-R1-Distill-Qwen-7B7.6BBF1617.0 GB
Meta-Llama-3.1-8B-Instruct8.0BBF1617.9 GB
Mistral-7B-v0.17.2BBF1616.2 GB
Meta-Llama-3.1-8B-Instruct8.0BBF1617.9 GB
Olmo-3-7B-Instruct7.3BBF1616.3 GB
Fanar-1-9B-Instruct8.8BBF1619.6 GB
LLaDA-8B-Instruct8.0BBF1617.9 GB
Qwen2-7B7.6BBF1617.0 GB
Ornith-1.5-9B9.7BBF1621.6 GB
Llama-3.1-Nemotron-Nano-8B-v18.0BBF1617.9 GB
granite-guardian-3.3-8b8.2BBF1618.3 GB
Llama-Guard-3-8B8.0BBF1617.9 GB
Qwen2.5-7B-Instruct-1M7.6BBF1617.0 GB
Mistral-7B-Instruct-v0.17.2BBF1616.2 GB
Nemotron-Labs-Diffusion-8B8.5BBF1619.0 GB
Llama-3-Taiwan-8B-Instruct8.0BBF1617.9 GB
granite-3.0-8b-instruct8.2BBF1618.3 GB
DeepSeek-Coder-V2-Lite-Instruct-FP815.7BF8_E4M317.6 GB

Vision-language models

The 40 most downloaded of 42.

ModelParametersPublished asVRAM needed
Qwen3.5-9B9.7BBF1621.6 GB
Qwen3-VL-8B-Instruct8.8BBF1619.6 GB
Qwen2.5-VL-7B-Instruct8.3BBF1618.5 GB
Qwen3.6-27B-NVFP421.2BF8_E4M323.7 GB
Qwen2-VL-7B-Instruct8.3BBF1618.5 GB
Qwen3.5-9B-AWQ9.7BBF1621.6 GB
llava-v1.6-mistral-7b-hf7.6BF1616.9 GB
Cosmos-Reason2-8B8.8BBF1619.6 GB
gemma-4-E4B-it-unsloth-bnb-4bit8.0BBF1617.9 GB
blip2-opt-2.7b3.7BF3216.7 GB
Qwen3.5-9B-Base9.7BBF1621.6 GB
Ovis2.5-9B9.2BBF1620.5 GB
qwen3vl-resume-parser8.8BBF1619.6 GB
MiniCPM-V-4_58.7BBF1619.4 GB
ChatRex-7B7.3BBF1616.3 GB
Llama-3.1-Nemotron-Nano-VL-8B-V18.7BBF1619.5 GB
Qwen3.5-9B-Claude-4.6-HighIQ-INSTRUCT-HERETIC-UNCENSORED9.4BBF1621.0 GB
GLM-4.1V-9B-Thinking10.3BBF1623.0 GB
olmOCR-2-7B-10258.3BBF1618.5 GB
moondream3-preview9.3BBF1620.7 GB
lift9.7BBF1621.6 GB
blip2-flan-t5-xl3.9BF3217.6 GB
gemma-3n-E4B-it8.4BBF1618.7 GB
Llama-3.2-11B-Vision-Instruct10.7BBF1623.8 GB
Idefics3-8B-Llama38.5BBF1618.9 GB
Cosmos-Reason1-7B8.3BBF1618.5 GB
InternVL3-8B7.9BBF1617.8 GB
Molmo2-4B4.9BF3221.7 GB
GLM-4.6V-Flash10.3BBF1623.0 GB
Qwen3-VL-8B-Thinking8.8BBF1619.6 GB
XCurOS1.2-8B-VLBF16-Instruct8.8BBF1619.6 GB
llava-v1.6-mistral-7b7.6BBF1616.9 GB
gemma-3n-E4B-it-MLX-bf167.8BBF1617.5 GB
gemma-3n-E4B-it7.8BBF1617.5 GB
deepseek-vl-7b-chat7.3BF1616.4 GB
MiMo-V2.6-Distill-Qwen-9B9.4BBF1621.0 GB
Ovis1.6-Gemma2-9B10.2BBF1622.8 GB
llava-med-v1.5-mistral-7b7.6BBF1616.9 GB
ZDTaichu5.0-9B9.8BBF1621.9 GB
clef-flash9.4BBF1621.0 GB

Image generation models

6 models.

ModelParametersPublished asVRAM needed
stable-diffusion-3.5-large8.1BBF1618.2 GB
Chroma1-HD8.9BBF1619.9 GB
Chroma1-Base8.9BBF1619.9 GB
FIBO8.3BBF1618.5 GB
flux2-klein-9b-uncensored-text-encoder8.2BF1618.3 GB
Fibo-1.58.3BBF1618.5 GB

Video generation models

1 model.

ModelParametersPublished asVRAM needed
Wan2.2-TI2V-5B-Diffusers5.0BF3222.4 GB

Speech models

5 models.

ModelParametersPublished asVRAM needed
VibeVoice-ASR8.7BBF1619.4 GB
orpheus-3b-0.1-ft3.8BF3216.9 GB
granite-speech-3.2-8b8.5BBF1619.0 GB
granite-speech-3.3-8b8.6BBF1619.3 GB
higgs-audio-v3-8b-stt-v28.9BBF1619.9 GB

Embedding models

3 models.

ModelParametersPublished asVRAM needed
Qwen3-Embedding-8B7.6BBF1616.9 GB
Qwen3-VL-Embedding-8B8.1BBF1618.2 GB
WeMM-Embedding-9B9.4BBF1621.0 GB

Other models

17 models.

ModelParametersPublished asVRAM needed
gemma-4-E4B-it8.0BBF1617.9 GB
Qwen3.8-27B-NVFP419.9BF8_E4M322.2 GB
gemma-4-E4B-it-qat-w4a16-ct8.7BBF1619.5 GB
gemma-4-E4B8.0BBF1617.9 GB
gemma-4-E4B-it-uncensored-heretic8.0BBF1617.9 GB
NuMarkdown-8B-Thinking8.3BBF1618.5 GB
JEV-9B9.0BBF1620.0 GB
FLUX.2-klein-9B9.1BBF1620.3 GB
gemma-4-E4B-it-AWQ-INT48.2BF1618.3 GB
personaplex-7b-v18.4BBF1618.7 GB
Qwen3-Reranker-8B8.2BBF1618.3 GB
openvla-7b7.5BBF1616.9 GB
VibeVoice-ASR-HF8.3BBF1618.6 GB
LLaVA-Video-7B-Qwen28.0BBF1617.9 GB
rank1-7b7.6BBF1617.0 GB
elephant-19.4BBF1621.0 GB
Fibo-2.0-edit-turbo8.1BBF1618.2 GB

Fits at FP8

Models that fit only after quantizing the weights to 8 bits (1 byte per parameter). Needs an FP8 checkpoint or an engine that quantizes on load, and a GPU with FP8 support.

Text models

32 models.

ModelParametersPublished asVRAM needed
Qwen2.5-14B-Instruct14.8BBF1616.5 GB
Gemma-4-31B-IT-NVFP420.9BBF1623.3 GB
Qwen2.5-Coder-14B-Instruct14.8BBF1616.5 GB
Qwen3-14B14.8BBF1616.5 GB
gpt-neox-20b20.7BF1623.2 GB
DeepSeek-Coder-V2-Lite-Instruct15.7BBF1617.6 GB
Qwen3-14B-Base14.8BBF1616.5 GB
phi-414.7BBF1616.4 GB
DeepSeek-R1-Distill-Qwen-14B14.8BBF1616.5 GB
DeepSeek-V2-Lite-Chat15.7BBF1617.6 GB
DeepSeek-V2-Lite15.7BBF1617.6 GB
LLaDA2.0-mini16.3BBF1618.2 GB
Qwen2.5-Coder-14B14.8BBF1616.5 GB
LLaDA2.1-mini16.3BBF1618.2 GB
gpt-oss-20b-BF1620.9BBF1623.4 GB
Qwen2.5-14B14.8BBF1616.5 GB
Qwen2.5-14B-Instruct-1M14.8BBF1616.5 GB
Moonlight-16B-A3B-Instruct16.0BBF1617.8 GB
JiRackUltra_14b14.8BBF1616.5 GB
deepseek-moe-16b-chat16.4BBF1618.3 GB
HyperCLOVAX-SEED-Think-14B14.7BF3216.5 GB
Phi-4-reasoning14.7BBF1616.4 GB
internlm2-chat-20b19.9BBF1622.2 GB
Moonlight-16B-A3B16.0BBF1617.8 GB
internlm2-chat-20b-ExPO19.9BBF1622.2 GB
deepseek-moe-16b-base16.4BBF1618.3 GB
Huihui-gpt-oss-20b-BF16-abliterated20.9BBF1623.4 GB
Param2-17B-A2.4B-Thinking17.2BBF1619.2 GB
Ling-mini-2.016.3BBF1618.2 GB
Phi-4-reasoning-plus14.7BBF1616.4 GB
DeepSeek-R1-Distill-Qwen-14B-abliterated-v214.8BBF1616.5 GB
ContextPilot-14B14.8BBF1616.5 GB

Vision-language models

1 model.

ModelParametersPublished asVRAM needed
Kimi-VL-A3B-Instruct16.4BBF1618.3 GB

Image generation models

4 models.

ModelParametersPublished asVRAM needed
Qwen-Image20.4BBF1622.8 GB
HiDream-I1-Fast17.1BBF1619.1 GB
Qwen-Image-251220.4BBF1622.8 GB
HiDream-I1-Full17.1BF1619.1 GB

Video generation models

12 models.

ModelParametersPublished asVRAM needed
LTX-218.9BBF1621.1 GB
Wan2.1-I2V-14B-720P-Diffusers16.4BF3218.3 GB
Wan2.1-I2V-14B-480P-Diffusers16.4BF3218.3 GB
LTX-2.5-Diffusers19.0BBF1621.2 GB
Wan2.1-I2V-14B-480P16.4BF3218.3 GB
Wan2.1-I2V-14B-720P16.4BF3218.3 GB
Wan2.2-S2V-14B16.3BBF1618.2 GB
Wan2.2-S2V-14B-Diffusers16.3BBF1618.2 GB
lingbot-world-fast18.5BF3220.7 GB
Cosmos-H-Surgical15.2BBF1617.0 GB
Wan2.1-VACE-14B17.3BF3219.4 GB
LTX-2.3-Diffusers19.0BBF1621.2 GB

Other models

4 models.

ModelParametersPublished asVRAM needed
Qwen-Image-Edit-251120.4BBF1622.8 GB
SenseNova-U1-8B-MoT17.6BBF1619.6 GB
A.X-K2-Raon-Speech-21B-A3B21.2BBF1623.7 GB
SenseNova-U1.5-8B-MoT17.5BBF1619.6 GB

Fits at INT4

Models that fit only after quantizing to 4 bits (0.5 byte per parameter). Needs a quantized checkpoint actually published for the model; check its Hugging Face page before relying on a row.

Text models

The 40 most downloaded of 90.

ModelParametersPublished asVRAM needed
OTel-2.0-LLM-31B-IT32.1BBF1617.9 GB
Qwen3-32B32.8BBF1618.3 GB
dolphin-2.9.1-yi-1.5-34b34.4BBF1619.2 GB
Qwen3-30B-A3B30.5BBF1617.1 GB
Qwen2.5-32B-Instruct32.8BBF1618.3 GB
GLM-4.7-Flash31.2BBF1617.4 GB
Qwen2.5-Coder-32B-Instruct32.8BBF1618.3 GB
Qwen3-30B-A3B-Instruct-250730.5BBF1617.1 GB
Qwen3-Coder-30B-A3B-Instruct-FP830.5BF8_E4M317.1 GB
Qwen3.6-35B-A3B-abliterated-v434.7BBF1619.4 GB
Ornith-1.0-35B-FP835.1BF8_E4M319.6 GB
NVIDIA-Nemotron-3-Nano-30B-A3B-BF1631.6BBF1617.6 GB
Ornith-1.0-35B-FP835.1BF8_E4M319.6 GB
Qwen3-Coder-30B-A3B-Instruct30.5BBF1617.1 GB
NVIDIA-Nemotron-3-Nano-30B-A3B-FP831.6BF8_E4M317.6 GB
Qwen3-30B-A3B-Instruct-2507-FP830.5BF8_E4M317.1 GB
DeepSeek-R1-Distill-Qwen-32B32.8BBF1618.3 GB
Ornith-1.0-35B-FP835.1BF8_E4M319.6 GB
Qwen3-30B-A3B-abliterated30.5BF3217.1 GB
NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF1631.6BBF1617.6 GB
Ornith-1.0-35B-AEON-Ultimate-Uncensored-BF1635.1BBF1619.6 GB
granite-4.1-30b28.9BBF1616.1 GB
automotive34.7BBF1619.4 GB
Ornith-1.5-35B-A3B36.0BBF1620.1 GB
gemma-4-31B-it-uncensored32.7BBF1618.3 GB
Ornith-1.5-35B-A3B-FP836.0BF8_E4M320.1 GB
Ornith-1.5-35B-A3B-MLX34.7BBF1619.4 GB
Phi-3.5-MoE-instruct41.9BBF1623.4 GB
Qwen3-30B-A3B-Base30.5BBF1617.1 GB
NVIDIA-Nemotron-3-Nano-30B-A3B-Base-BF1631.6BBF1617.6 GB
Qwen3-32B-FP832.8BF8_E4M318.3 GB
lynx-instruct-30b30.5BBF1617.1 GB
Qwen3-30B-A3B-FP830.5BF8_E4M317.1 GB
Goedel-Prover-V2-32B32.8BBF1618.3 GB
Qwen2.5-32B32.8BBF1618.3 GB
DeepSeek-R1-Distill-Qwen-32B-FP8-dynamic32.8BF8_E4M318.3 GB
Qwen3-30B-A3B-Thinking-250730.5BBF1617.1 GB
Qwen-AgentWorld-35B-A3B34.7BBF1619.4 GB
QwQ-32B32.8BBF1618.3 GB
Laguna-XS-2.133.4BBF1618.7 GB

Vision-language models

19 models.

ModelParametersPublished asVRAM needed
Qwen3.6-35B-A3B-FP836.0BF8_E4M320.1 GB
gemma-4-31B-it31.3BBF1617.5 GB
Qwen3.6-35B-A3B36.0BBF1620.1 GB
Qwen3.5-35B-A3B36.0BBF1620.1 GB
Qwen2.5-VL-32B-Instruct33.5BBF1618.7 GB
Qwen3.5-35B-A3B-FP836.0BF8_E4M320.1 GB
gemma-4-31B-it-FP8-block31.3BF8_E4M317.5 GB
Qwen3-VL-30B-A3B-Instruct-FP831.1BF8_E4M317.4 GB
gemma-4-31B32.7BBF1618.3 GB
Muse-Glimmer-30B29.8BBF1616.6 GB
Qwen3-VL-32B-Instruct33.4BBF1618.6 GB
Qwen3-VL-32B-Instruct-FP833.4BF8_E4M318.6 GB
Infinity-Parser2-Pro35.1BBF1619.6 GB
Qwen3-VL-30B-A3B-Instruct31.1BBF1617.4 GB
gemma-4-31B-it-FP8-dynamic31.3BF8_E4M317.5 GB
medgemma-27b-it28.8BBF1616.1 GB
Qwen3.5-35B-A3B-Base36.0BBF1620.1 GB
Thomson-1.0-Small35.1BBF1619.6 GB
fibo-scene-analyzer36.0BBF1620.1 GB

Image generation models

2 models.

ModelParametersPublished asVRAM needed
minimax-h3-image-pdmd-2step33.1BBF1618.5 GB
P-H3-Image33.1BBF1618.5 GB

Video generation models

5 models.

ModelParametersPublished asVRAM needed
Pika-H3-Flex33.1BBF1618.5 GB
FastVideo-Minimax-FastH3-Preview-v0.235.0BBF1619.6 GB
Kandinsky-6.0-Pro-distill-5s-Diffusers30.1BBF1616.8 GB
Kandinsky-6.0-Pro-5s-Diffusers30.1BBF1616.8 GB
FastVideo-FastH3-4-step-Preview-v1-VSA-DataFree35.0BBF1619.6 GB

Speech models

2 models.

ModelParametersPublished asVRAM needed
NVIDIA-Nemotron-3.5-Transcribe-30B-A4B33.7BBF1618.8 GB
drama-335.9BF8_E4M320.1 GB

Other models

5 models.

ModelParametersPublished asVRAM needed
MiniMax-H333.1BBF1618.5 GB
FLUX.2-dev32.2BBF1618.0 GB
Artemis-31B-v1.231.3BBF1617.5 GB
PAN229.2BBF1616.3 GB
Isaac-0.535.7BF3220.0 GB

How these numbers are computed

Required VRAM is the weight size at each precision times a flat 1.2 overhead, the same figure every model page shows. It does not include a long context: the KV cache grows with every token, so a model near the top of a tier can need the next one at long context. Read how much VRAM you need for LLMs for the method, the VRAM and quantization glossary entries for the terms, and the VRAM calculator to size a model that is not listed.

Looking for a model by job rather than by memory? Start with coding, reasoning, chat and assistants, vision-language or see the full models directory.

Other VRAM tiers

Start ComfyUI on a rented GPU.

© 2026 Aquanode. All rights reserved.

All trademarks, logos and brand names are the property of their respective owners.