Radeon RX 6700 XT VRAM: 12 GB GDDR6, and what fits in it

Models that fit at FP16 (12 GB)

• google-bert/bert-base-uncased (110M)
• Qwen/Qwen3-0.6B (752M)
• openai-community/gpt2 (137M)
• Qwen/Qwen2.5-1.5B-Instruct (1.5B)
• Qwen/Qwen2.5-3B-Instruct (3.1B)
• Qwen/Qwen3.5-4B (4.7B)
• openai/whisper-large-v3-turbo (809M)
• Qwen/Qwen3-Embedding-0.6B (596M)
• meta-llama/Llama-3.2-1B-Instruct (1.2B)
• Qwen/Qwen3-4B (4.0B)
• Qwen/Qwen2.5-0.5B-Instruct (494M)
• openai/whisper-large-v3 (1.5B)
• Qwen/Qwen3-ASR-1.7B (2.3B)
• Qwen/Qwen3-VL-4B-Instruct (4.4B)
• Qwen/Qwen2.5-VL-3B-Instruct (3.8B)
• Qwen/Qwen3-1.7B (2.0B)
• EleutherAI/pythia-160m (213M)
• Qwen/Qwen3-4B-Instruct-2507 (4.0B)
• google/gemma-4-E2B-it (5.1B)
• Qwen/Qwen3-Embedding-4B (4.0B)
• google/gemma-3-1b-it (1000M)
• baidu/Unlimited-OCR (3.3B)
• RadixArk/Kimi-K3-DSpark (2.2B)
• openai/whisper-small (242M)
• datalab-to/chandra-ocr-2 (5.3B)
• Qwen/Qwen3-VL-2B-Instruct (2.1B)
• Qwen/Qwen3.5-2B (2.3B)
• microsoft/Florence-2-base (232M)
• HuggingFaceTB/SmolLM2-135M (135M)
• MahmoudAshraf/mms-300m-1130-forced-aligner (315M)
• deepseek-ai/DeepSeek-OCR (3.3B)
• Qwen/Qwen3.5-0.8B (873M)
• Qwen/Qwen3-Reranker-4B (4.0B)
• facebook/sam3 (860M)
• mistralai/Voxtral-Mini-4B-Realtime-2602 (4.4B)
• zai-org/GLM-OCR (1.3B)
• Qwen/Qwen3-VL-Reranker-2B (2.1B)
• mlx-community/parakeet-tdt-0.6b-v2 (618M)
• prism-ml/Bonsai-27B-mlx-1bit (1.7B)
• Qwen/Qwen3-1.7B-Base (1.7B)

Models that fit at INT4 (quantized, 12 GB)

This GPU's hardware doesn't support INT4-class serving kernels (AWQ/GPTQ/Marlin), so no INT4 fit list applies.

Live pricing

No current live offer for this GPU, either there is no inventory listed right now, or the marketplace feed was briefly unreachable. This refreshes hourly; no price is shown rather than a stale or estimated one.