Llama 3.1 models
42 Llama 3.1 models on Hugging Face, from 950M to 405.9B parameters. At the precision each one is published in, the smallest needs about 2.1 GB of VRAM (Llama-3.1-8B-Instruct-speculator.eagle3, cheapest live fit: RTX 5060 Ti) and the largest about 907 GB (Llama-3.1-405B). The cheapest way to run Llama-3.1-8B-Instruct-speculator.eagle3 is $0.110/hr.
Llama 3.1 models
VRAM is for the precision the model is published in, with the same overhead and an 8,192-token context assumed on every page; see the methodology. The fit shown is the lowest-priced single GPU type that holds the model at that precision, or the lowest-priced multi-GPU set (up to 8) when none does.
More from Meta
- Llama 3.2 (21 models)
- Llama 3 (22 models)
- Llama 2 (11 models)
- Llama 3.3 (4 models)
- Code Llama (3 models)
- Llama (3 models)
- Llama Guard (4 models)
