Small, fast Llama 3.1. The default cheap open-weights model in 2024–25 across Groq, Cerebras and Together.
Llama 3.1 8B Instruct is a efficient AI model from Meta. It costs $0.020 per million input tokens and $0.030 per million output tokens (blended $0.023/M), with a 131K-token context window.
Profile inherited from upstream Llama 3.1 8B ↗ — this is a hosted variant of the same open-weights model.
Llama 3.1 8B Instruct costs $0.020 per million input tokens and $0.030 per million output tokens, for a blended reference rate of $0.023 per million tokens.
Llama 3.1 8B Instruct supports up to 131K tokens of context (131,072 tokens).
Llama 3.1 8B Instruct is well suited to Cheap, Fast on LPU/Cerebras and Open weights.
Llama 3.1 8B Instruct is developed and served by Meta. It was released in Jul 2024.