Small, fast Llama 3.1. The default cheap open-weights model in 2024–25 across Groq, Cerebras and Together.
Llama 3.1 8B is a efficient AI model from Meta. It costs $0.100 per million input tokens and $0.100 per million output tokens (blended $0.100/M), with a 128K-token context window.
Llama 3.1 8B costs $0.100 per million input tokens and $0.100 per million output tokens, for a blended reference rate of $0.100 per million tokens.
Llama 3.1 8B supports up to 128K tokens of context (128,000 tokens).
Llama 3.1 8B is well suited to Cheap, Fast on LPU/Cerebras and Open weights.
Llama 3.1 8B is developed and served by Meta. It was released in Jul 2024.