Llama 3 70B
Meta · Released April 2024
Input Price
$0.65
per 1M tokens
Output Price
$2.75
per 1M tokens
Context Window
8K
tokens
Speed Score
92
out of 100
Benchmarks
Avg 73/100Pricing
Input
Prompt / context tokens
$0.65/ 1M
Output
Generated tokens
$2.75/ 1M
Best For
Llama 3 70B in context
On a typical 70% input / 30% output mix, Llama 3 70B blends to $1.28 per million tokens. That puts it above 28% of the 32 models tracked here, and 8 other models in the same budget tier undercut it. Tier is a capability label, not a price band — the spread inside one tier is often wider than the gap between tiers, which is why picking by tier alone tends to overspend.
Input runs $0.65 per million and output $2.75 — a 4.2x ratio. That ratio matters more than either number on its own: a summarisation or classification workload reads far more than it writes and will track the input price, while a code-generation or long-form writing workload inverts that and will track the output price. Compare models on the ratio your own traffic actually has, not on the input price alone.
The benchmark profile is uneven rather than flat: data extraction at 80/100 against vision at 52/100, a 28-point spread. An average hides that. If your workload sits on the strong end this model punches above its price; if it sits on the weak end, a cheaper model with a flatter profile will serve you better.
The context window is 8K tokens and the throughput score is 92/100. Context only earns its keep if you fill it, and filling it is also what makes a request expensive — a large window is an option, not a discount. For a budget-tier model, judge the speed score against what you are doing: it decides everything for interactive chat and almost nothing for overnight batch work.
Worth checking before you commit: Gemini 2.0 Flash scores at least as well on combined coding and reasoning and blends to $0.19 per million against Llama 3 70B's $1.28. That does not make Llama 3 70B the wrong choice — context window, latency, vendor lock-in, and specific capabilities all sit outside a benchmark score — but it does mean the price difference needs a reason behind it.
The closest comparison is GPT-4o Mini from OpenAI, at $0.29 per million against $1.28. 6 models in this tier score higher on combined coding and reasoning, which is the useful framing: the question is rarely whether a model is good, it is whether it is the cheapest thing that is good enough for the specific work you are sending it.
What it costs in production
At 10M + 2M tokens a month — a realistic mid-size production workload — Llama 3 70B runs about $12.00. There is no batch discount on this model, so that figure is the floor — the usual lever of shifting background work to a cheaper asynchronous tier is not available here.
Price History
No price changes since launch
Strengths
- Fully open source — self-hostable
- No vendor lock-in
- Cost-effective at high volume on own infra
- Active community and fine-tuning ecosystem
Avoid For
- Vision tasks
- Long context (only 8K tokens)
- Teams without GPU infrastructure