HomeModelsLlama 3 70B
MetaFast Tier Vision

Llama 3 70B

Meta · Released April 2024

Input Price

$0.65

per 1M tokens

Output Price

$2.75

per 1M tokens

Context Window

8K

tokens

Speed Score

92

out of 100

Benchmarks

Avg 73/100
Coding76/100
Reasoning79/100
Extraction80/100
Creative80/100
Vision52/100

Pricing

Input

Prompt / context tokens

$0.65/ 1M

Output

Generated tokens

$2.75/ 1M

Best For

chatbotanalysisextraction

Llama 3 70B in context

On a typical 70% input / 30% output mix, Llama 3 70B blends to $1.28 per million tokens. That puts it above 28% of the 32 models tracked here, and 8 other models in the same budget tier undercut it. Tier is a capability label, not a price band — the spread inside one tier is often wider than the gap between tiers, which is why picking by tier alone tends to overspend.

Input runs $0.65 per million and output $2.75 — a 4.2x ratio. That ratio matters more than either number on its own: a summarisation or classification workload reads far more than it writes and will track the input price, while a code-generation or long-form writing workload inverts that and will track the output price. Compare models on the ratio your own traffic actually has, not on the input price alone.

The benchmark profile is uneven rather than flat: data extraction at 80/100 against vision at 52/100, a 28-point spread. An average hides that. If your workload sits on the strong end this model punches above its price; if it sits on the weak end, a cheaper model with a flatter profile will serve you better.

The context window is 8K tokens and the throughput score is 92/100. Context only earns its keep if you fill it, and filling it is also what makes a request expensive — a large window is an option, not a discount. For a budget-tier model, judge the speed score against what you are doing: it decides everything for interactive chat and almost nothing for overnight batch work.

Worth checking before you commit: Gemini 2.0 Flash scores at least as well on combined coding and reasoning and blends to $0.19 per million against Llama 3 70B's $1.28. That does not make Llama 3 70B the wrong choice — context window, latency, vendor lock-in, and specific capabilities all sit outside a benchmark score — but it does mean the price difference needs a reason behind it.

The closest comparison is GPT-4o Mini from OpenAI, at $0.29 per million against $1.28. 6 models in this tier score higher on combined coding and reasoning, which is the useful framing: the question is rarely whether a model is good, it is whether it is the cheapest thing that is good enough for the specific work you are sending it.

What it costs in production

At 10M + 2M tokens a month — a realistic mid-size production workload — Llama 3 70B runs about $12.00. There is no batch discount on this model, so that figure is the floor — the usual lever of shifting background work to a cheaper asynchronous tier is not available here.

Price History

No price changes since launch

Strengths

  • Fully open source — self-hostable
  • No vendor lock-in
  • Cost-effective at high volume on own infra
  • Active community and fine-tuning ecosystem

Avoid For

  • Vision tasks
  • Long context (only 8K tokens)
  • Teams without GPU infrastructure