Skip to content
optera

Llama 3 70B

Meta · Released April 2024
MetaFast Tier

How much does Llama 3 70B cost?

Llama 3 70B is an open-weights model with no first-party API, so each host sets its own price; a typical rate at launch was $0.65 per million input tokens and $2.75 per million output tokens.

Input Price
$0.65
per 1M tokens
Output Price
$2.75
per 1M tokens
Context Window
8K
tokens
Speed Score
92
out of 100

Benchmarks

Avg 79/100
  • Coding76/100
  • Reasoning79/100
  • Extraction80/100
  • Creative80/100
  • VisionN/A

Pricing

Input

Prompt / context tokens

$0.65/ 1M

Output

Generated tokens

$2.75/ 1M

Open-weights model: each host sets its own price. The figure shown is a typical rate at launch.

How we verify prices

Best For

chatbotanalysisextraction

Llama 3 70B in context

On a typical 70% input / 30% output mix, Llama 3 70B blends to $1.28 per million tokens. That puts it above 28% of the 47 models tracked here, and 12 other models in the same budget tier undercut it. Tier is a capability label, not a price band — the spread inside one tier is often wider than the gap between tiers, which is why picking by tier alone tends to overspend.

Input runs $0.65 per million and output $2.75 — a 4.2x ratio. That ratio matters more than either number on its own: a summarisation or classification workload reads far more than it writes and will track the input price, while a code-generation or long-form writing workload inverts that and will track the output price. Compare models on the ratio your own traffic actually has, not on the input price alone.

The benchmark profile is unusually flat — data extraction leads at 80/100 but only 4 points separate the strongest category from the weakest. That makes Llama 3 70B a safe default for mixed workloads where you cannot predict in advance which capability a request will lean on, and a poor choice if you need a specialist.

The context window is 8K tokens and the throughput score is 92/100. Context only earns its keep if you fill it, and filling it is also what makes a request expensive — a large window is an option, not a discount. For a budget-tier model, judge the speed score against what you are doing: it decides everything for interactive chat and almost nothing for overnight batch work.

Worth checking before you commit: Gemini 2.0 Flash scores at least as well on combined coding and reasoning and blends to $0.19 per million against Llama 3 70B's $1.28. That does not make Llama 3 70B the wrong choice — context window, latency, vendor lock-in, and specific capabilities all sit outside a benchmark score — but it does mean the price difference needs a reason behind it.

The closest comparison is GPT-4o Mini from OpenAI, at $0.29 per million against $1.28. 11 models in this tier score higher on combined coding and reasoning, which is the useful framing: the question is rarely whether a model is good, it is whether it is the cheapest thing that is good enough for the specific work you are sending it.

What it costs in production

At 10M + 2M tokens a month — a realistic mid-size production workload — Llama 3 70B runs about $12.00. There is no batch discount on this model, so that figure is the floor — the usual lever of shifting background work to a cheaper asynchronous tier is not available here.

Price History

No price changes since launch

Strengths

  • Open weights — can run on your own hardware
  • No per-token fee when self-hosted

Avoid For

  • Anything needing more than 8K tokens of context
  • Image input (text-only)
  • New builds — Meta's current open-weights line is Llama 4