Meta
Released April 18, 2024Cutoff December 2023

Llama 3 70B Instruct

Meta's Llama 3 70B Instruct is a 70B-parameter, instruction-tuned open model using GQA, SFT+RLHF alignment, and an 8K context window for dialogue use cases.

Inputs
Text
Outputs
Text

Model Overview

Capabilities, design details, and architectural traits

Llama 3 70B Instruct - Open-Weight Instruction-Tuned Dialogue Model

Llama 3 70B Instruct is Meta's open-weight generative text model, instruction-tuned specifically for dialogue and assistant-like chat tasks. It is part of the Llama 3 family.

Training Methodology

The instruction-tuned variant is aligned using supervised fine-tuning (SFT) followed by reinforcement learning with human feedback (RLHF). Fine-tuning data includes publicly available instruction datasets plus over 10 million human-annotated examples. Pretraining used over 15 trillion tokens from publicly available sources.

Intended Use

Instruction-tuned models are explicitly scoped to assistant-like chat use cases. Pretrained base variants support broader natural language generation tasks. Out-of-scope use includes languages other than English (fine-tuning for other languages is permitted under the Llama 3 Community License).

Benchmark Performance

Independent evaluations · Artificial Analysis

5.5%
Intelligence

Accuracy & Capability Details

GPQA - Graduate Science37.9%
Humanity's Last Exam4.5%
SciCode - Scientific Coding18.9%
Instruction Following37.1%
Long Context Reasoning0.0%
τ²-Bench - Agentic Tasks0.0%
TerminalBench - System Control0.8%

Compare Models Side-by-Side

Evaluate specifications, pricing, and independent benchmark indices

Model Details
General Info
ProviderMetaAnthropicAnthropic
Release DateApril 18, 2024September 22, 2026September 28, 2026
Knowledge CutoffDec 2023-Jun 2026
Context & Limits
Context Window8K
1M
Best Context Window
1M
Best Context Window
Pricing (per 1M tokens)
Input Pricing
$0.65
Best Input Pricing
$4$2
Output Pricing
$2.75
Best Output Pricing
$20$10
Modalities
Inputs
text
textimagefile
textimagefile
Outputs
text
text
text
Benchmarks (0-100)
Intelligence Index5.5
57.6
Best Intelligence Index
56.0
Coding Index---
Agentic Index---
Llama 3 70B Instruct
Claude Opus 5.5
Claude Sonnet 5.5

Humanity's Last Exam

Extremely difficult logical reasoning and knowledge.

5%
Llama 3 70B Instruct
Humanity's Last Exam
Score: 5%
Llama 3 70B Instruct
61%
Claude Opus 5.5
Humanity's Last Exam
Score: 61%
Claude Opus 5.5
55%
Claude Sonnet 5.5
Humanity's Last Exam
Score: 55%
Claude Sonnet 5.5

Long Context Reasoning

Logical reasoning over long context windows.

0%
Llama 3 70B Instruct
Long Context Reasoning
Score: 0%
Llama 3 70B Instruct
85%
Claude Opus 5.5
Long Context Reasoning
Score: 85%
Claude Opus 5.5
83%
Claude Sonnet 5.5
Long Context Reasoning
Score: 83%
Claude Sonnet 5.5

SciCode Benchmark

Scientific coding and mathematical modeling.

19%
Llama 3 70B Instruct
SciCode Benchmark
Score: 19%
Llama 3 70B Instruct
67%
Claude Opus 5.5
SciCode Benchmark
Score: 67%
Claude Opus 5.5
61%
Claude Sonnet 5.5
SciCode Benchmark
Score: 61%
Claude Sonnet 5.5

Independent evaluation data provided by Artificial Analysis. To view the latest benchmarks and full details, visit their official site.

Explore more from Meta

Other models by Meta

Top AI Models

Leading alternatives by intelligence score

View all