📖 The AI Tool Bible

Llama 3.1 70B

by Metaopen weights
Llama 3 family
Parameters
70B
Context window
128K tokens
Released
2024-07-23
Input price / 1M tok
$0.60
Output price / 1M tok
$0.60
Modality
tools

About Llama 3.1 70B

The workhorse of open-weight production. 70B parameters at ~$0.60/Mtok on Together/Fireworks — best-price-per-quality open model until Llama 4. Fine-tunes cheaply and self-hosts on a single 8×A100 or 4×H100 node.

Strengths

  • Great $/quality ratio
  • Self-hostable on one node
  • Huge fine-tune ecosystem
  • Predictable

Weaknesses

  • Text-only
  • Superseded by Llama 4 on quality
  • Not multimodal

Best for

Fine-tuningOn-prem inferenceRAG
Vendor page →HuggingFace →