Llama 2 70B Chat Hf

Jul 2023
Llama 2 70B Chat Hf
Compare in
on
—per task?
$0.64 / $0.80per 1M in / out?
—output speed?
4Kcontext

Alternatives?

Run it yourself

estimate
Fits on✗ 8 GB (phone, laptop)✗ 16 GB✗ 24 GB GPU✓ 48 GB GPU · compressed✓ 80 GB GPU · 8-bit
LicenceLlama 2 licencecommercial use with conditions

Benchmarks

in Chat & Knowledge

FAQ

How much does Llama 2 70B Chat Hf cost?›

$0.64 per 1M input tokens and $0.80 per 1M output tokens (cheapest host: DeepInfra).

Is Llama 2 70B Chat Hf free to use?›

There is no free API; the cheapest paid price is $0.64 per 1M input tokens. The weights are open, so you can run it yourself.

How good is Llama 2 70B Chat Hf, and what is it best at?›

#125 of 133 in Chat & Knowledge.

Is Llama 2 70B Chat Hf better than Mistral 7B Instruct v0.3?›

On MATH Level 5, Llama 2 70B Chat Hf scores 3.3 vs 3.6 — about the same.

How can I use Llama 2 70B Chat Hf?›

Through the API of DeepInfra.

What is the context window of Llama 2 70B Chat Hf?›

4K tokens.

When was Llama 2 70B Chat Hf released? Is there a newer version?›

Released 2023-07-14. It is the current version in its line.

Is Llama 2 70B Chat Hf open source?›

Yes, the weights are open (llama2 licence).

Can I run Llama 2 70B Chat Hf locally?›

The weights are open and can be self-hosted; hardware needs are not confirmed yet.

Can Llama 2 70B Chat Hf read images?›

No, it accepts text only.

What is Llama 2 70B Chat Hf?›

Llama 2 70B Chat Hf is an open-weights language model from Meta, released Jul 2023.

What are the best alternatives to Llama 2 70B Chat Hf?›

GPT-5 Nano (2025-08-07) (cheaper), GPT-5 (2025-08-07) (better), DeepSeek R1 Distill Llama 70B (open weights).