m

Reflection Llama 3.1 70B

Sep 2024
mReflection Llama 3.1 70B
Compare in
onMMLU-Pro · Official board
—per task?
$0.35 / $0.40per 1M in / out?
—output speed?
8Kcontext

Run it yourself

estimate
Fits on✗ 8 GB (phone, laptop)✗ 16 GB✗ 24 GB GPU✓ 48 GB GPU · compressed✓ 80 GB GPU · 8-bit
LicenceLlama 3.1 licencecommercial use with conditions

Benchmarks

in Chat & Knowledge

FAQ

How much does Reflection Llama 3.1 70B cost?›

$0.35 per 1M input tokens and $0.40 per 1M output tokens (cheapest host: DeepInfra).

Is Reflection Llama 3.1 70B free to use?›

There is no free API; the cheapest paid price is $0.35 per 1M input tokens. The weights are open, so you can run it yourself.

How good is Reflection Llama 3.1 70B, and what is it best at?›

#8 of 32 in Chat & Knowledge.

Is Reflection Llama 3.1 70B better than Llama 3.1 70B Instruct?›

On MMLU-Pro · official board, Reflection Llama 3.1 70B scores 60.4 vs 62.8 — lower.

How can I use Reflection Llama 3.1 70B?›

Through the API of DeepInfra.

What is the context window of Reflection Llama 3.1 70B?›

8K tokens.

When was Reflection Llama 3.1 70B released? Is there a newer version?›

Released 2024-09-05. It is the current version in its line.

Is Reflection Llama 3.1 70B open source?›

Yes, the weights are open (llama3.1 licence).

Can I run Reflection Llama 3.1 70B locally?›

The weights are open and can be self-hosted; hardware needs are not confirmed yet.

Can Reflection Llama 3.1 70B read images?›

No, it accepts text only.

What is Reflection Llama 3.1 70B?›

Reflection Llama 3.1 70B is an open-weights language model from mattshumer, released Sep 2024.

What are the best alternatives to Reflection Llama 3.1 70B?›

GPT OSS 20B (cheaper), Gemini 3.1 Pro (better).