Alternatives?
ModelScoreCostPer taskWhat changes
ModelScoreCostPer taskWhat changes
ModelScoreCostPer taskWhat changes
Run it yourself
estimateFits on✗ 8 GB (phone, laptop)✗ 16 GB✗ 24 GB GPU✓ 48 GB GPU · compressed✓ 80 GB GPU · 8-bit
LicenceLlama 3.1 licencecommercial use with conditions
Benchmarks
in Chat & KnowledgeFAQ
How much does Reflection Llama 3.1 70B cost?›
$0.35 per 1M input tokens and $0.40 per 1M output tokens (cheapest host: DeepInfra).
Is Reflection Llama 3.1 70B free to use?›
There is no free API; the cheapest paid price is $0.35 per 1M input tokens. The weights are open, so you can run it yourself.
How good is Reflection Llama 3.1 70B, and what is it best at?›
#8 of 32 in Chat & Knowledge.
Is Reflection Llama 3.1 70B better than Llama 3.1 70B Instruct?›
On MMLU-Pro · official board, Reflection Llama 3.1 70B scores 60.4 vs 62.8 — lower.
How can I use Reflection Llama 3.1 70B?›
Through the API of DeepInfra.
What is the context window of Reflection Llama 3.1 70B?›
8K tokens.
When was Reflection Llama 3.1 70B released? Is there a newer version?›
Released 2024-09-05. It is the current version in its line.
Is Reflection Llama 3.1 70B open source?›
Yes, the weights are open (llama3.1 licence).
Can I run Reflection Llama 3.1 70B locally?›
The weights are open and can be self-hosted; hardware needs are not confirmed yet.
Can Reflection Llama 3.1 70B read images?›
No, it accepts text only.
What is Reflection Llama 3.1 70B?›
Reflection Llama 3.1 70B is an open-weights language model from mattshumer, released Sep 2024.
What are the best alternatives to Reflection Llama 3.1 70B?›
GPT OSS 20B (cheaper), Gemini 3.1 Pro (better).