GPT-4.1
Apr 2025
GPT-4.1Compare inon
Benchmarks of GPT-4.129
BenchmarkByScoreRank
Overall1
Knowledge5
Reasoning4
Science2
Coding1
Multimodal2
Writing3
Health & law1
Documents1
Legacy · saturated or no longer reported9
No benchmark matches
Rankingin non-thinking mode?
Alternatives?
ModelScoreCostPer taskWhat changes
CheaperMiMo v2.6 ProthinkingOpen×11.8-84%$0.13Pass back reasoning_content+3BetterGPT-6 Lunalow×4.8-94%$0.005Function calling only with none · Chat Completions+3
CheaperMuse Spark 1.3max×11.7-43%$1.60Only auto tool_choice is supported+5
CheaperMiniMax M3.1 Flashthinking×11.5-93%$0.22Complete model response must be appended
CheaperGemini 3.8 Flashhigh×11.4-57%*$1.24Sampling parameters are ignored+1ModelScoreCostPer taskWhat changes
MiMo v2.6 ProthinkingOpen×11.8-84%$0.13Pass back reasoning_content+3Muse Spark 1.3max×11.7-43%$1.60Only auto tool_choice is supported+5MiniMax M3.1 Flashthinking×11.5-93%$0.22Complete model response must be appendedGemini 3.8 Flashhigh×11.4-57%*$1.24Sampling parameters are ignored+1
Step 5 PreviewthinkingOpen×11.1-59%$1.03web_search not available · Chat Completions+2ModelScoreCostPer taskWhat changes
GPT-6 Lunalow×4.8-94%$0.005Function calling only with none · Chat Completions+3
Granite 4.2 3BthinkingOpen+59%-99%$0.006Context: 1M → 128K+1GPT-5.6 Lunalow×4.7-87%$0.01GPT OSS 20BhighOpen×2.6-99%$0.011Context: 1M → 131K+1
Mistral Small 4thinkingOpen×2.4-93%$0.015Context: 1M → 262KModelScoreCostPer taskWhat changes
MiMo v2.6 ProthinkingOpen×11.8-84%$0.13Pass back reasoning_content+3
Kimi K3maxOpen×11.2+71%$2.00Sampling parameters are fixed+3Step 5 PreviewthinkingOpen×11.1-59%$1.03web_search not available · Chat Completions+2Muse Spark OpenxhighOpen×10.5-43%$0.84Reasoning off leaves output unchanged · Self-hosted / llama.cpp+1
DeepSeek V4.1 Flash 1017maxOpen×10.4-85%$0.26Pass back reasoning_content · Chat Completions+4ModelScoreCostPer taskWhat changes
GPT-6 Astramedium×12.6—$1.54Monitoring can return HTTP 403+2GPT-6.1 Solmedium×11.9—$0.21Remove unsupported parameters+5GPT-5.3 Codexxhigh×10.2—$1.75 / $14Context: 1M → 400K+1GPT-5.5medium×10.1—$0.90Prompts with >272K input tokensGPT-5.6 Solmedium×10.1—$0.50GPT-6 Solmedium×9.8—$0.25GPT-5.6 Terramedium×8—$0.18Prompts with >272K input tokensGPT-6 Lunamedium×6.8—$0.017Function calling only with none · Chat Completions+3All OpenAI models →History
17 versionsBenchmarks
all categoriesChat & Knowledge
Humanity's Last Exam4.2#305
AA Omniscience Index-39.6#174
CritPt (physics)0#180
AA Intelligence Index 4.3.2≈12.7#173
AA Omniscience · Accuracy27.8#89
AA-LCR (long context) 1.168.3#133
MMLU-Pro · official boardlab81.8
GPQA Diamond66.6#207
AIME 2025 · AA archived34.7#102
Coding
LiveCodeBench · AA archived45.7#98
Agents & Tool Use
τ²-bench · AA47.1#115
Writing & Language
IFBench (instructions)43#142
COMET22 averagelab84.1
COMET22 multi-domain Zh-Enlab86.9
COMET22 multi-domain En-Zhlab82.8
COMET22 multi-domain En-Delab82.7
COMET22 multi-domain De-Enlab83.9
COMET22 WMT24lab85.1
Vision & Documents
MMMU-Pro (vision)61.2#96
FAQ
How much does GPT-4.1 cost?›
$2 per 1M input tokens and $8 per 1M output tokens; cached input $0.50 per 1M.
Is GPT-4.1 free to use?›
There is no free API; the cheapest paid price is $2 per 1M input tokens.
How good is GPT-4.1, and what is it best at?›
#302 of 334 in Chat & Knowledge, #113 of 239 in Coding, #113 of 242 in Agents & Tool Use, #65 of 195 in Writing & Language, #94 of 124 in Vision & Documents.
Is GPT-4.1 better than GPT-4o Mini?›
On Humanity's Last Exam, GPT-4.1 scores 4.2 vs 4.2 — about the same.
How can I use GPT-4.1?›
Through the API of Azure, Azure AI Foundry, OpenAI.
What is the context window of GPT-4.1?›
1M tokens, with up to 33K output tokens.
When was GPT-4.1 released? Is there a newer version?›
Released 2025-04-14. It has been superseded by GPT-6 Luna.
Is GPT-4.1 open source?›
No, GPT-4.1 is a closed model available through an API. The closest open-weights option here is MiMo v2.6 Pro.
Can GPT-4.1 read images?›
It accepts text and images, PDF files as input.
What is GPT-4.1?›
GPT-4.1 is a closed language model from OpenAI, released Apr 2025, the successor to GPT-4.5 Preview.
What are the best alternatives to GPT-4.1?›
MiMo v2.6 Pro (cheaper), GPT-6 Luna (better).