OpenAIGPT-4oArena #158Jul 18, 2024
GPT-4o-mini (2024-07-18)
GPT-4o mini is OpenAI's newest model after GPT-4 Omni, supporting both text and image inputs with text outputs. As their most advanced small model, it is many multiples more affordable than other recent frontier models, and more than 60% cheaper than GPT-3.5 Turbo. It maintains SOTA intelligence, while being significantly more cost-effective. GPT-4o mini achieves an 82% score on MMLU and presently ranks higher than GPT-4 on chat preferences common leaderboards. Check out the launch announcement to learn more. #multimodal
Context Window
128K
tokens
Max Output
16K
tokens
Released
Jul 18, 2024
Arena Rank
#158
of 305 models
Output Speed
128
tokens/sec
Time to First Token
280ms
TTFT
Capabilities
👁Vision
🧠Reasoning
🔧Tool Calling
⚡Prompt Caching
🖥Computer Use
🎨Image Generation
Supported Parameters
Frequency Penalty
Reduce repetition
Logit Bias
Adjust token weights
Log Probs
Token probabilities
Max Tokens
Output length limit
Presence Penalty
Encourage new topics
Response Format
JSON mode / structured output
Seed
Deterministic outputs
Stop Sequences
Custom stop tokens
structured_outputs
Temperature
Controls randomness
Tool Choice
Control tool usage
Tool Calling
Function calling support
top_logprobs
Top P
Nucleus sampling
web_search_options
Pricing Comparison
| Router | Input / 1M | Output / 1M | Cached Input / 1M |
|---|---|---|---|
| Requesty★ | $0.15 | $0.60 | $0.07 |
| OpenRouter | $0.15 | $0.60 | $0.07 |
| Vercel AI | $0.15 | $0.60 | — |
| Martian | $0.15 | $0.60 | $0.07 |
Benchmarks
Artificial Analysis
Intelligence IndexArtificial Analysis
44.1/100Coding IndexArtificial Analysis
34.8/100Math IndexArtificial Analysis
53.8/100MMLU-PROArtificial Analysis
0.632/1GPQA DiamondArtificial Analysis
0.412/1MATH-500Artificial Analysis
0.717/1AIME 2024Artificial Analysis
0.067/1Humanity's Last ExamArtificial Analysis
0.005/1LiveCodeBenchArtificial Analysis
0.328/1SciCodeArtificial Analysis
0.108/1Aider Code Editing
Aider EditingAider Code Editing
40.6/100Aider Polyglot
Aider PolyglotAider Polyglot
0.9/100Model IDs
Requesty
openai/gpt-4o-miniOpenRouter
openai/gpt-4o-mini-2024-07-18Tags
visiontool-callingcaching