OpenAIGPT-4oArena #158Jul 18, 2024

GPT-4o-mini (2024-07-18)

GPT-4o mini is OpenAI's newest model after GPT-4 Omni, supporting both text and image inputs with text outputs. As their most advanced small model, it is many multiples more affordable than other recent frontier models, and more than 60% cheaper than GPT-3.5 Turbo. It maintains SOTA intelligence, while being significantly more cost-effective. GPT-4o mini achieves an 82% score on MMLU and presently ranks higher than GPT-4 on chat preferences common leaderboards. Check out the launch announcement to learn more. #multimodal

Context Window
128K
tokens
Max Output
16K
tokens
Released
Jul 18, 2024
Arena Rank
#158
of 305 models
Output Speed
128
tokens/sec
Time to First Token
280ms
TTFT

Capabilities

👁Vision
🧠Reasoning
🔧Tool Calling
Prompt Caching
🖥Computer Use
🎨Image Generation

Supported Parameters

Frequency Penalty
Reduce repetition
Logit Bias
Adjust token weights
Log Probs
Token probabilities
Max Tokens
Output length limit
Presence Penalty
Encourage new topics
Response Format
JSON mode / structured output
Seed
Deterministic outputs
Stop Sequences
Custom stop tokens
structured_outputs
Temperature
Controls randomness
Tool Choice
Control tool usage
Tool Calling
Function calling support
top_logprobs
Top P
Nucleus sampling
web_search_options

Pricing Comparison

RouterInput / 1MOutput / 1MCached Input / 1M
Requesty$0.15$0.60$0.07
OpenRouter$0.15$0.60$0.07
Vercel AI$0.15$0.60
Martian$0.15$0.60$0.07

Benchmarks

Artificial Analysis
Intelligence IndexArtificial Analysis
44.1/100
Coding IndexArtificial Analysis
34.8/100
Math IndexArtificial Analysis
53.8/100
MMLU-PROArtificial Analysis
0.632/1
GPQA DiamondArtificial Analysis
0.412/1
MATH-500Artificial Analysis
0.717/1
AIME 2024Artificial Analysis
0.067/1
Humanity's Last ExamArtificial Analysis
0.005/1
LiveCodeBenchArtificial Analysis
0.328/1
SciCodeArtificial Analysis
0.108/1
Aider Code Editing
Aider EditingAider Code Editing
40.6/100
Aider Polyglot
Aider PolyglotAider Polyglot
0.9/100

Model IDs

Requestyopenai/gpt-4o-mini
OpenRouteropenai/gpt-4o-mini-2024-07-18

Tags

visiontool-callingcaching
Compare with another model

Related Models