OpenAIGPT-4oArena #21Aug 14, 2024

Chatgpt 4o

OpenAI ChatGPT 4o is continually updated by OpenAI to point to the current version of GPT-4o used by ChatGPT. It therefore differs slightly from the API version of GPT-4o in that it has additional RLHF. It is intended for research and evaluation. OpenAI notes that this model is not suited for production use-cases as it may be removed or redirected to another model in the future.

Context Window
128K
tokens
Max Output
16K
tokens
Released
Aug 14, 2024
Arena Rank
#21
of 305 models
Output Speed
92
tokens/sec
Time to First Token
420ms
TTFT

Capabilities

👁Vision
🧠Reasoning
🔧Tool Calling
Prompt Caching
🖥Computer Use
🎨Image Generation

Supported Parameters

Frequency Penalty
Reduce repetition
Logit Bias
Adjust token weights
Log Probs
Token probabilities
Max Tokens
Output length limit
Presence Penalty
Encourage new topics
Response Format
JSON mode / structured output
Seed
Deterministic outputs
Stop Sequences
Custom stop tokens
structured_outputs
Temperature
Controls randomness
top_logprobs
Top P
Nucleus sampling

Pricing Comparison

RouterInput / 1MOutput / 1MCached Input / 1M
Requesty$5.00$15.00$5.00
OpenRouter$5.00$15.00
Martian$5.00$15.00

Benchmarks

Artificial Analysis
Intelligence IndexArtificial Analysis
54.4/100
Coding IndexArtificial Analysis
42.8/100
Math IndexArtificial Analysis
60.8/100
MMLU-PROArtificial Analysis
0.724/1
GPQA DiamondArtificial Analysis
0.538/1
MATH-500Artificial Analysis
0.763/1
AIME 2024Artificial Analysis
0.097/1
Humanity's Last ExamArtificial Analysis
0.013/1
LiveCodeBenchArtificial Analysis
0.395/1
SciCodeArtificial Analysis
0.158/1
Aider Code Editing
Aider EditingAider Code Editing
56.4/100

Model IDs

Requestyopenai/chatgpt-4o
OpenRouteropenai/chatgpt-4o-latest

Tags

visiontool-callingcaching
Compare with another model

Related Models