MetaLlama 3.1Open SourceAug 16, 2024

Nous: Hermes 3 405B Instruct (free)

Hermes 3 is a generalist language model with many improvements over Hermes 2, including advanced agentic capabilities, much better roleplaying, reasoning, multi-turn conversation, long context coherence, and improvements across the board. Hermes 3 405B is a frontier-level, full-parameter finetune of the Llama-3.1 405B foundation model, focused on aligning LLMs to the user, with powerful steering capabilities and control given to the end user. The Hermes 3 series builds and expands on the Hermes 2 set of capabilities, including more powerful and reliable function calling and structured output capabilities, generalist assistant capabilities, and improved code generation skills. Hermes 3 is competitive, if not superior, to Llama-3.1 Instruct models at general capabilities, with varying strengths and weaknesses attributable between the two.

Context Window
131K
tokens
Max Output
tokens
Released
Aug 16, 2024
Arena Rank
Output Speed
48
tokens/sec
Time to First Token
1.5s
TTFT

Capabilities

👁Vision
🧠Reasoning
🔧Tool Calling
Prompt Caching
🖥Computer Use
🎨Image Generation

Supported Parameters

Frequency Penalty
Reduce repetition
Max Tokens
Output length limit
Presence Penalty
Encourage new topics
Stop Sequences
Custom stop tokens
Temperature
Controls randomness
Top K
Top-K sampling
Top P
Nucleus sampling

Pricing Comparison

RouterInput / 1MOutput / 1MCached Input / 1M
OpenRouterFreeFree
DeepInfra$1.00$1.00

Benchmarks

Open LLM Leaderboard
AverageOpen LLM Leaderboard
38.51/100
IFEvalOpen LLM Leaderboard
76.61/100
BBHOpen LLM Leaderboard
53.77/100
MATH Lvl 5Open LLM Leaderboard
21/100
GPQAOpen LLM Leaderboard
14.88/100
MUSROpen LLM Leaderboard
23.43/100
MMLU-PROOpen LLM Leaderboard
41.41/100
Artificial Analysis
Intelligence IndexArtificial Analysis
51/100
Coding IndexArtificial Analysis
46/100
Math IndexArtificial Analysis
54/100
MMLU-PROArtificial Analysis
0.682/1
GPQA DiamondArtificial Analysis
0.488/1
MATH-500Artificial Analysis
0.738/1
AIME 2024Artificial Analysis
0.097/1
LiveCodeBenchArtificial Analysis
0.398/1
SciCodeArtificial Analysis
0.162/1
Aider Code Editing
Aider EditingAider Code Editing
51.1/100

Model IDs

OpenRouternousresearch/hermes-3-llama-3.1-405b:free
Compare with another model

Related Models