Claude 3.5 Sonnet Model Features, Pricing, Benchmarks, and Performance Analysis (September 2024)

Claude 3.5 Sonnet, developed by Anthropic, features a context window of 200.0K tokens. The model costs $3.00 per million tokens for input and $15.00 per million tokens for output. It was released on June 20, 2024,and has achieved impressive scores in various benchmarks.
Access Claude 3.5 Sonnet & 210+ other AI models all in one collaborative workspaceTry Flamingo.ai for free

Overview

Claude 3.5 SonnetClaude 3.5 Sonnet
Model Provider
The organization behind this AI's development
Anthropic logoAnthropic
Input Context Window
Maximum input tokens this model can process at once
200.0K
tokens
Output Token Limit
Maximum output tokens this model can generate at once
4096
tokens
Release Date
When this model first became publicly available
June 20th, 2024

Pricing

Claude 3.5 SonnetClaude 3.5 Sonnet
Input Token Cost
Cost per million tokens fed into the model
$3.00
per million tokens
Output Token Cost
Cost per million tokens generated by the model
$15.00
per million tokens

Benchmarks

Claude 3.5 SonnetClaude 3.5 Sonnet
MMLU
Measures model's ability to answer questions across various domains
90.4
(5-shot CoT)
Source
MMMU
Evaluates model's performance across diverse tasks and data types
68.3
(0-shot CoT)
Source
HellaSwag
Assesses the model's ability to understand everyday scenarios
Not available