Claude 3.5 Sonnet | GPT-3.5 Turbo | |
---|---|---|
Model Provider The organization behind this AI's development | Anthropic | OpenAI |
Input Context Window Maximum input tokens this model can process at once | 200.0K tokens | 4096 tokens |
Output Token Limit Maximum output tokens this model can generate at once | 4096 tokens | 4096 tokens |
Release Date When this model first became publicly available | June 20, 2024 3 months ago June 20th, 2024 | November 28, 2022 1 year ago November 28th, 2022 |
Claude 3.5 Sonnet | GPT-3.5 Turbo | |
---|---|---|
Input Token Cost Cost per million tokens fed into the model | $3.00 per million tokens | $0.50 per million tokens |
Output Token Cost Cost per million tokens generated by the model | $15.00 per million tokens | $1.50 per million tokens |
Claude 3.5 Sonnet | GPT-3.5 Turbo | |
---|---|---|
MMLU Measures model's ability to answer questions across various domains | 90.4 (5-shot CoT) | 70.0 (5-shot) |
MMMU Evaluates model's performance across diverse tasks and data types | 68.3 (0-shot CoT) | Benchmark not available. |
HellaSwag Assesses the model's ability to understand everyday scenarios | Benchmark not available. | 85.5 (10-shot) |