![]() | ![]() | |
---|---|---|
Model Provider The organization behind this AI's development | ![]() | ![]() |
Input Context Window Maximum input tokens this model can process at once | 200.0K tokens | 32.0K tokens |
Output Token Limit Maximum output tokens this model can generate at once | 4096 tokens | 8192 tokens |
Release Date When this model first became publicly available | June 20, 2024 3 months ago June 20th, 2024 | September 27, 2023 1 year ago September 27th, 2023 |
![]() | ![]() | |
---|---|---|
Input Token Cost Cost per million tokens fed into the model | $3.00 per million tokens | $0.25 per million tokens |
Output Token Cost Cost per million tokens generated by the model | $15.00 per million tokens | $0.25 per million tokens |
![]() | ![]() | |
---|---|---|
MMLU Measures model's ability to answer questions across various domains | 90.4 (5-shot CoT) | 60.1 (5-shot) |
MMMU Evaluates model's performance across diverse tasks and data types | 68.3 (0-shot CoT) | Benchmark not available. |
HellaSwag Assesses the model's ability to understand everyday scenarios | Benchmark not available. | Benchmark not available. |