Claude 3 Haiku
Claude 3 Haiku is the fastest and most compact model in the Claude 3 family, designed for near-instant responsiveness. It excels at answering simple queries and requests with unmatched speed, making it ideal for seamless AI experiences that mimic human interactions.
Benchmark results
| Benchmark | Score | Tags | Source |
|---|---|---|---|
| ARC-C | 89.2% | self-reported llm-stats | link → |
| BIG-Bench Hard | 73.7% | self-reported llm-stats | link → |
| DROP | 78.4% | self-reported llm-stats | link → |
| GPQA | 33.3% | self-reported llm-stats | link → |
| GSM8k | 88.9% | self-reported llm-stats | link → |
| HellaSwag | 85.9% | self-reported llm-stats | link → |
| HumanEval | 75.9% | self-reported llm-stats | link → |
| MATH | 38.9% | self-reported llm-stats | link → |
| MGSM | 75.1% | self-reported llm-stats | link → |
| MMLU | 75.2% | self-reported llm-stats | link → |