Claude 3.5 Haiku

Claude 3.5 Haiku is Anthropic's fastest model, delivering advanced coding, tool use, and reasoning capabilities at an accessible price. It excels at user-facing products, specialized sub-agent tasks, and generating personalized experiences from large data volumes. The model is particularly well-suited for code completions, interactive chatbots, data extraction, and real-time content moderation.

Benchmark results

Benchmark Score Tags Source
DROP 83.1% self-reported llm-stats link →
GPQA 41.6% self-reported llm-stats link →
HumanEval 88.1% self-reported llm-stats link →
MATH 69.4% self-reported llm-stats link →
MGSM 85.6% self-reported llm-stats link →
MMLU-Pro 65.0% self-reported llm-stats link →
SWE-Bench Verified 40.6% self-reported llm-stats link →
TAU-bench Airline 22.8% self-reported llm-stats link →
TAU-bench Retail 51.0% self-reported llm-stats link →