Claude 3.5 Sonnet Mid-tier Anthropic model. Benchmark results Service providers HumanEval 92.0% MMLU 88.7% MMMU 70.4% SWE-Bench Verified 49.0% Chatbot Arena 1271 elo No serving provider data recorded yet.