GPT-4o mini
GPT-4o mini is OpenAI's latest cost-efficient small model, designed to make AI intelligence more accessible and affordable. It excels in textual intelligence and multimodal reasoning, outperforming previous models like GPT-3.5 Turbo. With a context window of 128K tokens and support for text and vision, it offers low-cost, real-time applications such as customer support chatbots. Priced at 15 cents per million input tokens and 60 cents per million output tokens, it is significantly cheaper than its predecessors. Safety is prioritized with built-in measures and improved resistance to security threats.
Benchmark results
| Benchmark | Score | Tags | Source |
|---|---|---|---|
| DROP | 79.7% | self-reported llm-stats | link → |
| GPQA | 40.2% | self-reported llm-stats | link → |
| HumanEval | 87.2% | self-reported llm-stats | link → |
| MATH | 70.2% | self-reported llm-stats | link → |
| MathVista | 56.7% | self-reported llm-stats | link → |
| MGSM | 87.0% | self-reported llm-stats | link → |
| MMLU | 82.0% | self-reported llm-stats | link → |
| MMMU | 59.4% | self-reported llm-stats | link → |
| SWE-Bench Verified | 8.7% | self-reported llm-stats | link → |