Gemini 1.0 Pro
Gemini 1.0 Pro is a Natural Language Processing (NLP) model designed for tasks such as multi-turn text and code chat, and code generation. It supports text input and output, making it ideal for natural language tasks. The model is optimized for handling complex conversations and generating code snippets. It offers adjustable safety settings and supports function calling, but does not support JSON mode, JSON schema, or system instructions. The latest stable version is gemini-1.0-pro-001, and it was last updated in February 2024.
Benchmark results
| Benchmark | Score | Tags | Source |
|---|---|---|---|
| BIG-Bench | 75.0% | self-reported llm-stats | link → |
| EgoSchema | 55.7% | self-reported llm-stats | link → |
| FLEURS | 6.4% | self-reported llm-stats | link → |
| GPQA | 27.9% | self-reported llm-stats | link → |
| MATH | 32.6% | self-reported llm-stats | link → |
| MathVista | 46.6% | self-reported llm-stats | link → |
| MMLU | 71.8% | self-reported llm-stats | link → |
| MMMU | 47.9% | self-reported llm-stats | link → |
| WMT23 | 71.7% | self-reported llm-stats | link → |