Gemini 1.5 Flash

Gemini 1.5 Flash is a fast and versatile multimodal model for scaling across diverse tasks. It supports audio, images, video, and text input, and produces text output.

XSTest

97.0%

i
HellaSwag

86.5%

i
GSM8k

86.2%

i
BIG-Bench Hard

85.5%

i
MGSM

82.6%

i
Natural2Code

79.8%

i
MMLU

78.9%

i
MATH

77.9%

i
Video-MME

76.1%

i
HumanEval

74.3%

i
WMT23

74.1%

i
MRCR

71.9%

i
MMLU-Pro

67.3%

i
MathVista

65.8%

i
MMMU

62.3%

i
PhysicsFinals

57.4%

i
FunctionalMATH

53.6%

i
GPQA

51.0%

i
Vibe-Eval

48.9%

i
HiddenMath

47.2%

i
AMC_2022_23

34.8%

i
FLEURS

9.6%

i