Social IQa

reasoning

The first large-scale benchmark for commonsense reasoning about social situations. Contains 38,000 multiple choice questions probing emotional and social intelligence in everyday situations, testing commonsense understanding of social interactions and theory of mind reasoning about the implied emotions and behavior of others.

Leaderboard

Showing 9 of 9 results

Phi-3.5-MoE-instruct

78.0%

i
Phi-3.5-mini-instruct

74.7%

i
Phi 4 Mini

72.5%

i
Gemma 2 27B

53.7%

i
Gemma 2 9B

53.4%

i
Gemma 3n E4B

50.0%

i
Gemma 3n E4B Instructed LiteRT Preview

50.0%

i
Gemma 3n E2B

48.8%

i
Gemma 3n E2B Instructed LiteRT (Preview)

48.8%

i