Nexus

general official site →

NexusRaven benchmark for evaluating function calling capabilities of large language models in zero-shot scenarios across cybersecurity tools and API interactions

Methodology

Imported from llm-stats public benchmark metadata. Modality: text. Max score: 1. Categories: general, tool_calling. Language: en. Verified by llm-stats: no.

Leaderboard

  1. Llama 3.1 405B Instruct self-reported llm-stats
    58.7%
  2. Llama 3.1 70B Instruct self-reported llm-stats
    56.7%
  3. Llama 3.1 8B Instruct self-reported llm-stats
    38.5%
  4. Llama 3.2 3B Instruct self-reported llm-stats
    34.3%