Hugging Face Open LLM Leaderboard API

Use the Hugging Face Open LLM Leaderboard API to retrieve model rankings and published benchmark scores. Choose score order, model type and parameter-size bounds to browse the Open LLM Leaderboard v2, keeping its individual benchmarks and published evaluation dates alongside model metadata. Compare published evaluation scores, shortlist models for independent testing, or analyse rankings within a specified model-size range. These are published benchmark results, rather than a new evaluation performed with the caller’s own prompts. The detail page provides request and response examples, supported parameters, and usage pricing.

Selected price
$0.002 / billing creditPublished pricing
Sellers / implementations
1 / 1
Requests · 30d
—Loading...
Success rate · 30d
—Loading...

Run sends a real API request. Charges follow the published API contract.

Request parameters
Optional parameters (14)
Only models whose name contains this text.
Sort field (default average).
Sort order (default desc).
Minimum size in billions of parameters.
Maximum size in billions of parameters.
Only this model type.
Only (or no) models from official providers.
Page number (default 1).
Models per page, up to 100 (default 50).
0 leaves out the bulky `raw` source blocks (often 10-30x smaller).
Comma-separated fields to return, e.g. `posts.id,posts.title`. Call metadata is always included.
1 skips the 24-hour cache and fetches live.
JSON only for this OpenAny product. Omit output or use json; CSV and NDJSON exports are not exposed.
Native CSV/NDJSON record selector; it has no effect on this JSON-only product.

Sample response

{
  "cached": false,
  "count": 50,
  "credits_used": 1,
  "items": [
    {
      "architecture": "Qwen2ForCausalLM",
      "available_on_hub": false,
      "average": 48.10647092442315,
      "base_model": "Qwen/Qwen2.5-72B",
      "chat_template": true,
      "co2_kg": 76.77142501291785,
      "flagged": false,
      "generation": 2,
      "license": "other",
      "likes": 10,
      "merged": false,
      "model": "huihui-ai/Qwen2.5-72B-Instruct-abliterated",
      "moe": false,
      "official_provider": false,
      "params_b": 72.706,
      "position": 1,
      "precision": "bfloat16",
      "scores": {
        "bbh": 60.487869412693875,
        "gpqa": 19.35123042505593,
        "ifeval": 85.92667455684251,
        "math_lvl5": 60.12084592145015,
        "mmlu_pro": 50.410017730496456,
        "musr": 12.342187500000003
      },
      "sha": "6c92140f35084f10f08832cb884fd87328509d45",
      "submitted": "2024-12-07",
      "type": "fine-tunedondomain-specificdatasets",
      "uploaded": "2024-10-26",
      "url": "https://huggingface.co/huihui-ai/Qwen2.5-72B-Instruct-abliterated",
      "weight_type": "Original"
    },
    {
      "architecture": "Qwen2ForCausalLM",
      "available_on_hub": false,
      "average": 47.98045991216864,
      "base_model": "Qwen/Qwen2.5-72B",
      "chat_template": true,
      "co2_kg": 47.645491341309835,
      "flagged": false,
      "generation": 1,
      "license": "other",
      "likes": 777,
      "merged": false,
      "model": "Qwen/Qwen2.5-72B-Instruct",
      "moe": false,
      "official_provider": true,
      "params_b": 72.706,
      "position": 2,
      "precision": "bfloat16",
      "scores": {
        "bbh": 61.873255668787884,
        "gpqa": 16.666666666666664,
        "ifeval": 86.3837949972739,
        "math_lvl5": 59.818731117824775,
        "mmlu_pro": 51.39812352245864,
        "musr": 11.742187500000005
      },
      "sha": "a13fff9ad76700c7ecff2769f75943ba8395b4a7",
      "submitted": "2024-10-16",
      "type": "chatmodels",
      "uploaded": "2024-09-16",
      "url": "https://huggingface.co/Qwen/Qwen2.5-72B-Instruct",
      "weight_type": "Original"
    },
    "… 48 more"
  ],
  "leaderboard": "Open LLM Leaderboard v2",
  "next_page": 2,
  "order": "desc",
  "page": 1,
  "q": "qwen",
  "sort": "average",
  "total": 773,
  "url": "https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard"
}

Response result

Response structure

Inferred from examples
  • cachedboolean
  • countinteger
  • credits_usedinteger
  • items(object | string)[]
    • architecturestring
    • available_on_hubboolean
    • averagenumber
    • base_modelstring
    • chat_templateboolean
    • co2_kgnumber
    • flaggedboolean
    • generationinteger
    • licensestring
    • likesinteger
    • mergedboolean
    • modelstring
    • moeboolean
    • official_providerboolean
    • params_bnumber
    • positioninteger
    • precisionstring
    • scoresobject
      • bbhnumber
      • gpqanumber
      • ifevalnumber
      • math_lvl5number
      • mmlu_pronumber
      • musrnumber
    • shastring
    • submittedstring
    • typestring
    • uploadedstring
    • urlstring
    • weight_typestring
  • leaderboardstring
  • next_pageinteger
  • orderstring
  • pageinteger
  • qstring
  • sortstring
  • totalinteger
  • urlstring

Loading related APIs…

Common questions

Do I need a separate key for every provider?

Use your OpenAny API key for standard API access. Read it from OPENANY_API_KEY in your environment and keep it out of prompts, source code and logs.

Are these providers interchangeable?

No. Each offering has its own inputs, pricing and response contract. Selecting a catalog offering does not establish automatic routing or fallback. Confirm the service contract before calling.

How is this API billed?

API-key calls use your shared balance at the selected implementation's published rate. Check the billing unit and request-specific pricing rules before making a paid call. Recorded usage determines the final charge under that contract.

Where do the price and contract come from?

The selected implementation publishes its provider, request contract, revision and billing rules through OpenAny's public API catalog. A revision number identifies a contract version, not a price update date. A price update timestamp is not supplied; do not treat a page date as one.

How do OpenAny Balance and x402 differ?

OpenAny Balance uses an API key and one shared balance. Card, USDC and x402 top-ups, card auto top-up and USDC subscriptions fund that balance; available routes appear on the Credits page. Direct x402 is a separate pay-per-request flow, available only on listings that show it and requiring an authorized payment client.

Does Playground send a paid request?

Yes. After you sign in, Run sends a real API request using an active OpenAny API key. Charges follow the published API contract and use your shared balance. Selecting an implementation, editing inputs and viewing sample responses do not send requests.

Use Hugging Face Open LLM Leaderboard API with your agent

Inspect endpoint contracts and confirm availability and pricing before a paid call.