Datasets

Every dataset is registered in dataset_registry.yaml. Click through for a per-dataset leaderboard.

• BEIR v1.0.0 — ARGUANA 0 runs
  beir-v1.0.0-arguana
  metrics: ndcg_cut_10, recall_100, recall_1000
• BEIR v1.0.0 — BIOASQ 0 runs
  beir-v1.0.0-bioasq
  metrics: ndcg_cut_10, recall_100, recall_1000
• BEIR v1.0.0 — CLIMATE-FEVER 0 runs
  beir-v1.0.0-climate-fever
  metrics: ndcg_cut_10, recall_100, recall_1000
• BEIR v1.0.0 — CQADUPSTACK-ANDROID 0 runs
  beir-v1.0.0-cqadupstack-android
  metrics: ndcg_cut_10, recall_100, recall_1000
• BEIR v1.0.0 — CQADUPSTACK-ENGLISH 0 runs
  beir-v1.0.0-cqadupstack-english
  metrics: ndcg_cut_10, recall_100, recall_1000
• BEIR v1.0.0 — CQADUPSTACK-GAMING 0 runs
  beir-v1.0.0-cqadupstack-gaming
  metrics: ndcg_cut_10, recall_100, recall_1000
• BEIR v1.0.0 — CQADUPSTACK-GIS 0 runs
  beir-v1.0.0-cqadupstack-gis
  metrics: ndcg_cut_10, recall_100, recall_1000
• BEIR v1.0.0 — CQADUPSTACK-MATHEMATICA 0 runs
  beir-v1.0.0-cqadupstack-mathematica
  metrics: ndcg_cut_10, recall_100, recall_1000
• BEIR v1.0.0 — CQADUPSTACK-PHYSICS 0 runs
  beir-v1.0.0-cqadupstack-physics
  metrics: ndcg_cut_10, recall_100, recall_1000
• BEIR v1.0.0 — CQADUPSTACK-PROGRAMMERS 0 runs
  beir-v1.0.0-cqadupstack-programmers
  metrics: ndcg_cut_10, recall_100, recall_1000
• BEIR v1.0.0 — CQADUPSTACK-STATS 0 runs
  beir-v1.0.0-cqadupstack-stats
  metrics: ndcg_cut_10, recall_100, recall_1000
• BEIR v1.0.0 — CQADUPSTACK-TEX 0 runs
  beir-v1.0.0-cqadupstack-tex
  metrics: ndcg_cut_10, recall_100, recall_1000
• BEIR v1.0.0 — CQADUPSTACK-UNIX 0 runs
  beir-v1.0.0-cqadupstack-unix
  metrics: ndcg_cut_10, recall_100, recall_1000
• BEIR v1.0.0 — CQADUPSTACK-WEBMASTERS 0 runs
  beir-v1.0.0-cqadupstack-webmasters
  metrics: ndcg_cut_10, recall_100, recall_1000
• BEIR v1.0.0 — CQADUPSTACK-WORDPRESS 0 runs
  beir-v1.0.0-cqadupstack-wordpress
  metrics: ndcg_cut_10, recall_100, recall_1000
• BEIR v1.0.0 — DBPEDIA-ENTITY 0 runs
  beir-v1.0.0-dbpedia-entity
  metrics: ndcg_cut_10, recall_100, recall_1000
• BEIR v1.0.0 — FEVER 0 runs
  beir-v1.0.0-fever
  metrics: ndcg_cut_10, recall_100, recall_1000
• BEIR v1.0.0 — FIQA 0 runs
  beir-v1.0.0-fiqa
  metrics: ndcg_cut_10, recall_100, recall_1000
• BEIR v1.0.0 — HOTPOTQA 0 runs
  beir-v1.0.0-hotpotqa
  metrics: ndcg_cut_10, recall_100, recall_1000
• BEIR v1.0.0 — NFCORPUS 0 runs
  beir-v1.0.0-nfcorpus
  metrics: ndcg_cut_10, recall_100, recall_1000
• BEIR v1.0.0 — NQ 0 runs
  beir-v1.0.0-nq
  metrics: ndcg_cut_10, recall_100, recall_1000
• BEIR v1.0.0 — QUORA 0 runs
  beir-v1.0.0-quora
  metrics: ndcg_cut_10, recall_100, recall_1000
• BEIR v1.0.0 — ROBUST04 0 runs
  beir-v1.0.0-robust04
  metrics: ndcg_cut_10, recall_100, recall_1000
• BEIR v1.0.0 — SCIDOCS 0 runs
  beir-v1.0.0-scidocs
  metrics: ndcg_cut_10, recall_100, recall_1000
• BEIR v1.0.0 — SCIFACT 0 runs
  beir-v1.0.0-scifact
  metrics: ndcg_cut_10, recall_100, recall_1000
• BEIR v1.0.0 — SIGNAL1M 0 runs
  beir-v1.0.0-signal1m
  metrics: ndcg_cut_10, recall_100, recall_1000
• BEIR v1.0.0 — TREC-COVID 0 runs
  beir-v1.0.0-trec-covid
  metrics: ndcg_cut_10, recall_100, recall_1000
• BEIR v1.0.0 — TREC-NEWS 0 runs
  beir-v1.0.0-trec-news
  metrics: ndcg_cut_10, recall_100, recall_1000
• BEIR v1.0.0 — WEBIS-TOUCHE2020 0 runs
  beir-v1.0.0-webis-touche2020
  metrics: ndcg_cut_10, recall_100, recall_1000
• MS MARCO v1 Passage — Dev 0 runs
  msmarco-v1-passage.dev
  metrics: recip_rank, recall_1000
• TREC Deep Learning 2019 — Passage 0 runs
  msmarco-v1-passage.trecdl2019
  metrics: map, ndcg_cut_10, recall_1000
• TREC Deep Learning 2020 — Passage 0 runs
  msmarco-v1-passage.trecdl2020
  metrics: map, ndcg_cut_10, recall_1000