QueryGym
QueryGym Leaderboard
Reproducible benchmarks for LLM query reformulation.
← Datasets

DBPedia

beir-v1.0.0-dbpedia-entity
All results produced by QueryGym · fully reproducible!

120 (method × LLM × retriever) configurations evaluated on this dataset.
Click any row or the + button to expand. The three steps (reformulate → retrieve → evaluate) for that run appear inline.

Retriever
Model
Method
120 / 120 runs
best in column
Method LLM Retriever nDCG@10 R@100
csqe Qwen2.5-72B-Instruct BGE-base-en-v1.5 0.40240.4897
methodcsqe llmQwen2.5-72B-Instruct retrieverBGE-base-en-v1.5 datasetDBPedia
No run config available.
csqe Qwen2.5-72B-Instruct BM25 0.35560.4639
methodcsqe llmQwen2.5-72B-Instruct retrieverBM25 datasetDBPedia
No run config available.
csqe Qwen2.5-72B-Instruct SPLADE++ 0.36860.5021
methodcsqe llmQwen2.5-72B-Instruct retrieverSPLADE++ datasetDBPedia
No run config available.
csqe Qwen2.5-7B-Instruct BGE-base-en-v1.5 0.38260.4879
methodcsqe llmQwen2.5-7B-Instruct retrieverBGE-base-en-v1.5 datasetDBPedia
No run config available.
csqe Qwen2.5-7B-Instruct BM25 0.37670.5078
methodcsqe llmQwen2.5-7B-Instruct retrieverBM25 datasetDBPedia
No run config available.
csqe Qwen2.5-7B-Instruct SPLADE++ 0.36610.4830
methodcsqe llmQwen2.5-7B-Instruct retrieverSPLADE++ datasetDBPedia
No run config available.
csqe gpt-4.1 BGE-base-en-v1.5 0.42420.5229
methodcsqe llmgpt-4.1 retrieverBGE-base-en-v1.5 datasetDBPedia
No run config available.
csqe gpt-4.1 BM25 0.38990.5136
methodcsqe llmgpt-4.1 retrieverBM25 datasetDBPedia
No run config available.
csqe gpt-4.1 SPLADE++ 0.39620.5232
methodcsqe llmgpt-4.1 retrieverSPLADE++ datasetDBPedia
No run config available.
csqe gpt-4.1-nano BGE-base-en-v1.5 0.41470.5123
methodcsqe llmgpt-4.1-nano retrieverBGE-base-en-v1.5 datasetDBPedia
No run config available.
csqe gpt-4.1-nano BM25 0.36470.4939
methodcsqe llmgpt-4.1-nano retrieverBM25 datasetDBPedia
No run config available.
csqe gpt-4.1-nano SPLADE++ 0.38050.5235
methodcsqe llmgpt-4.1-nano retrieverSPLADE++ datasetDBPedia
No run config available.
genqr Qwen2.5-72B-Instruct BGE-base-en-v1.5 0.36920.4808
methodgenqr llmQwen2.5-72B-Instruct retrieverBGE-base-en-v1.5 datasetDBPedia
No run config available.
genqr Qwen2.5-72B-Instruct BM25 0.26490.3941
methodgenqr llmQwen2.5-72B-Instruct retrieverBM25 datasetDBPedia
No run config available.
genqr Qwen2.5-72B-Instruct SPLADE++ 0.35790.5275
methodgenqr llmQwen2.5-72B-Instruct retrieverSPLADE++ datasetDBPedia
No run config available.
genqr Qwen2.5-7B-Instruct BGE-base-en-v1.5 0.34260.4550
methodgenqr llmQwen2.5-7B-Instruct retrieverBGE-base-en-v1.5 datasetDBPedia
No run config available.
genqr Qwen2.5-7B-Instruct BM25 0.28760.4203
methodgenqr llmQwen2.5-7B-Instruct retrieverBM25 datasetDBPedia
No run config available.
genqr Qwen2.5-7B-Instruct SPLADE++ 0.37030.5386
methodgenqr llmQwen2.5-7B-Instruct retrieverSPLADE++ datasetDBPedia
No run config available.
genqr gpt-4.1 BGE-base-en-v1.5 0.35550.4693
methodgenqr llmgpt-4.1 retrieverBGE-base-en-v1.5 datasetDBPedia
No run config available.
genqr gpt-4.1 BM25 0.34420.4635
methodgenqr llmgpt-4.1 retrieverBM25 datasetDBPedia
No run config available.
genqr gpt-4.1 SPLADE++ 0.38270.5414
methodgenqr llmgpt-4.1 retrieverSPLADE++ datasetDBPedia
No run config available.
genqr gpt-4.1-nano BGE-base-en-v1.5 0.34340.4680
methodgenqr llmgpt-4.1-nano retrieverBGE-base-en-v1.5 datasetDBPedia
No run config available.
genqr gpt-4.1-nano BM25 0.25910.4137
methodgenqr llmgpt-4.1-nano retrieverBM25 datasetDBPedia
No run config available.
genqr gpt-4.1-nano SPLADE++ 0.35920.5267
methodgenqr llmgpt-4.1-nano retrieverSPLADE++ datasetDBPedia
No run config available.
genqr_ensemble Qwen2.5-72B-Instruct BGE-base-en-v1.5 0.39740.5309
methodgenqr_ensemble llmQwen2.5-72B-Instruct retrieverBGE-base-en-v1.5 datasetDBPedia
No run config available.
genqr_ensemble Qwen2.5-72B-Instruct BM25 0.31360.4161
methodgenqr_ensemble llmQwen2.5-72B-Instruct retrieverBM25 datasetDBPedia
No run config available.
genqr_ensemble Qwen2.5-72B-Instruct SPLADE++ 0.42710.5565
methodgenqr_ensemble llmQwen2.5-72B-Instruct retrieverSPLADE++ datasetDBPedia
No run config available.
genqr_ensemble Qwen2.5-7B-Instruct BGE-base-en-v1.5 0.34620.4644
methodgenqr_ensemble llmQwen2.5-7B-Instruct retrieverBGE-base-en-v1.5 datasetDBPedia
No run config available.
genqr_ensemble Qwen2.5-7B-Instruct BM25 0.34640.4916
methodgenqr_ensemble llmQwen2.5-7B-Instruct retrieverBM25 datasetDBPedia
No run config available.
genqr_ensemble Qwen2.5-7B-Instruct SPLADE++ 0.35890.5194
methodgenqr_ensemble llmQwen2.5-7B-Instruct retrieverSPLADE++ datasetDBPedia
No run config available.
genqr_ensemble gpt-4.1 BGE-base-en-v1.5 0.37590.4961
methodgenqr_ensemble llmgpt-4.1 retrieverBGE-base-en-v1.5 datasetDBPedia
No run config available.
genqr_ensemble gpt-4.1 BM25 0.36000.4765
methodgenqr_ensemble llmgpt-4.1 retrieverBM25 datasetDBPedia
No run config available.
genqr_ensemble gpt-4.1 SPLADE++ 0.36430.5365
methodgenqr_ensemble llmgpt-4.1 retrieverSPLADE++ datasetDBPedia
No run config available.
genqr_ensemble gpt-4.1-nano BGE-base-en-v1.5 0.34880.4758
methodgenqr_ensemble llmgpt-4.1-nano retrieverBGE-base-en-v1.5 datasetDBPedia
No run config available.
genqr_ensemble gpt-4.1-nano BM25 0.31810.4501
methodgenqr_ensemble llmgpt-4.1-nano retrieverBM25 datasetDBPedia
No run config available.
genqr_ensemble gpt-4.1-nano SPLADE++ 0.36110.5276
methodgenqr_ensemble llmgpt-4.1-nano retrieverSPLADE++ datasetDBPedia
No run config available.
lamer Qwen2.5-72B-Instruct BGE-base-en-v1.5 0.41390.5001
methodlamer llmQwen2.5-72B-Instruct retrieverBGE-base-en-v1.5 datasetDBPedia
No run config available.
lamer Qwen2.5-72B-Instruct BM25 0.40100.5217
methodlamer llmQwen2.5-72B-Instruct retrieverBM25 datasetDBPedia
No run config available.
lamer Qwen2.5-72B-Instruct SPLADE++ 0.36970.4883
methodlamer llmQwen2.5-72B-Instruct retrieverSPLADE++ datasetDBPedia
No run config available.
lamer Qwen2.5-7B-Instruct BGE-base-en-v1.5 0.39000.4838
methodlamer llmQwen2.5-7B-Instruct retrieverBGE-base-en-v1.5 datasetDBPedia
No run config available.
lamer Qwen2.5-7B-Instruct BM25 0.38960.5139
methodlamer llmQwen2.5-7B-Instruct retrieverBM25 datasetDBPedia
No run config available.
lamer Qwen2.5-7B-Instruct SPLADE++ 0.34990.4799
methodlamer llmQwen2.5-7B-Instruct retrieverSPLADE++ datasetDBPedia
No run config available.
lamer gpt-4.1 BGE-base-en-v1.5 0.40180.4998
methodlamer llmgpt-4.1 retrieverBGE-base-en-v1.5 datasetDBPedia
No run config available.
lamer gpt-4.1 BM25 0.39890.5159
methodlamer llmgpt-4.1 retrieverBM25 datasetDBPedia
No run config available.
lamer gpt-4.1 SPLADE++ 0.35590.4904
methodlamer llmgpt-4.1 retrieverSPLADE++ datasetDBPedia
No run config available.
lamer gpt-4.1-nano BGE-base-en-v1.5 0.38270.4804
methodlamer llmgpt-4.1-nano retrieverBGE-base-en-v1.5 datasetDBPedia
No run config available.
lamer gpt-4.1-nano BM25 0.34400.4807
methodlamer llmgpt-4.1-nano retrieverBM25 datasetDBPedia
No run config available.
lamer gpt-4.1-nano SPLADE++ 0.33160.4680
methodlamer llmgpt-4.1-nano retrieverSPLADE++ datasetDBPedia
No run config available.
mugi Qwen2.5-72B-Instruct BGE-base-en-v1.5 0.43420.5318
methodmugi llmQwen2.5-72B-Instruct retrieverBGE-base-en-v1.5 datasetDBPedia
No run config available.
mugi Qwen2.5-72B-Instruct BM25 0.41030.5296
methodmugi llmQwen2.5-72B-Instruct retrieverBM25 datasetDBPedia
No run config available.
mugi Qwen2.5-72B-Instruct SPLADE++ 0.37350.5044
methodmugi llmQwen2.5-72B-Instruct retrieverSPLADE++ datasetDBPedia
No run config available.
mugi Qwen2.5-7B-Instruct BGE-base-en-v1.5 0.41060.5195
methodmugi llmQwen2.5-7B-Instruct retrieverBGE-base-en-v1.5 datasetDBPedia
No run config available.
mugi Qwen2.5-7B-Instruct BM25 0.40060.5114
methodmugi llmQwen2.5-7B-Instruct retrieverBM25 datasetDBPedia
No run config available.
mugi Qwen2.5-7B-Instruct SPLADE++ 0.36000.4989
methodmugi llmQwen2.5-7B-Instruct retrieverSPLADE++ datasetDBPedia
No run config available.
mugi gpt-4.1 BGE-base-en-v1.5 0.44000.5286
methodmugi llmgpt-4.1 retrieverBGE-base-en-v1.5 datasetDBPedia
No run config available.
mugi gpt-4.1 BM25 0.40990.5309
methodmugi llmgpt-4.1 retrieverBM25 datasetDBPedia
No run config available.
mugi gpt-4.1 SPLADE++ 0.38430.5137
methodmugi llmgpt-4.1 retrieverSPLADE++ datasetDBPedia
No run config available.
mugi gpt-4.1-nano BGE-base-en-v1.5 0.42800.5284
methodmugi llmgpt-4.1-nano retrieverBGE-base-en-v1.5 datasetDBPedia
No run config available.
mugi gpt-4.1-nano BM25 0.40850.5161
methodmugi llmgpt-4.1-nano retrieverBM25 datasetDBPedia
No run config available.
mugi gpt-4.1-nano SPLADE++ 0.38430.5095
methodmugi llmgpt-4.1-nano retrieverSPLADE++ datasetDBPedia
No run config available.
qa_expand Qwen2.5-72B-Instruct BGE-base-en-v1.5 0.40130.4955
methodqa_expand llmQwen2.5-72B-Instruct retrieverBGE-base-en-v1.5 datasetDBPedia
No run config available.
qa_expand Qwen2.5-72B-Instruct BM25 0.37440.4709
methodqa_expand llmQwen2.5-72B-Instruct retrieverBM25 datasetDBPedia
No run config available.
qa_expand Qwen2.5-72B-Instruct SPLADE++ 0.38300.5213
methodqa_expand llmQwen2.5-72B-Instruct retrieverSPLADE++ datasetDBPedia
No run config available.
qa_expand Qwen2.5-7B-Instruct BGE-base-en-v1.5 0.37310.4872
methodqa_expand llmQwen2.5-7B-Instruct retrieverBGE-base-en-v1.5 datasetDBPedia
No run config available.
qa_expand Qwen2.5-7B-Instruct BM25 0.33380.4669
methodqa_expand llmQwen2.5-7B-Instruct retrieverBM25 datasetDBPedia
No run config available.
qa_expand Qwen2.5-7B-Instruct SPLADE++ 0.36130.5111
methodqa_expand llmQwen2.5-7B-Instruct retrieverSPLADE++ datasetDBPedia
No run config available.
qa_expand gpt-4.1 BGE-base-en-v1.5 0.40050.5087
methodqa_expand llmgpt-4.1 retrieverBGE-base-en-v1.5 datasetDBPedia
No run config available.
qa_expand gpt-4.1 BM25 0.36990.4890
methodqa_expand llmgpt-4.1 retrieverBM25 datasetDBPedia
No run config available.
qa_expand gpt-4.1 SPLADE++ 0.38730.5289
methodqa_expand llmgpt-4.1 retrieverSPLADE++ datasetDBPedia
No run config available.
qa_expand gpt-4.1-nano BGE-base-en-v1.5 0.37180.4717
methodqa_expand llmgpt-4.1-nano retrieverBGE-base-en-v1.5 datasetDBPedia
No run config available.
qa_expand gpt-4.1-nano BM25 0.36800.4808
methodqa_expand llmgpt-4.1-nano retrieverBM25 datasetDBPedia
No run config available.
qa_expand gpt-4.1-nano SPLADE++ 0.40190.5396
methodqa_expand llmgpt-4.1-nano retrieverSPLADE++ datasetDBPedia
No run config available.
Q2D (FS) Qwen2.5-72B-Instruct BGE-base-en-v1.5 0.41130.5101
methodQ2D (FS) llmQwen2.5-72B-Instruct retrieverBGE-base-en-v1.5 datasetDBPedia
No run config available.
Q2D (ZS) Qwen2.5-72B-Instruct BGE-base-en-v1.5 0.42170.5121
methodQ2D (ZS) llmQwen2.5-72B-Instruct retrieverBGE-base-en-v1.5 datasetDBPedia
No run config available.
Q2D (COT) Qwen2.5-72B-Instruct BGE-base-en-v1.5 0.35280.4617
methodQ2D (COT) llmQwen2.5-72B-Instruct retrieverBGE-base-en-v1.5 datasetDBPedia
No run config available.
Q2D (ZS) Qwen2.5-72B-Instruct BM25 0.40340.5107
methodQ2D (ZS) llmQwen2.5-72B-Instruct retrieverBM25 datasetDBPedia
No run config available.
Q2D (COT) Qwen2.5-72B-Instruct BM25 0.37870.4778
methodQ2D (COT) llmQwen2.5-72B-Instruct retrieverBM25 datasetDBPedia
No run config available.
Q2D (FS) Qwen2.5-72B-Instruct BM25 0.39040.4993
methodQ2D (FS) llmQwen2.5-72B-Instruct retrieverBM25 datasetDBPedia
No run config available.
Q2D (FS) Qwen2.5-72B-Instruct SPLADE++ 0.36620.5023
methodQ2D (FS) llmQwen2.5-72B-Instruct retrieverSPLADE++ datasetDBPedia
No run config available.
Q2D (ZS) Qwen2.5-72B-Instruct SPLADE++ 0.37070.5051
methodQ2D (ZS) llmQwen2.5-72B-Instruct retrieverSPLADE++ datasetDBPedia
No run config available.
Q2D (COT) Qwen2.5-72B-Instruct SPLADE++ 0.38970.5470
methodQ2D (COT) llmQwen2.5-72B-Instruct retrieverSPLADE++ datasetDBPedia
No run config available.
Q2D (COT) Qwen2.5-7B-Instruct BGE-base-en-v1.5 0.34980.4463
methodQ2D (COT) llmQwen2.5-7B-Instruct retrieverBGE-base-en-v1.5 datasetDBPedia
No run config available.
Q2D (ZS) Qwen2.5-7B-Instruct BGE-base-en-v1.5 0.39320.4932
methodQ2D (ZS) llmQwen2.5-7B-Instruct retrieverBGE-base-en-v1.5 datasetDBPedia
No run config available.
Q2D (FS) Qwen2.5-7B-Instruct BGE-base-en-v1.5 0.39220.4865
methodQ2D (FS) llmQwen2.5-7B-Instruct retrieverBGE-base-en-v1.5 datasetDBPedia
No run config available.
Q2D (COT) Qwen2.5-7B-Instruct BM25 0.36690.4809
methodQ2D (COT) llmQwen2.5-7B-Instruct retrieverBM25 datasetDBPedia
No run config available.
Q2D (FS) Qwen2.5-7B-Instruct BM25 0.38590.4831
methodQ2D (FS) llmQwen2.5-7B-Instruct retrieverBM25 datasetDBPedia
No run config available.
Q2D (ZS) Qwen2.5-7B-Instruct BM25 0.38360.5047
methodQ2D (ZS) llmQwen2.5-7B-Instruct retrieverBM25 datasetDBPedia
No run config available.
Q2D (COT) Qwen2.5-7B-Instruct SPLADE++ 0.36970.5223
methodQ2D (COT) llmQwen2.5-7B-Instruct retrieverSPLADE++ datasetDBPedia
No run config available.
Q2D (ZS) Qwen2.5-7B-Instruct SPLADE++ 0.35310.4926
methodQ2D (ZS) llmQwen2.5-7B-Instruct retrieverSPLADE++ datasetDBPedia
No run config available.
Q2D (FS) Qwen2.5-7B-Instruct SPLADE++ 0.35750.4927
methodQ2D (FS) llmQwen2.5-7B-Instruct retrieverSPLADE++ datasetDBPedia
No run config available.
Q2D (ZS) gpt-4.1 BGE-base-en-v1.5 0.43110.5221
methodQ2D (ZS) llmgpt-4.1 retrieverBGE-base-en-v1.5 datasetDBPedia
No run config available.
Q2D (COT) gpt-4.1 BGE-base-en-v1.5 0.36780.4556
methodQ2D (COT) llmgpt-4.1 retrieverBGE-base-en-v1.5 datasetDBPedia
No run config available.
Q2D (FS) gpt-4.1 BGE-base-en-v1.5 0.43020.5303
methodQ2D (FS) llmgpt-4.1 retrieverBGE-base-en-v1.5 datasetDBPedia
No run config available.
Q2D (ZS) gpt-4.1 BM25 0.40620.5051
methodQ2D (ZS) llmgpt-4.1 retrieverBM25 datasetDBPedia
No run config available.
Q2D (COT) gpt-4.1 BM25 0.39340.4775
methodQ2D (COT) llmgpt-4.1 retrieverBM25 datasetDBPedia
No run config available.
Q2D (FS) gpt-4.1 BM25 0.40100.5083
methodQ2D (FS) llmgpt-4.1 retrieverBM25 datasetDBPedia
No run config available.
Q2D (ZS) gpt-4.1 SPLADE++ 0.39470.5209
methodQ2D (ZS) llmgpt-4.1 retrieverSPLADE++ datasetDBPedia
No run config available.
Q2D (COT) gpt-4.1 SPLADE++ 0.39260.5319
methodQ2D (COT) llmgpt-4.1 retrieverSPLADE++ datasetDBPedia
No run config available.
Q2D (FS) gpt-4.1 SPLADE++ 0.39100.5192
methodQ2D (FS) llmgpt-4.1 retrieverSPLADE++ datasetDBPedia
No run config available.
Q2D (COT) gpt-4.1-nano BGE-base-en-v1.5 0.38430.4891
methodQ2D (COT) llmgpt-4.1-nano retrieverBGE-base-en-v1.5 datasetDBPedia
No run config available.
Q2D (FS) gpt-4.1-nano BGE-base-en-v1.5 0.40260.5104
methodQ2D (FS) llmgpt-4.1-nano retrieverBGE-base-en-v1.5 datasetDBPedia
No run config available.
Q2D (ZS) gpt-4.1-nano BGE-base-en-v1.5 0.42680.5239
methodQ2D (ZS) llmgpt-4.1-nano retrieverBGE-base-en-v1.5 datasetDBPedia
No run config available.
Q2D (COT) gpt-4.1-nano BM25 0.39210.5132
methodQ2D (COT) llmgpt-4.1-nano retrieverBM25 datasetDBPedia
No run config available.
Q2D (FS) gpt-4.1-nano BM25 0.37200.4873
methodQ2D (FS) llmgpt-4.1-nano retrieverBM25 datasetDBPedia
No run config available.
Q2D (ZS) gpt-4.1-nano BM25 0.39680.4980
methodQ2D (ZS) llmgpt-4.1-nano retrieverBM25 datasetDBPedia
No run config available.
Q2D (COT) gpt-4.1-nano SPLADE++ 0.39620.5324
methodQ2D (COT) llmgpt-4.1-nano retrieverSPLADE++ datasetDBPedia
No run config available.
Q2D (FS) gpt-4.1-nano SPLADE++ 0.37900.5204
methodQ2D (FS) llmgpt-4.1-nano retrieverSPLADE++ datasetDBPedia
No run config available.
Q2D (ZS) gpt-4.1-nano SPLADE++ 0.38490.5064
methodQ2D (ZS) llmgpt-4.1-nano retrieverSPLADE++ datasetDBPedia
No run config available.
query2e Qwen2.5-72B-Instruct BGE-base-en-v1.5 0.36100.4706
methodquery2e llmQwen2.5-72B-Instruct retrieverBGE-base-en-v1.5 datasetDBPedia
No run config available.
query2e Qwen2.5-72B-Instruct BM25 0.35780.4641
methodquery2e llmQwen2.5-72B-Instruct retrieverBM25 datasetDBPedia
No run config available.
query2e Qwen2.5-72B-Instruct SPLADE++ 0.37550.5195
methodquery2e llmQwen2.5-72B-Instruct retrieverSPLADE++ datasetDBPedia
No run config available.
query2e Qwen2.5-7B-Instruct BGE-base-en-v1.5 0.34150.4534
methodquery2e llmQwen2.5-7B-Instruct retrieverBGE-base-en-v1.5 datasetDBPedia
No run config available.
query2e Qwen2.5-7B-Instruct BM25 0.34770.4691
methodquery2e llmQwen2.5-7B-Instruct retrieverBM25 datasetDBPedia
No run config available.
query2e Qwen2.5-7B-Instruct SPLADE++ 0.33860.5134
methodquery2e llmQwen2.5-7B-Instruct retrieverSPLADE++ datasetDBPedia
No run config available.
query2e gpt-4.1 BGE-base-en-v1.5 0.32490.4268
methodquery2e llmgpt-4.1 retrieverBGE-base-en-v1.5 datasetDBPedia
No run config available.
query2e gpt-4.1 BM25 0.37780.4772
methodquery2e llmgpt-4.1 retrieverBM25 datasetDBPedia
No run config available.
query2e gpt-4.1 SPLADE++ 0.39360.5477
methodquery2e llmgpt-4.1 retrieverSPLADE++ datasetDBPedia
No run config available.
query2e gpt-4.1-nano BGE-base-en-v1.5 0.35580.4657
methodquery2e llmgpt-4.1-nano retrieverBGE-base-en-v1.5 datasetDBPedia
No run config available.
query2e gpt-4.1-nano BM25 0.35970.4696
methodquery2e llmgpt-4.1-nano retrieverBM25 datasetDBPedia
No run config available.
query2e gpt-4.1-nano SPLADE++ 0.37160.5295
methodquery2e llmgpt-4.1-nano retrieverSPLADE++ datasetDBPedia
No run config available.