WikiCLIR - ir_datasets

`"wikiclir"`

A Cross-Language IR (CLIR) collection between English queries and other language documents, built from Wikipedia.

\cite{sasaki-etal-2018-cross}

Bibtex:

@inproceedings{sasaki-etal-2018-cross, title = "Cross-Lingual Learning-to-Rank with Shared Representations", author = "Sasaki, Shota and Sun, Shuo and Schamoni, Shigehiko and Duh, Kevin and Inui, Kentaro", booktitle = "Proceedings of the 2018 Conference of the North {A}merican Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 2 (Short Papers)", month = jun, year = "2018", address = "New Orleans, Louisiana", publisher = "Association for Computational Linguistics", url = "https://aclanthology.org/N18-2073", doi = "10.18653/v1/N18-2073", pages = "458--463" }

`"wikiclir/ar"`

WikiCLIR with Arabic documents.

queries docs qrels Citation Metadata

324K queries

Language: en

Query type:

GenericQuery: (namedtuple)

query_id: str
text: str

Examples:

Python API CLI PyTerrier

import ir_datasets
dataset = ir_datasets.load("wikiclir/ar")
for query in dataset.queries_iter():
    query # namedtuple<query_id, text>

You can find more details about the Python API here.

ir_datasets export wikiclir/ar queries



[query_id]    [text]
...

You can find more details about the CLI here.

Rel.	Definition	Count	%
1	All other articles that link to the mate, and are linked by the mate	`195K`	37.5%
2	Document assigned to the (English) cross-lingual mate	`324K`	62.5%

{
  "docs": {
    "count": 535118,
    "fields": {
      "doc_id": {
        "max_len": 7,
        "common_prefix": ""
      }
    }
  },
  "queries": {
    "count": 324489
  },
  "qrels": {
    "count": 519269,
    "fields": {
      "relevance": {
        "counts_by_value": {
          "2": 324475,
          "1": 194794
        }
      }
    }
  }
}

`"wikiclir/ca"`

WikiCLIR with Catalan documents.

queries docs qrels Citation Metadata

340K queries

Language: en

Query type:

GenericQuery: (namedtuple)

query_id: str
text: str

Examples:

Python API CLI PyTerrier

import ir_datasets
dataset = ir_datasets.load("wikiclir/ca")
for query in dataset.queries_iter():
    query # namedtuple<query_id, text>

You can find more details about the Python API here.

ir_datasets export wikiclir/ca queries



[query_id]    [text]
...

You can find more details about the CLI here.

Rel.	Definition	Count	%
1	All other articles that link to the mate, and are linked by the mate	`626K`	64.8%
2	Document assigned to the (English) cross-lingual mate	`340K`	35.2%

{
  "docs": {
    "count": 548722,
    "fields": {
      "doc_id": {
        "max_len": 7,
        "common_prefix": ""
      }
    }
  },
  "queries": {
    "count": 339586
  },
  "qrels": {
    "count": 965233,
    "fields": {
      "relevance": {
        "counts_by_value": {
          "2": 339562,
          "1": 625671
        }
      }
    }
  }
}

`"wikiclir/cs"`

WikiCLIR with Czech documents.

queries docs qrels Citation Metadata

234K queries

Language: en

Query type:

GenericQuery: (namedtuple)

query_id: str
text: str

Examples:

Python API CLI PyTerrier

import ir_datasets
dataset = ir_datasets.load("wikiclir/cs")
for query in dataset.queries_iter():
    query # namedtuple<query_id, text>

You can find more details about the Python API here.

ir_datasets export wikiclir/cs queries



[query_id]    [text]
...

You can find more details about the CLI here.

Rel.	Definition	Count	%
1	All other articles that link to the mate, and are linked by the mate	`721K`	75.5%
2	Document assigned to the (English) cross-lingual mate	`234K`	24.5%

{
  "docs": {
    "count": 386906,
    "fields": {
      "doc_id": {
        "max_len": 7,
        "common_prefix": ""
      }
    }
  },
  "queries": {
    "count": 233553
  },
  "qrels": {
    "count": 954370,
    "fields": {
      "relevance": {
        "counts_by_value": {
          "2": 233535,
          "1": 720835
        }
      }
    }
  }
}

`"wikiclir/de"`

WikiCLIR with German documents.

queries docs qrels Citation Metadata

938K queries

Language: en

Query type:

GenericQuery: (namedtuple)

query_id: str
text: str

Examples:

Python API CLI PyTerrier

import ir_datasets
dataset = ir_datasets.load("wikiclir/de")
for query in dataset.queries_iter():
    query # namedtuple<query_id, text>

You can find more details about the Python API here.

ir_datasets export wikiclir/de queries



[query_id]    [text]
...

You can find more details about the CLI here.

Rel.	Definition	Count	%
1	All other articles that link to the mate, and are linked by the mate	`4.6M`	83.1%
2	Document assigned to the (English) cross-lingual mate	`938K`	16.9%

{
  "docs": {
    "count": 2091278,
    "fields": {
      "doc_id": {
        "max_len": 8,
        "common_prefix": ""
      }
    }
  },
  "queries": {
    "count": 938217
  },
  "qrels": {
    "count": 5550454,
    "fields": {
      "relevance": {
        "counts_by_value": {
          "2": 938194,
          "1": 4612260
        }
      }
    }
  }
}

`"wikiclir/en-simple"`

WikiCLIR with Simple English documents.

queries docs qrels Citation Metadata

115K queries

Language: en

Query type:

GenericQuery: (namedtuple)

query_id: str
text: str

Examples:

Python API CLI PyTerrier

import ir_datasets
dataset = ir_datasets.load("wikiclir/en-simple")
for query in dataset.queries_iter():
    query # namedtuple<query_id, text>

You can find more details about the Python API here.

ir_datasets export wikiclir/en-simple queries



[query_id]    [text]
...

You can find more details about the CLI here.

Rel.	Definition	Count	%
1	All other articles that link to the mate, and are linked by the mate	`136K`	54.2%
2	Document assigned to the (English) cross-lingual mate	`115K`	45.8%

{
  "docs": {
    "count": 127089,
    "fields": {
      "doc_id": {
        "max_len": 6,
        "common_prefix": ""
      }
    }
  },
  "queries": {
    "count": 114572
  },
  "qrels": {
    "count": 250380,
    "fields": {
      "relevance": {
        "counts_by_value": {
          "2": 114564,
          "1": 135816
        }
      }
    }
  }
}

`"wikiclir/es"`

WikiCLIR with Spanish documents.

queries docs qrels Citation Metadata

782K queries

Language: en

Query type:

GenericQuery: (namedtuple)

query_id: str
text: str

Examples:

Python API CLI PyTerrier

import ir_datasets
dataset = ir_datasets.load("wikiclir/es")
for query in dataset.queries_iter():
    query # namedtuple<query_id, text>

You can find more details about the Python API here.

ir_datasets export wikiclir/es queries



[query_id]    [text]
...

You can find more details about the CLI here.

Rel.	Definition	Count	%
1	All other articles that link to the mate, and are linked by the mate	`2.1M`	73.0%
2	Document assigned to the (English) cross-lingual mate	`781K`	27.0%

{
  "docs": {
    "count": 1302958,
    "fields": {
      "doc_id": {
        "max_len": 7,
        "common_prefix": ""
      }
    }
  },
  "queries": {
    "count": 781642
  },
  "qrels": {
    "count": 2894807,
    "fields": {
      "relevance": {
        "counts_by_value": {
          "2": 781376,
          "1": 2113431
        }
      }
    }
  }
}

`"wikiclir/fi"`

WikiCLIR with Finnish documents.

queries docs qrels Citation Metadata

274K queries

Language: en

Query type:

GenericQuery: (namedtuple)

query_id: str
text: str

Examples:

Python API CLI PyTerrier

import ir_datasets
dataset = ir_datasets.load("wikiclir/fi")
for query in dataset.queries_iter():
    query # namedtuple<query_id, text>

You can find more details about the Python API here.

ir_datasets export wikiclir/fi queries



[query_id]    [text]
...

You can find more details about the CLI here.

Rel.	Definition	Count	%
1	All other articles that link to the mate, and are linked by the mate	`666K`	70.9%
2	Document assigned to the (English) cross-lingual mate	`274K`	29.1%

{
  "docs": {
    "count": 418677,
    "fields": {
      "doc_id": {
        "max_len": 7,
        "common_prefix": ""
      }
    }
  },
  "queries": {
    "count": 273819
  },
  "qrels": {
    "count": 939613,
    "fields": {
      "relevance": {
        "counts_by_value": {
          "2": 273796,
          "1": 665817
        }
      }
    }
  }
}

`"wikiclir/fr"`

WikiCLIR with French documents.

queries docs qrels Citation Metadata

1.1M queries

Language: en

Query type:

GenericQuery: (namedtuple)

query_id: str
text: str

Examples:

Python API CLI PyTerrier

import ir_datasets
dataset = ir_datasets.load("wikiclir/fr")
for query in dataset.queries_iter():
    query # namedtuple<query_id, text>

You can find more details about the Python API here.

ir_datasets export wikiclir/fr queries



[query_id]    [text]
...

You can find more details about the CLI here.

Rel.	Definition	Count	%
1	All other articles that link to the mate, and are linked by the mate	`4.0M`	78.8%
2	Document assigned to the (English) cross-lingual mate	`1.1M`	21.2%

{
  "docs": {
    "count": 1894397,
    "fields": {
      "doc_id": {
        "max_len": 8,
        "common_prefix": ""
      }
    }
  },
  "queries": {
    "count": 1089179
  },
  "qrels": {
    "count": 5137366,
    "fields": {
      "relevance": {
        "counts_by_value": {
          "2": 1089052,
          "1": 4048314
        }
      }
    }
  }
}

`"wikiclir/it"`

WikiCLIR with Italian documents.

queries docs qrels Citation Metadata

809K queries

Language: en

Query type:

GenericQuery: (namedtuple)

query_id: str
text: str

Examples:

Python API CLI PyTerrier

import ir_datasets
dataset = ir_datasets.load("wikiclir/it")
for query in dataset.queries_iter():
    query # namedtuple<query_id, text>

You can find more details about the Python API here.

ir_datasets export wikiclir/it queries



[query_id]    [text]
...

You can find more details about the CLI here.

Rel.	Definition	Count	%
1	All other articles that link to the mate, and are linked by the mate	`2.6M`	76.5%
2	Document assigned to the (English) cross-lingual mate	`808K`	23.5%

{
  "docs": {
    "count": 1347011,
    "fields": {
      "doc_id": {
        "max_len": 7,
        "common_prefix": ""
      }
    }
  },
  "queries": {
    "count": 808605
  },
  "qrels": {
    "count": 3443633,
    "fields": {
      "relevance": {
        "counts_by_value": {
          "2": 808345,
          "1": 2635288
        }
      }
    }
  }
}

`"wikiclir/ja"`

WikiCLIR with Japanese documents.

queries docs qrels Citation Metadata

426K queries

Language: en

Query type:

GenericQuery: (namedtuple)

query_id: str
text: str

Examples:

Python API CLI PyTerrier

import ir_datasets
dataset = ir_datasets.load("wikiclir/ja")
for query in dataset.queries_iter():
    query # namedtuple<query_id, text>

You can find more details about the Python API here.

ir_datasets export wikiclir/ja queries



[query_id]    [text]
...

You can find more details about the CLI here.

Rel.	Definition	Count	%
1	All other articles that link to the mate, and are linked by the mate	`2.9M`	87.2%
2	Document assigned to the (English) cross-lingual mate	`426K`	12.8%

{
  "docs": {
    "count": 1071292,
    "fields": {
      "doc_id": {
        "max_len": 7,
        "common_prefix": ""
      }
    }
  },
  "queries": {
    "count": 426431
  },
  "qrels": {
    "count": 3338667,
    "fields": {
      "relevance": {
        "counts_by_value": {
          "2": 426383,
          "1": 2912284
        }
      }
    }
  }
}

`"wikiclir/ko"`

WikiCLIR with Korean documents.

queries docs qrels Citation Metadata

225K queries

Language: en

Query type:

GenericQuery: (namedtuple)

query_id: str
text: str

Examples:

Python API CLI PyTerrier

import ir_datasets
dataset = ir_datasets.load("wikiclir/ko")
for query in dataset.queries_iter():
    query # namedtuple<query_id, text>

You can find more details about the Python API here.

ir_datasets export wikiclir/ko queries



[query_id]    [text]
...

You can find more details about the CLI here.

Rel.	Definition	Count	%
1	All other articles that link to the mate, and are linked by the mate	`343K`	60.4%
2	Document assigned to the (English) cross-lingual mate	`225K`	39.6%

{
  "docs": {
    "count": 394177,
    "fields": {
      "doc_id": {
        "max_len": 7,
        "common_prefix": ""
      }
    }
  },
  "queries": {
    "count": 224855
  },
  "qrels": {
    "count": 568205,
    "fields": {
      "relevance": {
        "counts_by_value": {
          "2": 224843,
          "1": 343362
        }
      }
    }
  }
}

`"wikiclir/nl"`

WikiCLIR with Dutch documents.

queries docs qrels Citation Metadata

688K queries

Language: en

Query type:

GenericQuery: (namedtuple)

query_id: str
text: str

Examples:

Python API CLI PyTerrier

import ir_datasets
dataset = ir_datasets.load("wikiclir/nl")
for query in dataset.queries_iter():
    query # namedtuple<query_id, text>

You can find more details about the Python API here.

ir_datasets export wikiclir/nl queries



[query_id]    [text]
...

You can find more details about the CLI here.

Rel.	Definition	Count	%
1	All other articles that link to the mate, and are linked by the mate	`1.6M`	70.5%
2	Document assigned to the (English) cross-lingual mate	`688K`	29.5%

{
  "docs": {
    "count": 1908260,
    "fields": {
      "doc_id": {
        "max_len": 7,
        "common_prefix": ""
      }
    }
  },
  "queries": {
    "count": 687718
  },
  "qrels": {
    "count": 2334644,
    "fields": {
      "relevance": {
        "counts_by_value": {
          "2": 687672,
          "1": 1646972
        }
      }
    }
  }
}

`"wikiclir/nn"`

WikiCLIR with Norwegian (Bokmål) documents.

queries docs qrels Citation Metadata

99K queries

Language: en

Query type:

GenericQuery: (namedtuple)

query_id: str
text: str

Examples:

Python API CLI PyTerrier

import ir_datasets
dataset = ir_datasets.load("wikiclir/nn")
for query in dataset.queries_iter():
    query # namedtuple<query_id, text>

You can find more details about the Python API here.

ir_datasets export wikiclir/nn queries



[query_id]    [text]
...

You can find more details about the CLI here.

Rel.	Definition	Count	%
1	All other articles that link to the mate, and are linked by the mate	`151K`	60.2%
2	Document assigned to the (English) cross-lingual mate	`99K`	39.8%

{
  "docs": {
    "count": 133290,
    "fields": {
      "doc_id": {
        "max_len": 6,
        "common_prefix": ""
      }
    }
  },
  "queries": {
    "count": 99493
  },
  "qrels": {
    "count": 250141,
    "fields": {
      "relevance": {
        "counts_by_value": {
          "2": 99465,
          "1": 150676
        }
      }
    }
  }
}

`"wikiclir/no"`

WikiCLIR with Norwegian (Nynorsk) documents.

queries docs qrels Citation Metadata

300K queries

Language: en

Query type:

GenericQuery: (namedtuple)

query_id: str
text: str

Examples:

Python API CLI PyTerrier

import ir_datasets
dataset = ir_datasets.load("wikiclir/no")
for query in dataset.queries_iter():
    query # namedtuple<query_id, text>

You can find more details about the Python API here.

ir_datasets export wikiclir/no queries



[query_id]    [text]
...

You can find more details about the CLI here.

Rel.	Definition	Count	%
1	All other articles that link to the mate, and are linked by the mate	`664K`	68.9%
2	Document assigned to the (English) cross-lingual mate	`300K`	31.1%

{
  "docs": {
    "count": 471420,
    "fields": {
      "doc_id": {
        "max_len": 7,
        "common_prefix": ""
      }
    }
  },
  "queries": {
    "count": 299897
  },
  "qrels": {
    "count": 963514,
    "fields": {
      "relevance": {
        "counts_by_value": {
          "2": 299831,
          "1": 663683
        }
      }
    }
  }
}

`"wikiclir/pl"`

WikiCLIR with Polish documents.

queries docs qrels Citation Metadata

694K queries

Language: en

Query type:

GenericQuery: (namedtuple)

query_id: str
text: str

Examples:

Python API CLI PyTerrier

import ir_datasets
dataset = ir_datasets.load("wikiclir/pl")
for query in dataset.queries_iter():
    query # namedtuple<query_id, text>

You can find more details about the Python API here.

ir_datasets export wikiclir/pl queries



[query_id]    [text]
...

You can find more details about the CLI here.

Rel.	Definition	Count	%
1	All other articles that link to the mate, and are linked by the mate	`1.8M`	71.9%
2	Document assigned to the (English) cross-lingual mate	`694K`	28.1%

{
  "docs": {
    "count": 1234316,
    "fields": {
      "doc_id": {
        "max_len": 7,
        "common_prefix": ""
      }
    }
  },
  "queries": {
    "count": 693656
  },
  "qrels": {
    "count": 2471360,
    "fields": {
      "relevance": {
        "counts_by_value": {
          "2": 693604,
          "1": 1777756
        }
      }
    }
  }
}

`"wikiclir/pt"`

WikiCLIR with Portuguese documents.

queries docs qrels Citation Metadata

612K queries

Language: en

Query type:

GenericQuery: (namedtuple)

query_id: str
text: str

Examples:

Python API CLI PyTerrier

import ir_datasets
dataset = ir_datasets.load("wikiclir/pt")
for query in dataset.queries_iter():
    query # namedtuple<query_id, text>

You can find more details about the Python API here.

ir_datasets export wikiclir/pt queries



[query_id]    [text]
...

You can find more details about the CLI here.

Rel.	Definition	Count	%
1	All other articles that link to the mate, and are linked by the mate	`1.1M`	64.9%
2	Document assigned to the (English) cross-lingual mate	`612K`	35.1%

{
  "docs": {
    "count": 973057,
    "fields": {
      "doc_id": {
        "max_len": 7,
        "common_prefix": ""
      }
    }
  },
  "queries": {
    "count": 611732
  },
  "qrels": {
    "count": 1741889,
    "fields": {
      "relevance": {
        "counts_by_value": {
          "2": 611643,
          "1": 1130246
        }
      }
    }
  }
}

`"wikiclir/ro"`

WikiCLIR with Romanian documents.

queries docs qrels Citation Metadata

199K queries

Language: en

Query type:

GenericQuery: (namedtuple)

query_id: str
text: str

Examples:

Python API CLI PyTerrier

import ir_datasets
dataset = ir_datasets.load("wikiclir/ro")
for query in dataset.queries_iter():
    query # namedtuple<query_id, text>

You can find more details about the Python API here.

ir_datasets export wikiclir/ro queries



[query_id]    [text]
...

You can find more details about the CLI here.

Rel.	Definition	Count	%
1	All other articles that link to the mate, and are linked by the mate	`252K`	55.8%
2	Document assigned to the (English) cross-lingual mate	`199K`	44.2%

{
  "docs": {
    "count": 376655,
    "fields": {
      "doc_id": {
        "max_len": 7,
        "common_prefix": ""
      }
    }
  },
  "queries": {
    "count": 199264
  },
  "qrels": {
    "count": 451180,
    "fields": {
      "relevance": {
        "counts_by_value": {
          "2": 199253,
          "1": 251927
        }
      }
    }
  }
}

`"wikiclir/ru"`

WikiCLIR with Russian documents.

queries docs qrels Citation Metadata

665K queries

Language: en

Query type:

GenericQuery: (namedtuple)

query_id: str
text: str

Examples:

Python API CLI PyTerrier

import ir_datasets
dataset = ir_datasets.load("wikiclir/ru")
for query in dataset.queries_iter():
    query # namedtuple<query_id, text>

You can find more details about the Python API here.

ir_datasets export wikiclir/ru queries



[query_id]    [text]
...

You can find more details about the CLI here.

Rel.	Definition	Count	%
1	All other articles that link to the mate, and are linked by the mate	`1.7M`	71.4%
2	Document assigned to the (English) cross-lingual mate	`665K`	28.6%

{
  "docs": {
    "count": 1413945,
    "fields": {
      "doc_id": {
        "max_len": 7,
        "common_prefix": ""
      }
    }
  },
  "queries": {
    "count": 664924
  },
  "qrels": {
    "count": 2321384,
    "fields": {
      "relevance": {
        "counts_by_value": {
          "2": 664780,
          "1": 1656604
        }
      }
    }
  }
}

`"wikiclir/sv"`

WikiCLIR with Swedish documents.

queries docs qrels Citation Metadata

639K queries

Language: en

Query type:

GenericQuery: (namedtuple)

query_id: str
text: str

Examples:

Python API CLI PyTerrier

import ir_datasets
dataset = ir_datasets.load("wikiclir/sv")
for query in dataset.queries_iter():
    query # namedtuple<query_id, text>

You can find more details about the Python API here.

ir_datasets export wikiclir/sv queries



[query_id]    [text]
...

You can find more details about the CLI here.

Rel.	Definition	Count	%
1	All other articles that link to the mate, and are linked by the mate	`1.4M`	69.1%
2	Document assigned to the (English) cross-lingual mate	`639K`	30.9%

{
  "docs": {
    "count": 3785412,
    "fields": {
      "doc_id": {
        "max_len": 7,
        "common_prefix": ""
      }
    }
  },
  "queries": {
    "count": 639073
  },
  "qrels": {
    "count": 2069453,
    "fields": {
      "relevance": {
        "counts_by_value": {
          "2": 638829,
          "1": 1430624
        }
      }
    }
  }
}

`"wikiclir/sw"`

WikiCLIR with Swahili documents.

queries docs qrels Citation Metadata

23K queries

Language: en

Query type:

GenericQuery: (namedtuple)

query_id: str
text: str

Examples:

Python API CLI PyTerrier

import ir_datasets
dataset = ir_datasets.load("wikiclir/sw")
for query in dataset.queries_iter():
    query # namedtuple<query_id, text>

You can find more details about the Python API here.

ir_datasets export wikiclir/sw queries



[query_id]    [text]
...

You can find more details about the CLI here.

Rel.	Definition	Count	%
1	All other articles that link to the mate, and are linked by the mate	`35K`	60.5%
2	Document assigned to the (English) cross-lingual mate	`23K`	39.5%

{
  "docs": {
    "count": 37079,
    "fields": {
      "doc_id": {
        "max_len": 5,
        "common_prefix": ""
      }
    }
  },
  "queries": {
    "count": 22860
  },
  "qrels": {
    "count": 57924,
    "fields": {
      "relevance": {
        "counts_by_value": {
          "2": 22859,
          "1": 35065
        }
      }
    }
  }
}

`"wikiclir/tl"`

WikiCLIR with Tagalog documents.

queries docs qrels Citation Metadata

49K queries

Language: en

Query type:

GenericQuery: (namedtuple)

query_id: str
text: str

Examples:

Python API CLI PyTerrier

import ir_datasets
dataset = ir_datasets.load("wikiclir/tl")
for query in dataset.queries_iter():
    query # namedtuple<query_id, text>

You can find more details about the Python API here.

ir_datasets export wikiclir/tl queries



[query_id]    [text]
...

You can find more details about the CLI here.

Rel.	Definition	Count	%
1	All other articles that link to the mate, and are linked by the mate	`23K`	32.4%
2	Document assigned to the (English) cross-lingual mate	`49K`	67.6%

{
  "docs": {
    "count": 79008,
    "fields": {
      "doc_id": {
        "max_len": 6,
        "common_prefix": ""
      }
    }
  },
  "queries": {
    "count": 48930
  },
  "qrels": {
    "count": 72359,
    "fields": {
      "relevance": {
        "counts_by_value": {
          "2": 48928,
          "1": 23431
        }
      }
    }
  }
}

`"wikiclir/tr"`

WikiCLIR with Turkish documents.

queries docs qrels Citation Metadata

185K queries

Language: en

Query type:

GenericQuery: (namedtuple)

query_id: str
text: str

Examples:

Python API CLI PyTerrier

import ir_datasets
dataset = ir_datasets.load("wikiclir/tr")
for query in dataset.queries_iter():
    query # namedtuple<query_id, text>

You can find more details about the Python API here.

ir_datasets export wikiclir/tr queries



[query_id]    [text]
...

You can find more details about the CLI here.

Rel.	Definition	Count	%
1	All other articles that link to the mate, and are linked by the mate	`195K`	51.3%
2	Document assigned to the (English) cross-lingual mate	`185K`	48.7%

{
  "docs": {
    "count": 295593,
    "fields": {
      "doc_id": {
        "max_len": 7,
        "common_prefix": ""
      }
    }
  },
  "queries": {
    "count": 185388
  },
  "qrels": {
    "count": 380651,
    "fields": {
      "relevance": {
        "counts_by_value": {
          "2": 185360,
          "1": 195291
        }
      }
    }
  }
}

`"wikiclir/uk"`

WikiCLIR with Ukrainian documents.

queries docs qrels Citation Metadata

348K queries

Language: en

Query type:

GenericQuery: (namedtuple)

query_id: str
text: str

Examples:

Python API CLI PyTerrier

import ir_datasets
dataset = ir_datasets.load("wikiclir/uk")
for query in dataset.queries_iter():
    query # namedtuple<query_id, text>

You can find more details about the Python API here.

ir_datasets export wikiclir/uk queries



[query_id]    [text]
...

You can find more details about the CLI here.

Rel.	Definition	Count	%
1	All other articles that link to the mate, and are linked by the mate	`565K`	61.9%
2	Document assigned to the (English) cross-lingual mate	`348K`	38.1%

{
  "docs": {
    "count": 704903,
    "fields": {
      "doc_id": {
        "max_len": 7,
        "common_prefix": ""
      }
    }
  },
  "queries": {
    "count": 348222
  },
  "qrels": {
    "count": 913358,
    "fields": {
      "relevance": {
        "counts_by_value": {
          "2": 348168,
          "1": 565190
        }
      }
    }
  }
}

`"wikiclir/vi"`

WikiCLIR with Vietnamese documents.

queries docs qrels Citation Metadata

354K queries

Language: en

Query type:

GenericQuery: (namedtuple)

query_id: str
text: str

Examples:

Python API CLI PyTerrier

import ir_datasets
dataset = ir_datasets.load("wikiclir/vi")
for query in dataset.queries_iter():
    query # namedtuple<query_id, text>

You can find more details about the Python API here.

ir_datasets export wikiclir/vi queries



[query_id]    [text]
...

You can find more details about the CLI here.

Rel.	Definition	Count	%
1	All other articles that link to the mate, and are linked by the mate	`257K`	42.1%
2	Document assigned to the (English) cross-lingual mate	`354K`	57.9%

{
  "docs": {
    "count": 1392152,
    "fields": {
      "doc_id": {
        "max_len": 7,
        "common_prefix": ""
      }
    }
  },
  "queries": {
    "count": 354312
  },
  "qrels": {
    "count": 611355,
    "fields": {
      "relevance": {
        "counts_by_value": {
          "2": 354279,
          "1": 257076
        }
      }
    }
  }
}

`"wikiclir/zh"`

WikiCLIR with Chinese documents.

queries docs qrels Citation Metadata

463K queries

Language: en

Query type:

GenericQuery: (namedtuple)

query_id: str
text: str

Examples:

Python API CLI PyTerrier

import ir_datasets
dataset = ir_datasets.load("wikiclir/zh")
for query in dataset.queries_iter():
    query # namedtuple<query_id, text>

You can find more details about the Python API here.

ir_datasets export wikiclir/zh queries



[query_id]    [text]
...

You can find more details about the CLI here.

Rel.	Definition	Count	%
1	All other articles that link to the mate, and are linked by the mate	`463K`	50.0%
2	Document assigned to the (English) cross-lingual mate	`463K`	50.0%

{
  "docs": {
    "count": 951480,
    "fields": {
      "doc_id": {
        "max_len": 7,
        "common_prefix": ""
      }
    }
  },
  "queries": {
    "count": 463273
  },
  "qrels": {
    "count": 926130,
    "fields": {
      "relevance": {
        "counts_by_value": {
          "2": 463209,
          "1": 462921
        }
      }
    }
  }
}

ir_datasets: WikiCLIR

"wikiclir"

"wikiclir/ar"

"wikiclir/ca"

"wikiclir/cs"

"wikiclir/de"

"wikiclir/en-simple"

"wikiclir/es"

"wikiclir/fi"

"wikiclir/fr"

"wikiclir/it"

"wikiclir/ja"

"wikiclir/ko"

"wikiclir/nl"

"wikiclir/nn"

"wikiclir/no"

"wikiclir/pl"

"wikiclir/pt"

"wikiclir/ro"

"wikiclir/ru"

"wikiclir/sv"

"wikiclir/sw"

"wikiclir/tl"

"wikiclir/tr"

"wikiclir/uk"

"wikiclir/vi"

"wikiclir/zh"

`ir_datasets`: WikiCLIR

`"wikiclir"`

`"wikiclir/ar"`

`"wikiclir/ca"`

`"wikiclir/cs"`

`"wikiclir/de"`

`"wikiclir/en-simple"`

`"wikiclir/es"`

`"wikiclir/fi"`

`"wikiclir/fr"`

`"wikiclir/it"`

`"wikiclir/ja"`

`"wikiclir/ko"`

`"wikiclir/nl"`

`"wikiclir/nn"`

`"wikiclir/no"`

`"wikiclir/pl"`

`"wikiclir/pt"`

`"wikiclir/ro"`

`"wikiclir/ru"`

`"wikiclir/sv"`

`"wikiclir/sw"`

`"wikiclir/tl"`

`"wikiclir/tr"`

`"wikiclir/uk"`

`"wikiclir/vi"`

`"wikiclir/zh"`