Mr. TyDi - ir_datasets

`"mr-tydi"`

A multi-lingual benchmark benchmark suite constructed from the TyDi QA Benchmark. Relevance labels are sparsely assigned based on shallow human annotation.

Dataset paper

Citation

ir_datasets.bib:

\cite{Zhang2021MrTyDi,Clark2020TyDiQa}

Bibtex:

@article{Zhang2021MrTyDi, title={{Mr. TyDi}: A Multi-lingual Benchmark for Dense Retrieval}, author={Xinyu Zhang and Xueguang Ma and Peng Shi and Jimmy Lin}, year={2021}, journal={arXiv:2108.08787}, } @article{Clark2020TyDiQa, title={{TyDi QA}: A Benchmark for Information-Seeking Question Answering in Typologically Diverse Languages}, author={Jonathan H. Clark and Eunsol Choi and Michael Collins and Dan Garrette and Tom Kwiatkowski and Vitaly Nikolaev and Jennimaria Palomaki}, year={2020}, journal={Transactions of the Association for Computational Linguistics} }

`"mr-tydi/ar"`

Complete Arabic dataset, including all train, dev, and test queries and qrels.

queries docs qrels Citation Metadata

17K queries

Language: ar

Query type:

GenericQuery: (namedtuple)

query_id: str
text: str

Examples:

Python API CLI PyTerrier

import ir_datasets
dataset = ir_datasets.load("mr-tydi/ar")
for query in dataset.queries_iter():
    query # namedtuple<query_id, text>

You can find more details about the Python API here.

ir_datasets export mr-tydi/ar queries



[query_id]    [text]
...

You can find more details about the CLI here.

Rel.	Definition	Count	%
1	Passage identified within Wikipedia article from top Google search results	`17K`	100.0%

{
  "docs": {
    "count": 2106586,
    "fields": {
      "doc_id": {
        "max_len": 11,
        "common_prefix": ""
      }
    }
  },
  "queries": {
    "count": 16595
  },
  "qrels": {
    "count": 16749,
    "fields": {
      "relevance": {
        "counts_by_value": {
          "1": 16749
        }
      }
    }
  }
}

`"mr-tydi/ar/dev"`

Development set for Arabic

queries docs qrels Citation Metadata

3.1K queries

Language: ar

Query type:

GenericQuery: (namedtuple)

query_id: str
text: str

Examples:

Python API CLI PyTerrier

import ir_datasets
dataset = ir_datasets.load("mr-tydi/ar/dev")
for query in dataset.queries_iter():
    query # namedtuple<query_id, text>

You can find more details about the Python API here.

ir_datasets export mr-tydi/ar/dev queries



[query_id]    [text]
...

You can find more details about the CLI here.

Rel.	Definition	Count	%
1	Passage identified within Wikipedia article from top Google search results	`3.1K`	100.0%

{
  "docs": {
    "count": 2106586,
    "fields": {
      "doc_id": {
        "max_len": 11,
        "common_prefix": ""
      }
    }
  },
  "queries": {
    "count": 3115
  },
  "qrels": {
    "count": 3115,
    "fields": {
      "relevance": {
        "counts_by_value": {
          "1": 3115
        }
      }
    }
  }
}

`"mr-tydi/ar/test"`

Test set for Arabic

queries docs qrels Citation Metadata

1.1K queries

Language: ar

Query type:

GenericQuery: (namedtuple)

query_id: str
text: str

Examples:

Python API CLI PyTerrier

import ir_datasets
dataset = ir_datasets.load("mr-tydi/ar/test")
for query in dataset.queries_iter():
    query # namedtuple<query_id, text>

You can find more details about the Python API here.

ir_datasets export mr-tydi/ar/test queries



[query_id]    [text]
...

You can find more details about the CLI here.

Rel.	Definition	Count	%
1	Passage identified within Wikipedia article from top Google search results	`1.3K`	100.0%

{
  "docs": {
    "count": 2106586,
    "fields": {
      "doc_id": {
        "max_len": 11,
        "common_prefix": ""
      }
    }
  },
  "queries": {
    "count": 1081
  },
  "qrels": {
    "count": 1257,
    "fields": {
      "relevance": {
        "counts_by_value": {
          "1": 1257
        }
      }
    }
  }
}

`"mr-tydi/ar/train"`

Train set for Arabic

queries docs qrels Citation Metadata

12K queries

Language: ar

Query type:

GenericQuery: (namedtuple)

query_id: str
text: str

Examples:

Python API CLI PyTerrier

import ir_datasets
dataset = ir_datasets.load("mr-tydi/ar/train")
for query in dataset.queries_iter():
    query # namedtuple<query_id, text>

You can find more details about the Python API here.

ir_datasets export mr-tydi/ar/train queries



[query_id]    [text]
...

You can find more details about the CLI here.

Rel.	Definition	Count	%
1	Passage identified within Wikipedia article from top Google search results	`12K`	100.0%

{
  "docs": {
    "count": 2106586,
    "fields": {
      "doc_id": {
        "max_len": 11,
        "common_prefix": ""
      }
    }
  },
  "queries": {
    "count": 12377
  },
  "qrels": {
    "count": 12377,
    "fields": {
      "relevance": {
        "counts_by_value": {
          "1": 12377
        }
      }
    }
  }
}

`"mr-tydi/bn"`

Complete Bengali dataset, including all train, dev, and test queries and qrels.

queries docs qrels Citation Metadata

2.3K queries

Language: bn

Query type:

GenericQuery: (namedtuple)

query_id: str
text: str

Examples:

Python API CLI PyTerrier

import ir_datasets
dataset = ir_datasets.load("mr-tydi/bn")
for query in dataset.queries_iter():
    query # namedtuple<query_id, text>

You can find more details about the Python API here.

ir_datasets export mr-tydi/bn queries



[query_id]    [text]
...

You can find more details about the CLI here.

Rel.	Definition	Count	%
1	Passage identified within Wikipedia article from top Google search results	`2.3K`	100.0%

{
  "docs": {
    "count": 304059,
    "fields": {
      "doc_id": {
        "max_len": 10,
        "common_prefix": ""
      }
    }
  },
  "queries": {
    "count": 2264
  },
  "qrels": {
    "count": 2292,
    "fields": {
      "relevance": {
        "counts_by_value": {
          "1": 2292
        }
      }
    }
  }
}

`"mr-tydi/bn/dev"`

Development set for Bengali

queries docs qrels Citation Metadata

440 queries

Language: bn

Query type:

GenericQuery: (namedtuple)

query_id: str
text: str

Examples:

Python API CLI PyTerrier

import ir_datasets
dataset = ir_datasets.load("mr-tydi/bn/dev")
for query in dataset.queries_iter():
    query # namedtuple<query_id, text>

You can find more details about the Python API here.

ir_datasets export mr-tydi/bn/dev queries



[query_id]    [text]
...

You can find more details about the CLI here.

Rel.	Definition	Count	%
1	Passage identified within Wikipedia article from top Google search results	`443`	100.0%

{
  "docs": {
    "count": 304059,
    "fields": {
      "doc_id": {
        "max_len": 10,
        "common_prefix": ""
      }
    }
  },
  "queries": {
    "count": 440
  },
  "qrels": {
    "count": 443,
    "fields": {
      "relevance": {
        "counts_by_value": {
          "1": 443
        }
      }
    }
  }
}

`"mr-tydi/bn/test"`

Test set for Bengali

queries docs qrels Citation Metadata

111 queries

Language: bn

Query type:

GenericQuery: (namedtuple)

query_id: str
text: str

Examples:

Python API CLI PyTerrier

import ir_datasets
dataset = ir_datasets.load("mr-tydi/bn/test")
for query in dataset.queries_iter():
    query # namedtuple<query_id, text>

You can find more details about the Python API here.

ir_datasets export mr-tydi/bn/test queries



[query_id]    [text]
...

You can find more details about the CLI here.

Rel.	Definition	Count	%
1	Passage identified within Wikipedia article from top Google search results	`130`	100.0%

{
  "docs": {
    "count": 304059,
    "fields": {
      "doc_id": {
        "max_len": 10,
        "common_prefix": ""
      }
    }
  },
  "queries": {
    "count": 111
  },
  "qrels": {
    "count": 130,
    "fields": {
      "relevance": {
        "counts_by_value": {
          "1": 130
        }
      }
    }
  }
}

`"mr-tydi/bn/train"`

Train set for Bengali

queries docs qrels Citation Metadata

1.7K queries

Language: bn

Query type:

GenericQuery: (namedtuple)

query_id: str
text: str

Examples:

Python API CLI PyTerrier

import ir_datasets
dataset = ir_datasets.load("mr-tydi/bn/train")
for query in dataset.queries_iter():
    query # namedtuple<query_id, text>

You can find more details about the Python API here.

ir_datasets export mr-tydi/bn/train queries



[query_id]    [text]
...

You can find more details about the CLI here.

Rel.	Definition	Count	%
1	Passage identified within Wikipedia article from top Google search results	`1.7K`	100.0%

{
  "docs": {
    "count": 304059,
    "fields": {
      "doc_id": {
        "max_len": 10,
        "common_prefix": ""
      }
    }
  },
  "queries": {
    "count": 1713
  },
  "qrels": {
    "count": 1719,
    "fields": {
      "relevance": {
        "counts_by_value": {
          "1": 1719
        }
      }
    }
  }
}

`"mr-tydi/en"`

Complete English dataset, including all train, dev, and test queries and qrels.

queries docs qrels Citation Metadata

5.2K queries

Language: en

Query type:

GenericQuery: (namedtuple)

query_id: str
text: str

Examples:

Python API CLI PyTerrier

import ir_datasets
dataset = ir_datasets.load("mr-tydi/en")
for query in dataset.queries_iter():
    query # namedtuple<query_id, text>

You can find more details about the Python API here.

ir_datasets export mr-tydi/en queries



[query_id]    [text]
...

You can find more details about the CLI here.

Rel.	Definition	Count	%
1	Passage identified within Wikipedia article from top Google search results	`5.4K`	100.0%

{
  "docs": {
    "count": 32907100,
    "fields": {
      "doc_id": {
        "max_len": 13,
        "common_prefix": ""
      }
    }
  },
  "queries": {
    "count": 5194
  },
  "qrels": {
    "count": 5360,
    "fields": {
      "relevance": {
        "counts_by_value": {
          "1": 5360
        }
      }
    }
  }
}

`"mr-tydi/en/dev"`

Development set for English

queries docs qrels Citation Metadata

878 queries

Language: en

Query type:

GenericQuery: (namedtuple)

query_id: str
text: str

Examples:

Python API CLI PyTerrier

import ir_datasets
dataset = ir_datasets.load("mr-tydi/en/dev")
for query in dataset.queries_iter():
    query # namedtuple<query_id, text>

You can find more details about the Python API here.

ir_datasets export mr-tydi/en/dev queries



[query_id]    [text]
...

You can find more details about the CLI here.

Rel.	Definition	Count	%
1	Passage identified within Wikipedia article from top Google search results	`878`	100.0%

{
  "docs": {
    "count": 32907100,
    "fields": {
      "doc_id": {
        "max_len": 13,
        "common_prefix": ""
      }
    }
  },
  "queries": {
    "count": 878
  },
  "qrels": {
    "count": 878,
    "fields": {
      "relevance": {
        "counts_by_value": {
          "1": 878
        }
      }
    }
  }
}

`"mr-tydi/en/test"`

Test set for English

queries docs qrels Citation Metadata

744 queries

Language: en

Query type:

GenericQuery: (namedtuple)

query_id: str
text: str

Examples:

Python API CLI PyTerrier

import ir_datasets
dataset = ir_datasets.load("mr-tydi/en/test")
for query in dataset.queries_iter():
    query # namedtuple<query_id, text>

You can find more details about the Python API here.

ir_datasets export mr-tydi/en/test queries



[query_id]    [text]
...

You can find more details about the CLI here.

Rel.	Definition	Count	%
1	Passage identified within Wikipedia article from top Google search results	`935`	100.0%

{
  "docs": {
    "count": 32907100,
    "fields": {
      "doc_id": {
        "max_len": 13,
        "common_prefix": ""
      }
    }
  },
  "queries": {
    "count": 744
  },
  "qrels": {
    "count": 935,
    "fields": {
      "relevance": {
        "counts_by_value": {
          "1": 935
        }
      }
    }
  }
}

`"mr-tydi/en/train"`

Train set for English

queries docs qrels Citation Metadata

3.5K queries

Language: en

Query type:

GenericQuery: (namedtuple)

query_id: str
text: str

Examples:

Python API CLI PyTerrier

import ir_datasets
dataset = ir_datasets.load("mr-tydi/en/train")
for query in dataset.queries_iter():
    query # namedtuple<query_id, text>

You can find more details about the Python API here.

ir_datasets export mr-tydi/en/train queries



[query_id]    [text]
...

You can find more details about the CLI here.

Rel.	Definition	Count	%
1	Passage identified within Wikipedia article from top Google search results	`3.5K`	100.0%

{
  "docs": {
    "count": 32907100,
    "fields": {
      "doc_id": {
        "max_len": 13,
        "common_prefix": ""
      }
    }
  },
  "queries": {
    "count": 3547
  },
  "qrels": {
    "count": 3547,
    "fields": {
      "relevance": {
        "counts_by_value": {
          "1": 3547
        }
      }
    }
  }
}

`"mr-tydi/fi"`

Complete Finnish dataset, including all train, dev, and test queries and qrels.

queries docs qrels Citation Metadata

9.6K queries

Language: fi

Query type:

GenericQuery: (namedtuple)

query_id: str
text: str

Examples:

Python API CLI PyTerrier

import ir_datasets
dataset = ir_datasets.load("mr-tydi/fi")
for query in dataset.queries_iter():
    query # namedtuple<query_id, text>

You can find more details about the Python API here.

ir_datasets export mr-tydi/fi queries



[query_id]    [text]
...

You can find more details about the CLI here.

Rel.	Definition	Count	%
1	Passage identified within Wikipedia article from top Google search results	`9.8K`	100.0%

{
  "docs": {
    "count": 1908757,
    "fields": {
      "doc_id": {
        "max_len": 11,
        "common_prefix": ""
      }
    }
  },
  "queries": {
    "count": 9572
  },
  "qrels": {
    "count": 9750,
    "fields": {
      "relevance": {
        "counts_by_value": {
          "1": 9750
        }
      }
    }
  }
}

`"mr-tydi/fi/dev"`

Development set for Finnish

queries docs qrels Citation Metadata

1.7K queries

Language: fi

Query type:

GenericQuery: (namedtuple)

query_id: str
text: str

Examples:

Python API CLI PyTerrier

import ir_datasets
dataset = ir_datasets.load("mr-tydi/fi/dev")
for query in dataset.queries_iter():
    query # namedtuple<query_id, text>

You can find more details about the Python API here.

ir_datasets export mr-tydi/fi/dev queries



[query_id]    [text]
...

You can find more details about the CLI here.

Rel.	Definition	Count	%
1	Passage identified within Wikipedia article from top Google search results	`1.7K`	100.0%

{
  "docs": {
    "count": 1908757,
    "fields": {
      "doc_id": {
        "max_len": 11,
        "common_prefix": ""
      }
    }
  },
  "queries": {
    "count": 1738
  },
  "qrels": {
    "count": 1738,
    "fields": {
      "relevance": {
        "counts_by_value": {
          "1": 1738
        }
      }
    }
  }
}

`"mr-tydi/fi/test"`

Test set for Finnish

queries docs qrels Citation Metadata

1.3K queries

Language: fi

Query type:

GenericQuery: (namedtuple)

query_id: str
text: str

Examples:

Python API CLI PyTerrier

import ir_datasets
dataset = ir_datasets.load("mr-tydi/fi/test")
for query in dataset.queries_iter():
    query # namedtuple<query_id, text>

You can find more details about the Python API here.

ir_datasets export mr-tydi/fi/test queries



[query_id]    [text]
...

You can find more details about the CLI here.

Rel.	Definition	Count	%
1	Passage identified within Wikipedia article from top Google search results	`1.5K`	100.0%

{
  "docs": {
    "count": 1908757,
    "fields": {
      "doc_id": {
        "max_len": 11,
        "common_prefix": ""
      }
    }
  },
  "queries": {
    "count": 1254
  },
  "qrels": {
    "count": 1451,
    "fields": {
      "relevance": {
        "counts_by_value": {
          "1": 1451
        }
      }
    }
  }
}

`"mr-tydi/fi/train"`

Train set for Finnish

queries docs qrels Citation Metadata

6.6K queries

Language: fi

Query type:

GenericQuery: (namedtuple)

query_id: str
text: str

Examples:

Python API CLI PyTerrier

import ir_datasets
dataset = ir_datasets.load("mr-tydi/fi/train")
for query in dataset.queries_iter():
    query # namedtuple<query_id, text>

You can find more details about the Python API here.

ir_datasets export mr-tydi/fi/train queries



[query_id]    [text]
...

You can find more details about the CLI here.

Rel.	Definition	Count	%
1	Passage identified within Wikipedia article from top Google search results	`6.6K`	100.0%

{
  "docs": {
    "count": 1908757,
    "fields": {
      "doc_id": {
        "max_len": 11,
        "common_prefix": ""
      }
    }
  },
  "queries": {
    "count": 6561
  },
  "qrels": {
    "count": 6561,
    "fields": {
      "relevance": {
        "counts_by_value": {
          "1": 6561
        }
      }
    }
  }
}

`"mr-tydi/id"`

Complete Indonesian dataset, including all train, dev, and test queries and qrels.

queries docs qrels Citation Metadata

7.0K queries

Language: id

Query type:

GenericQuery: (namedtuple)

query_id: str
text: str

Examples:

Python API CLI PyTerrier

import ir_datasets
dataset = ir_datasets.load("mr-tydi/id")
for query in dataset.queries_iter():
    query # namedtuple<query_id, text>

You can find more details about the Python API here.

ir_datasets export mr-tydi/id queries



[query_id]    [text]
...

You can find more details about the CLI here.

Rel.	Definition	Count	%
1	Passage identified within Wikipedia article from top Google search results	`7.1K`	100.0%

{
  "docs": {
    "count": 1469399,
    "fields": {
      "doc_id": {
        "max_len": 11,
        "common_prefix": ""
      }
    }
  },
  "queries": {
    "count": 6977
  },
  "qrels": {
    "count": 7087,
    "fields": {
      "relevance": {
        "counts_by_value": {
          "1": 7087
        }
      }
    }
  }
}

`"mr-tydi/id/dev"`

Development set for Indonesian

queries docs qrels Citation Metadata

1.2K queries

Language: id

Query type:

GenericQuery: (namedtuple)

query_id: str
text: str

Examples:

Python API CLI PyTerrier

import ir_datasets
dataset = ir_datasets.load("mr-tydi/id/dev")
for query in dataset.queries_iter():
    query # namedtuple<query_id, text>

You can find more details about the Python API here.

ir_datasets export mr-tydi/id/dev queries



[query_id]    [text]
...

You can find more details about the CLI here.

Rel.	Definition	Count	%
1	Passage identified within Wikipedia article from top Google search results	`1.2K`	100.0%

{
  "docs": {
    "count": 1469399,
    "fields": {
      "doc_id": {
        "max_len": 11,
        "common_prefix": ""
      }
    }
  },
  "queries": {
    "count": 1224
  },
  "qrels": {
    "count": 1224,
    "fields": {
      "relevance": {
        "counts_by_value": {
          "1": 1224
        }
      }
    }
  }
}

`"mr-tydi/id/test"`

Test set for Indonesian

queries docs qrels Citation Metadata

829 queries

Language: id

Query type:

GenericQuery: (namedtuple)

query_id: str
text: str

Examples:

Python API CLI PyTerrier

import ir_datasets
dataset = ir_datasets.load("mr-tydi/id/test")
for query in dataset.queries_iter():
    query # namedtuple<query_id, text>

You can find more details about the Python API here.

ir_datasets export mr-tydi/id/test queries



[query_id]    [text]
...

You can find more details about the CLI here.

Rel.	Definition	Count	%
1	Passage identified within Wikipedia article from top Google search results	`961`	100.0%

{
  "docs": {
    "count": 1469399,
    "fields": {
      "doc_id": {
        "max_len": 11,
        "common_prefix": ""
      }
    }
  },
  "queries": {
    "count": 829
  },
  "qrels": {
    "count": 961,
    "fields": {
      "relevance": {
        "counts_by_value": {
          "1": 961
        }
      }
    }
  }
}

`"mr-tydi/id/train"`

Train set for Indonesian

queries docs qrels Citation Metadata

4.9K queries

Language: id

Query type:

GenericQuery: (namedtuple)

query_id: str
text: str

Examples:

Python API CLI PyTerrier

import ir_datasets
dataset = ir_datasets.load("mr-tydi/id/train")
for query in dataset.queries_iter():
    query # namedtuple<query_id, text>

You can find more details about the Python API here.

ir_datasets export mr-tydi/id/train queries



[query_id]    [text]
...

You can find more details about the CLI here.

Rel.	Definition	Count	%
1	Passage identified within Wikipedia article from top Google search results	`4.9K`	100.0%

{
  "docs": {
    "count": 1469399,
    "fields": {
      "doc_id": {
        "max_len": 11,
        "common_prefix": ""
      }
    }
  },
  "queries": {
    "count": 4902
  },
  "qrels": {
    "count": 4902,
    "fields": {
      "relevance": {
        "counts_by_value": {
          "1": 4902
        }
      }
    }
  }
}

`"mr-tydi/ja"`

Complete Japanese dataset, including all train, dev, and test queries and qrels.

queries docs qrels Citation Metadata

5.4K queries

Language: ja

Query type:

GenericQuery: (namedtuple)

query_id: str
text: str

Examples:

Python API CLI PyTerrier

import ir_datasets
dataset = ir_datasets.load("mr-tydi/ja")
for query in dataset.queries_iter():
    query # namedtuple<query_id, text>

You can find more details about the Python API here.

ir_datasets export mr-tydi/ja queries



[query_id]    [text]
...

You can find more details about the CLI here.

Rel.	Definition	Count	%
1	Passage identified within Wikipedia article from top Google search results	`5.5K`	100.0%

{
  "docs": {
    "count": 7000027,
    "fields": {
      "doc_id": {
        "max_len": 12,
        "common_prefix": ""
      }
    }
  },
  "queries": {
    "count": 5353
  },
  "qrels": {
    "count": 5548,
    "fields": {
      "relevance": {
        "counts_by_value": {
          "1": 5548
        }
      }
    }
  }
}

`"mr-tydi/ja/dev"`

Development set for Japanese

queries docs qrels Citation Metadata

928 queries

Language: ja

Query type:

GenericQuery: (namedtuple)

query_id: str
text: str

Examples:

Python API CLI PyTerrier

import ir_datasets
dataset = ir_datasets.load("mr-tydi/ja/dev")
for query in dataset.queries_iter():
    query # namedtuple<query_id, text>

You can find more details about the Python API here.

ir_datasets export mr-tydi/ja/dev queries



[query_id]    [text]
...

You can find more details about the CLI here.

Rel.	Definition	Count	%
1	Passage identified within Wikipedia article from top Google search results	`928`	100.0%

{
  "docs": {
    "count": 7000027,
    "fields": {
      "doc_id": {
        "max_len": 12,
        "common_prefix": ""
      }
    }
  },
  "queries": {
    "count": 928
  },
  "qrels": {
    "count": 928,
    "fields": {
      "relevance": {
        "counts_by_value": {
          "1": 928
        }
      }
    }
  }
}

`"mr-tydi/ja/test"`

Test set for Japanese

queries docs qrels Citation Metadata

720 queries

Language: ja

Query type:

GenericQuery: (namedtuple)

query_id: str
text: str

Examples:

Python API CLI PyTerrier

import ir_datasets
dataset = ir_datasets.load("mr-tydi/ja/test")
for query in dataset.queries_iter():
    query # namedtuple<query_id, text>

You can find more details about the Python API here.

ir_datasets export mr-tydi/ja/test queries



[query_id]    [text]
...

You can find more details about the CLI here.

Rel.	Definition	Count	%
1	Passage identified within Wikipedia article from top Google search results	`923`	100.0%

{
  "docs": {
    "count": 7000027,
    "fields": {
      "doc_id": {
        "max_len": 12,
        "common_prefix": ""
      }
    }
  },
  "queries": {
    "count": 720
  },
  "qrels": {
    "count": 923,
    "fields": {
      "relevance": {
        "counts_by_value": {
          "1": 923
        }
      }
    }
  }
}

`"mr-tydi/ja/train"`

Train set for Japanese

queries docs qrels Citation Metadata

3.7K queries

Language: ja

Query type:

GenericQuery: (namedtuple)

query_id: str
text: str

Examples:

Python API CLI PyTerrier

import ir_datasets
dataset = ir_datasets.load("mr-tydi/ja/train")
for query in dataset.queries_iter():
    query # namedtuple<query_id, text>

You can find more details about the Python API here.

ir_datasets export mr-tydi/ja/train queries



[query_id]    [text]
...

You can find more details about the CLI here.

Rel.	Definition	Count	%
1	Passage identified within Wikipedia article from top Google search results	`3.7K`	100.0%

{
  "docs": {
    "count": 7000027,
    "fields": {
      "doc_id": {
        "max_len": 12,
        "common_prefix": ""
      }
    }
  },
  "queries": {
    "count": 3697
  },
  "qrels": {
    "count": 3697,
    "fields": {
      "relevance": {
        "counts_by_value": {
          "1": 3697
        }
      }
    }
  }
}

`"mr-tydi/ko"`

Complete Korean dataset, including all train, dev, and test queries and qrels.

queries docs qrels Citation Metadata

2.0K queries

Language: ko

Query type:

GenericQuery: (namedtuple)

query_id: str
text: str

Examples:

Python API CLI PyTerrier

import ir_datasets
dataset = ir_datasets.load("mr-tydi/ko")
for query in dataset.queries_iter():
    query # namedtuple<query_id, text>

You can find more details about the Python API here.

ir_datasets export mr-tydi/ko queries



[query_id]    [text]
...

You can find more details about the CLI here.

Rel.	Definition	Count	%
1	Passage identified within Wikipedia article from top Google search results	`2.1K`	100.0%

{
  "docs": {
    "count": 1496126,
    "fields": {
      "doc_id": {
        "max_len": 12,
        "common_prefix": ""
      }
    }
  },
  "queries": {
    "count": 2019
  },
  "qrels": {
    "count": 2116,
    "fields": {
      "relevance": {
        "counts_by_value": {
          "1": 2116
        }
      }
    }
  }
}

`"mr-tydi/ko/dev"`

Development set for Korean

queries docs qrels Citation Metadata

303 queries

Language: ko

Query type:

GenericQuery: (namedtuple)

query_id: str
text: str

Examples:

Python API CLI PyTerrier

import ir_datasets
dataset = ir_datasets.load("mr-tydi/ko/dev")
for query in dataset.queries_iter():
    query # namedtuple<query_id, text>

You can find more details about the Python API here.

ir_datasets export mr-tydi/ko/dev queries



[query_id]    [text]
...

You can find more details about the CLI here.

Rel.	Definition	Count	%
1	Passage identified within Wikipedia article from top Google search results	`307`	100.0%

{
  "docs": {
    "count": 1496126,
    "fields": {
      "doc_id": {
        "max_len": 12,
        "common_prefix": ""
      }
    }
  },
  "queries": {
    "count": 303
  },
  "qrels": {
    "count": 307,
    "fields": {
      "relevance": {
        "counts_by_value": {
          "1": 307
        }
      }
    }
  }
}

`"mr-tydi/ko/test"`

Test set for Korean

queries docs qrels Citation Metadata

421 queries

Language: ko

Query type:

GenericQuery: (namedtuple)

query_id: str
text: str

Examples:

Python API CLI PyTerrier

import ir_datasets
dataset = ir_datasets.load("mr-tydi/ko/test")
for query in dataset.queries_iter():
    query # namedtuple<query_id, text>

You can find more details about the Python API here.

ir_datasets export mr-tydi/ko/test queries



[query_id]    [text]
...

You can find more details about the CLI here.

Rel.	Definition	Count	%
1	Passage identified within Wikipedia article from top Google search results	`492`	100.0%

{
  "docs": {
    "count": 1496126,
    "fields": {
      "doc_id": {
        "max_len": 12,
        "common_prefix": ""
      }
    }
  },
  "queries": {
    "count": 421
  },
  "qrels": {
    "count": 492,
    "fields": {
      "relevance": {
        "counts_by_value": {
          "1": 492
        }
      }
    }
  }
}

`"mr-tydi/ko/train"`

Train set for Korean

queries docs qrels Citation Metadata

1.3K queries

Language: ko

Query type:

GenericQuery: (namedtuple)

query_id: str
text: str

Examples:

Python API CLI PyTerrier

import ir_datasets
dataset = ir_datasets.load("mr-tydi/ko/train")
for query in dataset.queries_iter():
    query # namedtuple<query_id, text>

You can find more details about the Python API here.

ir_datasets export mr-tydi/ko/train queries



[query_id]    [text]
...

You can find more details about the CLI here.

Rel.	Definition	Count	%
1	Passage identified within Wikipedia article from top Google search results	`1.3K`	100.0%

{
  "docs": {
    "count": 1496126,
    "fields": {
      "doc_id": {
        "max_len": 12,
        "common_prefix": ""
      }
    }
  },
  "queries": {
    "count": 1295
  },
  "qrels": {
    "count": 1317,
    "fields": {
      "relevance": {
        "counts_by_value": {
          "1": 1317
        }
      }
    }
  }
}

`"mr-tydi/ru"`

Complete Russian dataset, including all train, dev, and test queries and qrels.

queries docs qrels Citation Metadata

7.8K queries

Language: ru

Query type:

GenericQuery: (namedtuple)

query_id: str
text: str

Examples:

Python API CLI PyTerrier

import ir_datasets
dataset = ir_datasets.load("mr-tydi/ru")
for query in dataset.queries_iter():
    query # namedtuple<query_id, text>

You can find more details about the Python API here.

ir_datasets export mr-tydi/ru queries



[query_id]    [text]
...

You can find more details about the CLI here.

Rel.	Definition	Count	%
1	Passage identified within Wikipedia article from top Google search results	`7.9K`	100.0%

{
  "docs": {
    "count": 9597504,
    "fields": {
      "doc_id": {
        "max_len": 12,
        "common_prefix": ""
      }
    }
  },
  "queries": {
    "count": 7763
  },
  "qrels": {
    "count": 7909,
    "fields": {
      "relevance": {
        "counts_by_value": {
          "1": 7909
        }
      }
    }
  }
}

`"mr-tydi/ru/dev"`

Development set for Russian

queries docs qrels Citation Metadata

1.4K queries

Language: ru

Query type:

GenericQuery: (namedtuple)

query_id: str
text: str

Examples:

Python API CLI PyTerrier

import ir_datasets
dataset = ir_datasets.load("mr-tydi/ru/dev")
for query in dataset.queries_iter():
    query # namedtuple<query_id, text>

You can find more details about the Python API here.

ir_datasets export mr-tydi/ru/dev queries



[query_id]    [text]
...

You can find more details about the CLI here.

Rel.	Definition	Count	%
1	Passage identified within Wikipedia article from top Google search results	`1.4K`	100.0%

{
  "docs": {
    "count": 9597504,
    "fields": {
      "doc_id": {
        "max_len": 12,
        "common_prefix": ""
      }
    }
  },
  "queries": {
    "count": 1375
  },
  "qrels": {
    "count": 1375,
    "fields": {
      "relevance": {
        "counts_by_value": {
          "1": 1375
        }
      }
    }
  }
}

`"mr-tydi/ru/test"`

Test set for Russian

queries docs qrels Citation Metadata

995 queries

Language: ru

Query type:

GenericQuery: (namedtuple)

query_id: str
text: str

Examples:

Python API CLI PyTerrier

import ir_datasets
dataset = ir_datasets.load("mr-tydi/ru/test")
for query in dataset.queries_iter():
    query # namedtuple<query_id, text>

You can find more details about the Python API here.

ir_datasets export mr-tydi/ru/test queries



[query_id]    [text]
...

You can find more details about the CLI here.

Rel.	Definition	Count	%
1	Passage identified within Wikipedia article from top Google search results	`1.2K`	100.0%

{
  "docs": {
    "count": 9597504,
    "fields": {
      "doc_id": {
        "max_len": 12,
        "common_prefix": ""
      }
    }
  },
  "queries": {
    "count": 995
  },
  "qrels": {
    "count": 1168,
    "fields": {
      "relevance": {
        "counts_by_value": {
          "1": 1168
        }
      }
    }
  }
}

`"mr-tydi/ru/train"`

Train set for Russian

queries docs qrels Citation Metadata

5.4K queries

Language: ru

Query type:

GenericQuery: (namedtuple)

query_id: str
text: str

Examples:

Python API CLI PyTerrier

import ir_datasets
dataset = ir_datasets.load("mr-tydi/ru/train")
for query in dataset.queries_iter():
    query # namedtuple<query_id, text>

You can find more details about the Python API here.

ir_datasets export mr-tydi/ru/train queries



[query_id]    [text]
...

You can find more details about the CLI here.

Rel.	Definition	Count	%
1	Passage identified within Wikipedia article from top Google search results	`5.4K`	100.0%

{
  "docs": {
    "count": 9597504,
    "fields": {
      "doc_id": {
        "max_len": 12,
        "common_prefix": ""
      }
    }
  },
  "queries": {
    "count": 5366
  },
  "qrels": {
    "count": 5366,
    "fields": {
      "relevance": {
        "counts_by_value": {
          "1": 5366
        }
      }
    }
  }
}

`"mr-tydi/sw"`

Complete Swahili dataset, including all train, dev, and test queries and qrels.

queries docs qrels Citation Metadata

3.3K queries

Language: sw

Query type:

GenericQuery: (namedtuple)

query_id: str
text: str

Examples:

Python API CLI PyTerrier

import ir_datasets
dataset = ir_datasets.load("mr-tydi/sw")
for query in dataset.queries_iter():
    query # namedtuple<query_id, text>

You can find more details about the Python API here.

ir_datasets export mr-tydi/sw queries



[query_id]    [text]
...

You can find more details about the CLI here.

Rel.	Definition	Count	%
1	Passage identified within Wikipedia article from top Google search results	`3.8K`	100.0%

{
  "docs": {
    "count": 136689,
    "fields": {
      "doc_id": {
        "max_len": 9,
        "common_prefix": ""
      }
    }
  },
  "queries": {
    "count": 3271
  },
  "qrels": {
    "count": 3767,
    "fields": {
      "relevance": {
        "counts_by_value": {
          "1": 3767
        }
      }
    }
  }
}

`"mr-tydi/sw/dev"`

Development set for Swahili

queries docs qrels Citation Metadata

526 queries

Language: sw

Query type:

GenericQuery: (namedtuple)

query_id: str
text: str

Examples:

Python API CLI PyTerrier

import ir_datasets
dataset = ir_datasets.load("mr-tydi/sw/dev")
for query in dataset.queries_iter():
    query # namedtuple<query_id, text>

You can find more details about the Python API here.

ir_datasets export mr-tydi/sw/dev queries



[query_id]    [text]
...

You can find more details about the CLI here.

Rel.	Definition	Count	%
1	Passage identified within Wikipedia article from top Google search results	`623`	100.0%

{
  "docs": {
    "count": 136689,
    "fields": {
      "doc_id": {
        "max_len": 9,
        "common_prefix": ""
      }
    }
  },
  "queries": {
    "count": 526
  },
  "qrels": {
    "count": 623,
    "fields": {
      "relevance": {
        "counts_by_value": {
          "1": 623
        }
      }
    }
  }
}

`"mr-tydi/sw/test"`

Test set for Swahili

queries docs qrels Citation Metadata

670 queries

Language: sw

Query type:

GenericQuery: (namedtuple)

query_id: str
text: str

Examples:

Python API CLI PyTerrier

import ir_datasets
dataset = ir_datasets.load("mr-tydi/sw/test")
for query in dataset.queries_iter():
    query # namedtuple<query_id, text>

You can find more details about the Python API here.

ir_datasets export mr-tydi/sw/test queries



[query_id]    [text]
...

You can find more details about the CLI here.

Rel.	Definition	Count	%
1	Passage identified within Wikipedia article from top Google search results	`743`	100.0%

{
  "docs": {
    "count": 136689,
    "fields": {
      "doc_id": {
        "max_len": 9,
        "common_prefix": ""
      }
    }
  },
  "queries": {
    "count": 670
  },
  "qrels": {
    "count": 743,
    "fields": {
      "relevance": {
        "counts_by_value": {
          "1": 743
        }
      }
    }
  }
}

`"mr-tydi/sw/train"`

Train set for Swahili

queries docs qrels Citation Metadata

2.1K queries

Language: sw

Query type:

GenericQuery: (namedtuple)

query_id: str
text: str

Examples:

Python API CLI PyTerrier

import ir_datasets
dataset = ir_datasets.load("mr-tydi/sw/train")
for query in dataset.queries_iter():
    query # namedtuple<query_id, text>

You can find more details about the Python API here.

ir_datasets export mr-tydi/sw/train queries



[query_id]    [text]
...

You can find more details about the CLI here.

Rel.	Definition	Count	%
1	Passage identified within Wikipedia article from top Google search results	`2.4K`	100.0%

{
  "docs": {
    "count": 136689,
    "fields": {
      "doc_id": {
        "max_len": 9,
        "common_prefix": ""
      }
    }
  },
  "queries": {
    "count": 2072
  },
  "qrels": {
    "count": 2401,
    "fields": {
      "relevance": {
        "counts_by_value": {
          "1": 2401
        }
      }
    }
  }
}

`"mr-tydi/te"`

Complete Telugu dataset, including all train, dev, and test queries and qrels.

queries docs qrels Citation Metadata

5.5K queries

Language: te

Query type:

GenericQuery: (namedtuple)

query_id: str
text: str

Examples:

Python API CLI PyTerrier

import ir_datasets
dataset = ir_datasets.load("mr-tydi/te")
for query in dataset.queries_iter():
    query # namedtuple<query_id, text>

You can find more details about the Python API here.

ir_datasets export mr-tydi/te queries



[query_id]    [text]
...

You can find more details about the CLI here.

Rel.	Definition	Count	%
1	Passage identified within Wikipedia article from top Google search results	`5.5K`	100.0%

{
  "docs": {
    "count": 548224,
    "fields": {
      "doc_id": {
        "max_len": 10,
        "common_prefix": ""
      }
    }
  },
  "queries": {
    "count": 5517
  },
  "qrels": {
    "count": 5540,
    "fields": {
      "relevance": {
        "counts_by_value": {
          "1": 5540
        }
      }
    }
  }
}

`"mr-tydi/te/dev"`

Development set for Telugu

queries docs qrels Citation Metadata

983 queries

Language: te

Query type:

GenericQuery: (namedtuple)

query_id: str
text: str

Examples:

Python API CLI PyTerrier

import ir_datasets
dataset = ir_datasets.load("mr-tydi/te/dev")
for query in dataset.queries_iter():
    query # namedtuple<query_id, text>

You can find more details about the Python API here.

ir_datasets export mr-tydi/te/dev queries



[query_id]    [text]
...

You can find more details about the CLI here.

Rel.	Definition	Count	%
1	Passage identified within Wikipedia article from top Google search results	`983`	100.0%

{
  "docs": {
    "count": 548224,
    "fields": {
      "doc_id": {
        "max_len": 10,
        "common_prefix": ""
      }
    }
  },
  "queries": {
    "count": 983
  },
  "qrels": {
    "count": 983,
    "fields": {
      "relevance": {
        "counts_by_value": {
          "1": 983
        }
      }
    }
  }
}

`"mr-tydi/te/test"`

Test set for Telugu

queries docs qrels Citation Metadata

646 queries

Language: te

Query type:

GenericQuery: (namedtuple)

query_id: str
text: str

Examples:

Python API CLI PyTerrier

import ir_datasets
dataset = ir_datasets.load("mr-tydi/te/test")
for query in dataset.queries_iter():
    query # namedtuple<query_id, text>

You can find more details about the Python API here.

ir_datasets export mr-tydi/te/test queries



[query_id]    [text]
...

You can find more details about the CLI here.

Rel.	Definition	Count	%
1	Passage identified within Wikipedia article from top Google search results	`677`	100.0%

{
  "docs": {
    "count": 548224,
    "fields": {
      "doc_id": {
        "max_len": 10,
        "common_prefix": ""
      }
    }
  },
  "queries": {
    "count": 646
  },
  "qrels": {
    "count": 677,
    "fields": {
      "relevance": {
        "counts_by_value": {
          "1": 677
        }
      }
    }
  }
}

`"mr-tydi/te/train"`

Train set for Telugu

queries docs qrels Citation Metadata

3.9K queries

Language: te

Query type:

GenericQuery: (namedtuple)

query_id: str
text: str

Examples:

Python API CLI PyTerrier

import ir_datasets
dataset = ir_datasets.load("mr-tydi/te/train")
for query in dataset.queries_iter():
    query # namedtuple<query_id, text>

You can find more details about the Python API here.

ir_datasets export mr-tydi/te/train queries



[query_id]    [text]
...

You can find more details about the CLI here.

Rel.	Definition	Count	%
1	Passage identified within Wikipedia article from top Google search results	`3.9K`	100.0%

{
  "docs": {
    "count": 548224,
    "fields": {
      "doc_id": {
        "max_len": 10,
        "common_prefix": ""
      }
    }
  },
  "queries": {
    "count": 3880
  },
  "qrels": {
    "count": 3880,
    "fields": {
      "relevance": {
        "counts_by_value": {
          "1": 3880
        }
      }
    }
  }
}

`"mr-tydi/th"`

Complete Thai dataset, including all train, dev, and test queries and qrels.

queries docs qrels Citation Metadata

5.3K queries

Language: th

Query type:

GenericQuery: (namedtuple)

query_id: str
text: str

Examples:

Python API CLI PyTerrier

import ir_datasets
dataset = ir_datasets.load("mr-tydi/th")
for query in dataset.queries_iter():
    query # namedtuple<query_id, text>

You can find more details about the Python API here.

ir_datasets export mr-tydi/th queries



[query_id]    [text]
...

You can find more details about the CLI here.

Rel.	Definition	Count	%
1	Passage identified within Wikipedia article from top Google search results	`5.5K`	100.0%

{
  "docs": {
    "count": 568855,
    "fields": {
      "doc_id": {
        "max_len": 10,
        "common_prefix": ""
      }
    }
  },
  "queries": {
    "count": 5322
  },
  "qrels": {
    "count": 5545,
    "fields": {
      "relevance": {
        "counts_by_value": {
          "1": 5545
        }
      }
    }
  }
}

`"mr-tydi/th/dev"`

Development set for Thai

queries docs qrels Citation Metadata

807 queries

Language: th

Query type:

GenericQuery: (namedtuple)

query_id: str
text: str

Examples:

Python API CLI PyTerrier

import ir_datasets
dataset = ir_datasets.load("mr-tydi/th/dev")
for query in dataset.queries_iter():
    query # namedtuple<query_id, text>

You can find more details about the Python API here.

ir_datasets export mr-tydi/th/dev queries



[query_id]    [text]
...

You can find more details about the CLI here.

Rel.	Definition	Count	%
1	Passage identified within Wikipedia article from top Google search results	`817`	100.0%

{
  "docs": {
    "count": 568855,
    "fields": {
      "doc_id": {
        "max_len": 10,
        "common_prefix": ""
      }
    }
  },
  "queries": {
    "count": 807
  },
  "qrels": {
    "count": 817,
    "fields": {
      "relevance": {
        "counts_by_value": {
          "1": 817
        }
      }
    }
  }
}

`"mr-tydi/th/test"`

Test set for Thai

queries docs qrels Citation Metadata

1.2K queries

Language: th

Query type:

GenericQuery: (namedtuple)

query_id: str
text: str

Examples:

Python API CLI PyTerrier

import ir_datasets
dataset = ir_datasets.load("mr-tydi/th/test")
for query in dataset.queries_iter():
    query # namedtuple<query_id, text>

You can find more details about the Python API here.

ir_datasets export mr-tydi/th/test queries



[query_id]    [text]
...

You can find more details about the CLI here.

Rel.	Definition	Count	%
1	Passage identified within Wikipedia article from top Google search results	`1.4K`	100.0%

{
  "docs": {
    "count": 568855,
    "fields": {
      "doc_id": {
        "max_len": 10,
        "common_prefix": ""
      }
    }
  },
  "queries": {
    "count": 1190
  },
  "qrels": {
    "count": 1368,
    "fields": {
      "relevance": {
        "counts_by_value": {
          "1": 1368
        }
      }
    }
  }
}

`"mr-tydi/th/train"`

Train set for Thai

queries docs qrels Citation Metadata

3.3K queries

Language: th

Query type:

GenericQuery: (namedtuple)

query_id: str
text: str

Examples:

Python API CLI PyTerrier

import ir_datasets
dataset = ir_datasets.load("mr-tydi/th/train")
for query in dataset.queries_iter():
    query # namedtuple<query_id, text>

You can find more details about the Python API here.

ir_datasets export mr-tydi/th/train queries



[query_id]    [text]
...

You can find more details about the CLI here.

Rel.	Definition	Count	%
1	Passage identified within Wikipedia article from top Google search results	`3.4K`	100.0%

{
  "docs": {
    "count": 568855,
    "fields": {
      "doc_id": {
        "max_len": 10,
        "common_prefix": ""
      }
    }
  },
  "queries": {
    "count": 3319
  },
  "qrels": {
    "count": 3360,
    "fields": {
      "relevance": {
        "counts_by_value": {
          "1": 3360
        }
      }
    }
  }
}

ir_datasets: Mr. TyDi

"mr-tydi"

"mr-tydi/ar"

"mr-tydi/ar/dev"

"mr-tydi/ar/test"

"mr-tydi/ar/train"

"mr-tydi/bn"

"mr-tydi/bn/dev"

"mr-tydi/bn/test"

"mr-tydi/bn/train"

"mr-tydi/en"

"mr-tydi/en/dev"

"mr-tydi/en/test"

"mr-tydi/en/train"

"mr-tydi/fi"

"mr-tydi/fi/dev"

"mr-tydi/fi/test"

"mr-tydi/fi/train"

"mr-tydi/id"

"mr-tydi/id/dev"

"mr-tydi/id/test"

"mr-tydi/id/train"

"mr-tydi/ja"

"mr-tydi/ja/dev"

"mr-tydi/ja/test"

"mr-tydi/ja/train"

"mr-tydi/ko"

"mr-tydi/ko/dev"

"mr-tydi/ko/test"

"mr-tydi/ko/train"

"mr-tydi/ru"

"mr-tydi/ru/dev"

"mr-tydi/ru/test"

"mr-tydi/ru/train"

"mr-tydi/sw"

"mr-tydi/sw/dev"

"mr-tydi/sw/test"

"mr-tydi/sw/train"

"mr-tydi/te"

"mr-tydi/te/dev"

"mr-tydi/te/test"

"mr-tydi/te/train"

"mr-tydi/th"

"mr-tydi/th/dev"

"mr-tydi/th/test"

"mr-tydi/th/train"

`ir_datasets`: Mr. TyDi

`"mr-tydi"`

`"mr-tydi/ar"`

`"mr-tydi/ar/dev"`

`"mr-tydi/ar/test"`

`"mr-tydi/ar/train"`

`"mr-tydi/bn"`

`"mr-tydi/bn/dev"`

`"mr-tydi/bn/test"`

`"mr-tydi/bn/train"`

`"mr-tydi/en"`

`"mr-tydi/en/dev"`

`"mr-tydi/en/test"`

`"mr-tydi/en/train"`

`"mr-tydi/fi"`

`"mr-tydi/fi/dev"`

`"mr-tydi/fi/test"`

`"mr-tydi/fi/train"`

`"mr-tydi/id"`

`"mr-tydi/id/dev"`

`"mr-tydi/id/test"`

`"mr-tydi/id/train"`

`"mr-tydi/ja"`

`"mr-tydi/ja/dev"`

`"mr-tydi/ja/test"`

`"mr-tydi/ja/train"`

`"mr-tydi/ko"`

`"mr-tydi/ko/dev"`

`"mr-tydi/ko/test"`

`"mr-tydi/ko/train"`

`"mr-tydi/ru"`

`"mr-tydi/ru/dev"`

`"mr-tydi/ru/test"`

`"mr-tydi/ru/train"`

`"mr-tydi/sw"`

`"mr-tydi/sw/dev"`

`"mr-tydi/sw/test"`

`"mr-tydi/sw/train"`

`"mr-tydi/te"`

`"mr-tydi/te/dev"`

`"mr-tydi/te/test"`

`"mr-tydi/te/train"`

`"mr-tydi/th"`

`"mr-tydi/th/dev"`

`"mr-tydi/th/test"`

`"mr-tydi/th/train"`