ir_datasets: TREC SpanishTo use this dataset, you need a copy of the source corpus, provided by the the Linguistic Data Consortium. The specific resource needed is LDC2000T51.
Many organizations already have a subscription to the LDC, so access to the collection can be as easy as confirming the data usage agreement and downloading the corpus. Check with your library for access details.
The source file is: LDC2000T51.tgz.
ir_datasets expects this file to be copied/linked as ~/.ir_datasets/trec-spanish/corpus.tgz.
A collection of news articles in Spanish, used for multi-lingual evaluation in TREC 3 and TREC 4.
Document collection from LDC2000T51.
Language: es
Examples:
import ir_datasets
dataset = ir_datasets.load("trec-spanish")
for doc in dataset.docs_iter():
doc # namedtuple<doc_id, text, marked_up_doc>
You can find more details about the Python API here.
ir_datasets export trec-spanish docs
[doc_id] [text] [marked_up_doc]
...
You can find more details about the CLI here.
No example available for PyTerrier
Bibtex:
@misc{Rogers2000Spanish, title={TREC Spanish LDC2000T51}, author={Rogers, Willie}, year={2000}, url={https://catalog.ldc.upenn.edu/LDC2000T51}, publisher={Linguistic Data Consortium} }Spanish benchmark from TREC 3.
Language: multiple/other/unknown
Examples:
import ir_datasets
dataset = ir_datasets.load("trec-spanish/trec3")
for query in dataset.queries_iter():
query # namedtuple<query_id, title_es, title_en, description_es, description_en, narrative_es, narrative_en>
You can find more details about the Python API here.
ir_datasets export trec-spanish/trec3 queries
[query_id] [title_es] [title_en] [description_es] [description_en] [narrative_es] [narrative_en]
...
You can find more details about the CLI here.
No example available for PyTerrier
Language: es
Note: Uses docs from trec-spanish
Examples:
import ir_datasets
dataset = ir_datasets.load("trec-spanish/trec3")
for doc in dataset.docs_iter():
doc # namedtuple<doc_id, text, marked_up_doc>
You can find more details about the Python API here.
ir_datasets export trec-spanish/trec3 docs
[doc_id] [text] [marked_up_doc]
...
You can find more details about the CLI here.
No example available for PyTerrier
Relevance levels
| Rel. | Definition |
|---|---|
| 0 | not relevant |
| 1 | relevant |
Examples:
import ir_datasets
dataset = ir_datasets.load("trec-spanish/trec3")
for qrel in dataset.qrels_iter():
qrel # namedtuple<query_id, doc_id, relevance, iteration>
You can find more details about the Python API here.
ir_datasets export trec-spanish/trec3 qrels --format tsv
[query_id] [doc_id] [relevance] [iteration]
...
You can find more details about the CLI here.
No example available for PyTerrier
Bibtex:
@inproceedings{Harman1994Trec3, title={Overview of the Third Text REtrieval Conference (TREC-3)}, author={Donna Harman}, booktitle={TREC}, year={1994} } @misc{Rogers2000Spanish, title={TREC Spanish LDC2000T51}, author={Rogers, Willie}, year={2000}, url={https://catalog.ldc.upenn.edu/LDC2000T51}, publisher={Linguistic Data Consortium} }Spanish benchmark from TREC 4.
Language: multiple/other/unknown
Examples:
import ir_datasets
dataset = ir_datasets.load("trec-spanish/trec4")
for query in dataset.queries_iter():
query # namedtuple<query_id, description_es1, description_en1, description_es2, description_en2>
You can find more details about the Python API here.
ir_datasets export trec-spanish/trec4 queries
[query_id] [description_es1] [description_en1] [description_es2] [description_en2]
...
You can find more details about the CLI here.
No example available for PyTerrier
Language: es
Note: Uses docs from trec-spanish
Examples:
import ir_datasets
dataset = ir_datasets.load("trec-spanish/trec4")
for doc in dataset.docs_iter():
doc # namedtuple<doc_id, text, marked_up_doc>
You can find more details about the Python API here.
ir_datasets export trec-spanish/trec4 docs
[doc_id] [text] [marked_up_doc]
...
You can find more details about the CLI here.
No example available for PyTerrier
Relevance levels
| Rel. | Definition |
|---|---|
| 0 | not relevant |
| 1 | relevant |
Examples:
import ir_datasets
dataset = ir_datasets.load("trec-spanish/trec4")
for qrel in dataset.qrels_iter():
qrel # namedtuple<query_id, doc_id, relevance, iteration>
You can find more details about the Python API here.
ir_datasets export trec-spanish/trec4 qrels --format tsv
[query_id] [doc_id] [relevance] [iteration]
...
You can find more details about the CLI here.
No example available for PyTerrier
Bibtex:
@inproceedings{Harman1995Trec4, title={Overview of the Fourth Text REtrieval Conference (TREC-4)}, author={Donna Harman}, booktitle={TREC}, year={1995} } @misc{Rogers2000Spanish, title={TREC Spanish LDC2000T51}, author={Rogers, Willie}, year={2000}, url={https://catalog.ldc.upenn.edu/LDC2000T51}, publisher={Linguistic Data Consortium} }