← home
Github: datasets/highwire.py

ir_datasets: Highwire (TREC Genomics 2006-07)

Index
  1. highwire
  2. highwire/trec-genomics-2006
  3. highwire/trec-genomics-2007

"highwire"

Medical document collection from Highwire Press. Includes 162,259 scientific articles from 49 journals.

This dataset is used for the TREC 2006-07 TREC Genomics track.

Note that these documents are split into passages based on paragraph tags in the HTML.

docs

Language: en

Document type:
HighwireDoc: (namedtuple)
  1. doc_id: str
  2. journal: str
  3. title: str
  4. spans: Tuple[
    HighwireSpan: (namedtuple)
    1. start: int
    2. length: int
    3. text: str
    , ...]

Example

import ir_datasets
dataset = ir_datasets.load('highwire')
for doc in dataset.docs_iter():
    doc # namedtuple<doc_id, journal, title, spans>

"highwire/trec-genomics-2006"

The TREC Genomics Track 2006 benchmark. Contains 28 queries with passage-level relevance judgments.

queries

Language: en

Query type:
GenericQuery: (namedtuple)
  1. query_id: str
  2. text: str

Example

import ir_datasets
dataset = ir_datasets.load('highwire/trec-genomics-2006')
for query in dataset.queries_iter():
    query # namedtuple<query_id, text>
docs

Language: en

Document type:
HighwireDoc: (namedtuple)
  1. doc_id: str
  2. journal: str
  3. title: str
  4. spans: Tuple[
    HighwireSpan: (namedtuple)
    1. start: int
    2. length: int
    3. text: str
    , ...]

Example

import ir_datasets
dataset = ir_datasets.load('highwire/trec-genomics-2006')
for doc in dataset.docs_iter():
    doc # namedtuple<doc_id, journal, title, spans>
qrels
Query relevance judgment type:
HighwireQrel: (namedtuple)
  1. query_id: str
  2. doc_id: str
  3. start: int
  4. length: int
  5. relevance: int

Relevance levels

Rel.Definition
0NOT
1POSSIBLY
2DEFINITELY

Example

import ir_datasets
dataset = ir_datasets.load('highwire/trec-genomics-2006')
for qrel in dataset.qrels_iter():
    qrel # namedtuple<query_id, doc_id, start, length, relevance>
Citation
bibtex: @inproceedings{Hersh2006TrecGenomics, title={TREC 2006 Genomics Track Overview}, author={William Hersh and Aaron M. Cohen and Phoebe Roberts and Hari Krishna Rekapalli}, booktitle={TREC}, year={2006} }

"highwire/trec-genomics-2007"

The TREC Genomics Track 2007 benchmark. Contains 36 queries with passage-level relevance judgments.

queries

Language: en

Query type:
GenericQuery: (namedtuple)
  1. query_id: str
  2. text: str

Example

import ir_datasets
dataset = ir_datasets.load('highwire/trec-genomics-2007')
for query in dataset.queries_iter():
    query # namedtuple<query_id, text>
docs

Language: en

Document type:
HighwireDoc: (namedtuple)
  1. doc_id: str
  2. journal: str
  3. title: str
  4. spans: Tuple[
    HighwireSpan: (namedtuple)
    1. start: int
    2. length: int
    3. text: str
    , ...]

Example

import ir_datasets
dataset = ir_datasets.load('highwire/trec-genomics-2007')
for doc in dataset.docs_iter():
    doc # namedtuple<doc_id, journal, title, spans>
qrels
Query relevance judgment type:
HighwireQrel: (namedtuple)
  1. query_id: str
  2. doc_id: str
  3. start: int
  4. length: int
  5. relevance: int

Relevance levels

Rel.Definition
0NOT_RELEVANT
1RELEVANT

Example

import ir_datasets
dataset = ir_datasets.load('highwire/trec-genomics-2007')
for qrel in dataset.qrels_iter():
    qrel # namedtuple<query_id, doc_id, start, length, relevance>
Citation
bibtex: @inproceedings{Hersh2007TrecGenomics, title={TREC 2007 Genomics Track Overview}, author={William Hersh and Aaron Cohen and Lynn Ruslen and Phoebe Roberts}, booktitle={TREC}, year={2007} }