Skip to content

Add page for Patapsco#2

Draft
eugene-yang wants to merge 3 commits intoseanmacavaney:masterfrom
eugene-yang:master
Draft

Add page for Patapsco#2
eugene-yang wants to merge 3 commits intoseanmacavaney:masterfrom
eugene-yang:master

Conversation

@eugene-yang
Copy link
Copy Markdown

No description provided.

<p>
For both <kbd>documents</kbd>, <kbd>topics</kbd> and <kbd>scores</kbd> sections, use <kbd>irds</kbd>
as the <kbd>format</kbd> in the <kbd>input</kbd> subsection to tell Pataspco to use <kbd>ir_datasets</kbd>
and specify the dataset name at <kbd>path</kbd>. The <kbd>lang</kbd> value has to match the language
Copy link
Copy Markdown
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is there a way to automatically set lang for the user from the lang provided by irds? (Or would this be counter to the design of Patapsco?)

lang: zho
path: clirmatrix/zh/bi139-base/en/dev
process:
inherit: text
Copy link
Copy Markdown
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is this the field from a document to use?

encoding: utf8
path: clirmatrix/zh/bi139-base/en/dev

score:
Copy link
Copy Markdown
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I presume score corresponds to the qrels?

source: original
encoding: utf8
path: clirmatrix/zh/bi139-base/en/dev

Copy link
Copy Markdown
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The example file linked above also has a "queries" section. Is that optional?

@seanmacavaney
Copy link
Copy Markdown
Owner

@eugene-yang any progress on the associated Patapsco changes?

@eugene-yang
Copy link
Copy Markdown
Author

Unfortunately we haven't got a chance to pick them up.
Probably we will need to work on those in order to let it better support NeuCLIR collection as well.

@eugene-yang
Copy link
Copy Markdown
Author

eugene-yang commented Mar 11, 2022

Pull request in progress.
Will come back here after the update is merged.

@eugene-yang eugene-yang marked this pull request as draft March 15, 2022 18:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants