Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

P3-2CR Pages #32

Open
ronakice opened this issue Jan 22, 2024 · 3 comments
Open

P3-2CR Pages #32

ronakice opened this issue Jan 22, 2024 · 3 comments
Assignees
@charlie-liuu
Labels
documentation Improvements or additions to documentation good first issue Good for newcomers

Comments

@ronakice
Copy link
Member

2cr pages for RankZephyr/Vicuna on MSv1/v2 to begin with like Pyserini - https://castorini.github.io/pyserini/2cr/msmarco-v1-passage.html
@ronakice ronakice added documentation Improvements or additions to documentation good first issue Good for newcomers labels Jan 22, 2024
@sahel-sh sahel-sh changed the title 2CR Pages P3-2CR Pages Jan 29, 2024
@charlie-liuu
Copy link
Contributor

Working on this

@ronakice ronakice mentioned this issue Jan 29, 2024
Open
@ronakice
Copy link
Member Author

https://github.com/castorini/pyserini/tree/master/pyserini/2cr

This will be a good guide, we might want to add fields like Retrieval Method and top-$k$

@ronakice
Copy link
Member Author

https://castorini.github.io/rank_llm/src/rank_llm/2cr/msmarco-v1-passage.html

We have the start of this.

This issue's goals now change to adding support for other datasets, MSv2 passage, NEWS, COVID, NovelEval in that order.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@charlie-liuu charlie-liuu

Labels
documentation Improvements or additions to documentation good first issue Good for newcomers
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@ronakice @charlie-liuu