Skip to content

Issues: embeddings-benchmark/mteb

Beta
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

251 Open 781 Closed
251 Open 781 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Add Unispeech model
#2694 opened May 11, 2025 by sufen-f
@sufen-f
Add SEW-D model
#2693 opened May 11, 2025 by sufen-f
@sufen-f
[v2] Refactor Retrieval tasks to use dataset directly v2 Issues and PRs related to `v2` branch
#2692 opened May 11, 2025 by Samoed
What to do if the max_length of CustomModel is smaller than the length of sentences more information needed More information is needed before this issue can be resolved
#2686 opened May 10, 2025 by ENg-122
1
Clarification on Data Pre-processing for Retrieval datasets more information needed More information is needed before this issue can be resolved
#2685 opened May 9, 2025 by marek-sarvas
2
Add LP-MusicCaps dataset for retrieval maeb Audio extension new dataset Issues related to adding a new task or dataset
#2683 opened May 9, 2025 by kkaitlyn111
Add FLEURS dataset for audio retrieval maeb Audio extension new dataset Issues related to adding a new task or dataset
#2681 opened May 9, 2025 by kkaitlyn111
Add test to ensure that new datasets can run enhancement New feature or request
#2675 opened May 8, 2025 by KennethEnevoldsen
2
Integrate lightonai/GTE-ModernColBERT-v1 new model Questions related to adding a new model to the benchmark
#2673 opened May 7, 2025 by Samoed
Create Audio Event Detection Task maeb Audio extension
#2670 opened May 7, 2025 by silky1708
2
Add Vaani dataset maeb Audio extension new dataset Issues related to adding a new task or dataset
#2669 opened May 7, 2025 by silky1708
1
2
Unable to sort leaderboard leaderboard issues related to the leaderboard wontfix This will not be worked on
#2662 opened May 6, 2025 by siddarth99
2
MAEB "Too Many Requests" Dataset Errors maeb Audio extension more information needed More information is needed before this issue can be resolved
#2659 opened May 5, 2025 by AdnanElAssadi56
5
MAEB Model Problem with "laion/clap-htsat-fused" bug Something isn't working
#2658 opened May 5, 2025 by AdnanElAssadi56
1
Issues with Reproducing Leaderboard Results for CoIR datasets replication question and issues related to replication
#2650 opened May 3, 2025 by gnatesan
8
Identify relevant datasets for SEBv2 from MTEB
#2627 opened May 2, 2025 by isaac-chung
@isaac-chung
2
[v2] Map task subtypes with available on huggingface task_ids when generating DatasetCard enhancement New feature or request v2 Issues and PRs related to `v2` branch
#2624 opened May 2, 2025 by Samoed
Add datasets from norbench new dataset Issues related to adding a new task or dataset
#2622 opened May 2, 2025 by Samoed
@Samoed
Change model2vec to SentenceTransformer
#2610 opened May 1, 2025 by Samoed
2
SEB v2
#2608 opened May 1, 2025 by isaac-chung
2 of 14 tasks
24
Move developer dependencies to groups PEP 735
#2602 opened Apr 30, 2025 by Samoed
1
Add support for xet
#2598 opened Apr 29, 2025 by KennethEnevoldsen
1
Missing results of ListConRanker on leaderboard
#2584 opened Apr 27, 2025 by tutuDoki
7
Initial load and refresh of the leaderboard takes more than 30s enhancement New feature or request leaderboard issues related to the leaderboard
#2580 opened Apr 26, 2025 by KennethEnevoldsen
Add SWE bench lite issue localization task enhancement New feature or request new dataset Issues related to adding a new task or dataset
#2578 opened Apr 25, 2025 by isaac-chung
ProTip! Follow long discussions with comments:>50.