UKPLab/useb
Heterogenous, Task- and Domain-Specific Benchmark for Unsupervised Sentence Embeddings used in the TSDAE paper: https://arxiv.org/abs/2104.06979.
This tool helps researchers and practitioners evaluate how well different sentence embedding models understand and represent the meaning of text. You input a trained sentence embedding model and various text datasets, and it outputs performance scores on tasks like question-answering, scientific paper citation analysis, and identifying paraphrases in social media. This is for anyone who develops or applies sentence embedding models and needs to rigorously test their effectiveness across diverse real-world text.
No commits in the last 6 months.
Use this if you need to objectively compare the quality of different unsupervised sentence embedding models on various real-world text understanding tasks.
Not ideal if you are looking for a tool to train sentence embedding models from scratch, as this focuses solely on evaluation.
Stars
29
Forks
2
Language
Python
License
Apache-2.0
Category
Last pushed
Jan 04, 2022
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/nlp/UKPLab/useb"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
acl-org/acl-anthology
Data and software for building the ACL Anthology.
anoopkunchukuttan/indic_nlp_library
Resources and tools for Indian language Natural Language Processing
CLUEbenchmark/CLUECorpus2020
Large-scale Pre-training Corpus for Chinese 100G 中文预训练语料
KennethEnevoldsen/scandinavian-embedding-benchmark
A Scandinavian Benchmark for sentence embeddings
Separius/awesome-sentence-embedding
A curated list of pretrained sentence and word embedding models