lanwuwei/Twitter-URL-Corpus
Large scale sentential paraphrases collection and annotation
This project provides a large dataset of English sentence pairs extracted from Twitter, along with human annotations indicating whether each pair is a paraphrase. Researchers and computational linguists can use this to train and evaluate models that understand semantic similarity between sentences. It takes raw Twitter data and outputs structured pairs of sentences labeled for paraphrasing.
No commits in the last 6 months.
Use this if you are a natural language processing researcher needing a substantial, human-annotated dataset of sentential paraphrases for tasks like semantic textual similarity or information retrieval.
Not ideal if you need to analyze tweets for sentiment, trending topics, or user behavior, as this dataset focuses specifically on sentence paraphrasing.
Stars
46
Forks
7
Language
HTML
License
—
Category
Last pushed
Dec 31, 2022
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/nlp/lanwuwei/Twitter-URL-Corpus"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
acl-org/acl-anthology
Data and software for building the ACL Anthology.
anoopkunchukuttan/indic_nlp_library
Resources and tools for Indian language Natural Language Processing
CLUEbenchmark/CLUECorpus2020
Large-scale Pre-training Corpus for Chinese 100G 中文预训练语料
KennethEnevoldsen/scandinavian-embedding-benchmark
A Scandinavian Benchmark for sentence embeddings
Separius/awesome-sentence-embedding
A curated list of pretrained sentence and word embedding models