mit-ccc/TweebankNLP
[LREC 2022] An off-the-shelf pre-trained Tweet NLP Toolkit (NER, tokenization, lemmatization, POS tagging, dependency parsing) + Tweebank-NER dataset
This toolkit helps social media analysts and researchers extract detailed information from English tweets. It takes raw tweet text and identifies entities like people, organizations, and locations (Named Entity Recognition), breaks down sentences into words and their base forms (tokenization, lemmatization), assigns parts of speech, and analyzes grammatical structure (dependency parsing). This allows for deeper content analysis of social media conversations.
106 stars. No commits in the last 6 months.
Use this if you need to perform in-depth linguistic analysis on Twitter data, such as identifying key entities or understanding grammatical relationships within tweets.
Not ideal if your primary data source is not Twitter or if you need a solution for languages other than English.
Stars
106
Forks
10
Language
Python
License
Apache-2.0
Category
Last pushed
Jan 24, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/nlp/mit-ccc/TweebankNLP"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
nltk/nltk
NLTK Source
explosion/spaCy
💫 Industrial-strength Natural Language Processing (NLP) in Python
undertheseanlp/underthesea
Underthesea - Vietnamese NLP Toolkit
stanfordnlp/stanza
Stanford NLP Python library for tokenization, sentence segmentation, NER, and parsing of many...
flairNLP/flair
A very simple framework for state-of-the-art Natural Language Processing (NLP)