taishi-i/nagisa
A Japanese tokenizer based on recurrent neural networks
This tool helps analyze Japanese text by breaking it down into individual words and identifying each word's part of speech, like nouns or verbs. You provide raw Japanese sentences, and it outputs a list of words with their corresponding grammatical tags. This is useful for researchers, linguists, or data analysts working with Japanese language data.
415 stars. Used by 2 other packages. Available on PyPI.
Use this if you need to accurately segment Japanese text into words and categorize them by their grammatical function for further analysis.
Not ideal if your primary need is for languages other than Japanese, or if you require advanced semantic analysis beyond basic word and part-of-speech tagging.
Stars
415
Forks
23
Language
Python
License
MIT
Category
Last pushed
Feb 12, 2026
Commits (30d)
0
Dependencies
3
Reverse dependents
2
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/nlp/taishi-i/nagisa"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Related tools
EmilStenstrom/conllu
A CoNLL-U parser that takes a CoNLL-U formatted string and turns it into a nested python dictionary.
OpenPecha/Botok
🏷 བོད་ཏོག [pʰøtɔk̚] Tibetan word tokenizer in Python
zaemyung/sentsplit
A flexible sentence segmentation library using CRF model and regex rules
natasha/razdel
Rule-based token, sentence segmentation for Russian language
polm/cutlet
Japanese to romaji converter in Python