ku-nlp/jumanpp
Juman++ (a Morphological Analyzer Toolkit)
This tool helps you break down Japanese text into its individual words and their grammatical properties, like parts of speech and base forms. You feed it raw Japanese sentences, and it outputs a detailed linguistic analysis for each word. It's designed for linguists, researchers, or anyone working with natural language processing of Japanese text.
409 stars. No commits in the last 6 months.
Use this if you need to perform detailed morphological analysis on Japanese text, especially when you require accurate segmentation and semantic plausibility considerations for word sequences.
Not ideal if you're working with languages other than Japanese, or if you only need very basic text splitting without deep linguistic insight.
Stars
409
Forks
46
Language
C++
License
Apache-2.0
Category
Last pushed
Oct 03, 2023
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/nlp/ku-nlp/jumanpp"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
EmilStenstrom/conllu
A CoNLL-U parser that takes a CoNLL-U formatted string and turns it into a nested python dictionary.
OpenPecha/Botok
🏷 བོད་ཏོག [pʰøtɔk̚] Tibetan word tokenizer in Python
zaemyung/sentsplit
A flexible sentence segmentation library using CRF model and regex rules
taishi-i/nagisa
A Japanese tokenizer based on recurrent neural networks
natasha/razdel
Rule-based token, sentence segmentation for Russian language