AliOsm/arabic-text-diacritization
Benchmark Arabic text diacritization dataset
This project provides a comprehensive dataset and tools for Arabic text diacritization, which is the process of adding short vowel marks (tashkeel) to unvowelized Arabic text. It takes raw Arabic text and outputs the same text with correct diacritics applied, or vice-versa. Language researchers, computational linguists, and developers working on Arabic natural language processing applications would find this beneficial for training and evaluating diacritization models.
No commits in the last 6 months.
Use this if you need a standardized, well-benchmarked dataset and helper scripts for developing, training, or evaluating systems that automatically add diacritics to Arabic text.
Not ideal if you are an end-user simply looking for a tool to diacritize a single document or a small amount of text without developing your own system.
Stars
77
Forks
20
Language
Python
License
MIT
Category
Last pushed
Jul 26, 2019
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/nlp/AliOsm/arabic-text-diacritization"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
linuxscout/mishkal
Mishkal is an arabic text vocalization software
hb20007/greek-dialect-classifier
Classifier that identifies Greek text as Cypriot Greek or Standard Modern Greek
mush42/libtashkeel
Add Arabic diacritics (tashkeel/harakat) using Rust/Python/C++/WASM and NLP models
AliOsm/shakkelha
Neural Arabic text diacritization
BasmaElhoseny01/Tashkeel
A system that takes a sentence and produces the same sentence after restoring the missing diacritics.