Linguistic Datasets ML Frameworks

Collections of language-specific textual and computational resources for training NLP models. Includes datasets, dictionaries, and corpora for individual languages. Does NOT include general multilingual models, machine translation frameworks, or non-linguistic AI tools.

There are 84 linguistic datasets frameworks tracked. The highest-rated is seanpm2001/AI2001_Category-Linguistics-SC-Igbo at 32/100 with 5 stars.

Get all 84 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=ml-frameworks&subcategory=linguistic-datasets&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

# Framework Score Tier
1 seanpm2001/AI2001_Category-Linguistics-SC-Igbo

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Igbo category for AI2001, containing...

32
Emerging
2 seanpm2001/AI2001_Category-Linguistics-SC-Welsh

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Welsh category for AI2001,...

31
Emerging
3 seanpm2001/AI2001_Category-Linguistics-SC-Urdu

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Urdu category for AI2001, containing...

31
Emerging
4 seanpm2001/AI2001_Category-Linguistics-SC-Burmese

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Burmese category for AI2001,...

31
Emerging
5 seanpm2001/AI2001_Category-Linguistics-SC-Bulgarian

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Bulgarian category for AI2001,...

31
Emerging
6 seanpm2001/AI2001_Category-Linguistics-SC-Chinese-Traditional

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Chinese-Traditional category for...

31
Emerging
7 seanpm2001/AI2001_Category-Linguistics-SC-Tamil

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Tamil category for AI2001,...

31
Emerging
8 seanpm2001/AI2001_Category-Linguistics-SC-Hungarian

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Hungarian category for AI2001,...

31
Emerging
9 seanpm2001/AI2001_Category-Linguistics-SC-Amharic

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Amharic category for AI2001,...

31
Emerging
10 seanpm2001/AI2001_Category-Linguistics-SC-Tatar

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Tatar category for AI2001,...

31
Emerging
11 seanpm2001/AI2001_Category-Linguistics-SC-Dogri

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Dogri category for AI2001,...

30
Emerging
12 seanpm2001/AI2001_Category-Linguistics-SC-Finnish

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Finnish category for AI2001,...

30
Emerging
13 seanpm2001/AI2001_Category-Linguistics-SC-Thai

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Thai category for AI2001, containing...

30
Emerging
14 seanpm2001/AI2001_Category-Linguistics-SC-Laos

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Laos category for AI2001, containing...

30
Emerging
15 seanpm2001/AI2001_Category-Linguistics-SC-Tigrinya

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Tigrinya category for AI2001,...

30
Emerging
16 seanpm2001/AI2001_Category-Linguistics-SC-Xhosa

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Xhosa category for AI2001,...

30
Emerging
17 seanpm2001/AI2001_Category-Linguistics-SC-Fula

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Fula category for AI2001, containing...

30
Emerging
18 seanpm2001/AI2001_Category-Linguistics-SC-Azerbaijan

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Azerbaijan category for AI2001,...

30
Emerging
19 seanpm2001/AI2001_Category-Linguistics-SC-Japanese

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Japanese category for AI2001,...

30
Emerging
20 seanpm2001/AI2001_Category-Linguistics-SC-Chechen

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Chechen category for AI2001,...

30
Emerging
21 seanpm2001/AI2001_Category-Linguistics-SC-Odia

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Odia for AI2001, containing Odia...

30
Emerging
22 seanpm2001/AI2001_Category-Linguistics-SC-Hindustani

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Hindustani category for AI2001,...

30
Emerging
23 seanpm2001/AI2001_Category-Linguistics-SC-Punjabi

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Punjabi category for AI2001,...

30
Emerging
24 seanpm2001/AI2001_Category-Linguistics-SC-Sami

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Sami category for AI2001, containing...

30
Emerging
25 seanpm2001/AI2001_Category-Linguistics-SC-Lushootseed

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Lushootseed category for AI2001,...

30
Emerging
26 seanpm2001/AI2001_Category-Linguistics-SC-Swiss-German

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Swiss German category for AI2001,...

30
Emerging
27 seanpm2001/AI2001_Category-Linguistics-SC-Catalan

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Catalan category for AI2001,...

30
Emerging
28 seanpm2001/AI2001_Category-Linguistics-SC-Konkani

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Konkani category for AI2001,...

30
Emerging
29 seanpm2001/AI2001_Category-Linguistics-SC-Hausa

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Hausa category for AI2001,...

30
Emerging
30 seanpm2001/AI2001_Category-Linguistics-SC-Kurdish

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Kurdish category for AI2001,...

30
Emerging
31 seanpm2001/AI2001_Category-Linguistics-SC-Frisian

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Frisian category for AI2001,...

30
Emerging
32 seanpm2001/AI2001_Category-Linguistics-SC-Syriac

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Syriac category for AI2001,...

30
Emerging
33 seanpm2001/AI2001_Category-Linguistics-SC-Corsican

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Corsican category for AI2001,...

30
Emerging
34 seanpm2001/AI2001_Category-Linguistics-SC-Greek

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Greek category for AI2001,...

30
Emerging
35 seanpm2001/AI2001_Category-Linguistics-SC-Korean-North

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Korean-North category for AI2001,...

30
Emerging
36 seanpm2001/AI2001_Category-Linguistics-SC-Quenya

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Quenya category for AI2001,...

30
Emerging
37 seanpm2001/AI2001_Category-Linguistics-SC-Mongolian-Classic

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Mongolian-Classic category for...

30
Emerging
38 seanpm2001/AI2001_Category-Linguistics-SC-Scottish

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Scottish category for AI2001,...

30
Emerging
39 seanpm2001/AI2001_Category-Linguistics-SC-Greenlandic

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Greenlandic category for AI2001,...

30
Emerging
40 seanpm2001/AI2001_Category-Linguistics-SC-Uyghur

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Uyghur category for AI2001,...

30
Emerging
41 seanpm2001/AI2001_Category-Linguistics-SC-Lingala

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Lingala category for AI2001,...

30
Emerging
42 seanpm2001/AI2001_Category-Linguistics-SC-Yoruba

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Yoruba category for AI2001,...

30
Emerging
43 seanpm2001/AI2001_Category-Linguistics-SC-Marathi

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Marathi category for AI2001,...

30
Emerging
44 seanpm2001/AI2001_Category-Linguistics-SC-Bengali

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Bengali category for AI2001,...

30
Emerging
45 seanpm2001/AI2001_Category-Linguistics-SC-Mongolian-Cyrillic

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Mongolian-Cyrillic category for...

30
Emerging
46 seanpm2001/AI2001_Category-Linguistics-SC-Mi-kmawi-simk

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Mi-kmawi-simk category for AI2001,...

30
Emerging
47 seanpm2001/AI2001_Category-Linguistics-SC-Bodo

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Bodo category for AI2001, containing...

30
Emerging
48 seanpm2001/AI2001_Category-Linguistics-SC-Old-Spanish

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Old-Spanish category for AI2001,...

30
Emerging
49 seanpm2001/AI2001_Category-Linguistics-SC-Comanche

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Comanche category for AI2001,...

30
Emerging
50 seanpm2001/AI2001_Category-Linguistics-SC-Cuban-Spanish

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Cuban-Spanish category for AI2001,...

30
Emerging
51 seanpm2001/AI2001_Category-Linguistics-SC-Klingon

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Klingon category for AI2001,...

30
Emerging
52 seanpm2001/AI2001_Category-Linguistics-SC-Tsilhqot-in

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Tsilhqot-in category for AI2001,...

30
Emerging
53 seanpm2001/AI2001_Category-Linguistics-SC-Siberian-Ingrian-Finnish

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Siberian Ingrian Finnish category...

30
Emerging
54 seanpm2001/AI2001_Category-Linguistics-SC-Coptic

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Coptic category for AI2001,...

30
Emerging
55 seanpm2001/AI2001_Category-Linguistics-SC-German-S-Pennsylvania-German

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:German:Pennsylvania German category...

30
Emerging
56 seanpm2001/AI2001_Category-Linguistics-SC-Low-Alemannic-German

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Low-Alemannic-German category for...

30
Emerging
57 seanpm2001/AI2001_Category-Linguistics-SC-Slavey-Jargon

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Slavey-Jargon category for AI2001,...

30
Emerging
58 seanpm2001/AI2001_Category-Linguistics-SC-Kashmiri

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Kashmiri category for AI2001,...

30
Emerging
59 seanpm2001/AI2001_Category-Linguistics-SC-Indonesian

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Indonesian category for AI2001,...

30
Emerging
60 seanpm2001/AI2001_Category-Linguistics-SC-Italian

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Italian category for AI2001,...

30
Emerging
61 seanpm2001/AI2001_Category-Linguistics-SC-Javanese

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Javanese category for AI2001,...

30
Emerging
62 seanpm2001/AI2001_Category-Linguistics-SC-Sanskrit

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Sanskrit category for AI2001,...

30
Emerging
63 seanpm2001/AI2001_Category-Linguistics-SC-Mandinka

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Mandinka category for AI2001,...

30
Emerging
64 seanpm2001/AI2001_Category-Linguistics-SC-Danish

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Danish category for AI2001,...

30
Emerging
65 seanpm2001/AI2001_Category-Linguistics-SC-Afar

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Afar category for AI2001, containing...

30
Emerging
66 seanpm2001/AI2001_Category-Linguistics-SC-Uzbek

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Uzbek category for AI2001,...

30
Emerging
67 seanpm2001/AI2001_Category-Linguistics-SC-Kannada

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Kannada for AI2001, containing...

30
Emerging
68 seanpm2001/AI2001_Category-Linguistics-SC-Zulu

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Zulu category for AI2001, containing...

30
Emerging
69 seanpm2001/AI2001_Category-Linguistics-SC-Pashto

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Pashto category for AI2001,...

30
Emerging
70 seanpm2001/AI2001_Category-Linguistics-SC-Meitei

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Meitei category for AI2001,...

30
Emerging
71 seanpm2001/AI2001_Category-Linguistics-SC-Maithili

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Maithili category for AI2001,...

30
Emerging
72 seanpm2001/AI2001_Category-Linguistics-SC-Serbian

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Serbian category for AI2001,...

30
Emerging
73 seanpm2001/AI2001_Category-Linguistics-SC-English

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:English category for AI2001,...

27
Experimental
74 MinSiThu/Burmese-Microbiology-1K

Microbiology 1K QA pairs in Burmese Language

26
Experimental
75 Jeffrey-Sardina/Focl-ir-Tr-chtais

Foclóir ríomheolaíochta agus ríomhfhoghlama na Gaeilge | Irish-language...

21
Experimental
76 seanpm2001/AI2001_Category-Linguistics-SC-Yahgan

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Yahgan category for AI2001,...

17
Experimental
77 seanpm2001/AI2001_Category-Linguistics-SC-Church-Slavonic

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Church Slavonic category for AI2001,...

17
Experimental
78 seanpm2001/AI2001_Category-Linguistics-SC-Alphabet-Phoenician

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Phoenician[Alphabet] category for...

17
Experimental
79 seanpm2001/AI2001_Category-Linguistics-SC-Ugric-languages

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Ugric-languages category for AI2001,...

12
Experimental
80 seanpm2001/AI2001_Category-Linguistics-SC-Alphabet-Elder-Futhark

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Elder Futhark[Alphabet] category for...

12
Experimental
81 seanpm2001/AI2001_Category-Linguistics-SC-Glagolitic-script

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Glagolitic script category for...

12
Experimental
82 seanpm2001/AI2001_Category-Linguistics-SC-Basque

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Basque category for AI2001,...

12
Experimental
83 seanpm2001/AI2001_Category-Linguistics-SC-Mansi-languages

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Mansi-languages category for AI2001,...

12
Experimental
84 seanpm2001/AI2001_Category-Linguistics-SC-Plains-Indian-Sign-Language

🧠️🖥️2️⃣️0️⃣️0️⃣️1️⃣️🔠️🔢️ The linguistic:Plains Indian Sign Language category...

12
Experimental