t-systems-on-site-services-gmbh/german-wikipedia-text-corpus
This is a german text corpus from Wikipedia. It is cleaned, preprocessed and sentence splitted. It's purpose is to train NLP embeddings like fastText or ELMo Deep contextualized word representations.
This is a German text corpus derived from Wikipedia, including both article content and discussion comments. It takes raw German Wikipedia data and provides a cleaned, preprocessed, and sentence-split text corpus. Data scientists, NLP researchers, or machine learning engineers working with German language models would use this to improve the quality of their downstream tasks.
No commits in the last 6 months.
Use this if you need a large, diverse German text dataset to train natural language processing (NLP) models, especially if your application involves processing conversational or less formal German text.
Not ideal if you need a very clean, strictly formal German text corpus without any discussion or comment content, or if you require a different language.
Stars
23
Forks
4
Language
—
License
—
Category
Last pushed
Feb 22, 2022
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/nlp/t-systems-on-site-services-gmbh/german-wikipedia-text-corpus"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
Helsinki-NLP/OpusFilter
OpusFilter - Parallel corpus processing toolkit
natasha/corus
Links to Russian corpora + Python functions for loading and parsing
SergeyShk/ruTS
Библиотека для извлечения статистик из текстов на русском языке.
darija-open-dataset/dataset
darija <-> english dataset
omicsNLP/Auto-CORPus
Auto-CORPus pipeline developed by a University of Nottingham and Imperial College London...