JuliaText/CorpusLoaders.jl
A variety of loaders for various NLP corpora.
This tool helps natural language processing (NLP) researchers and data scientists easily access and prepare common text datasets for their work. It takes raw text corpus files (like Wikipedia articles, movie reviews, or Twitter sentiment data) and makes them available in a structured, iterable format. This is designed for anyone building or experimenting with NLP models, such as those for sentiment analysis, text classification, or word sense disambiguation.
No commits in the last 6 months.
Use this if you need to quickly load and work with popular NLP benchmark datasets in Julia without writing custom parsing code for each one.
Not ideal if your primary goal is to work with custom, proprietary text data or if you are not using the Julia programming language for your NLP tasks.
Stars
32
Forks
12
Language
Julia
License
—
Category
Last pushed
Sep 17, 2022
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/nlp/JuliaText/CorpusLoaders.jl"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
Helsinki-NLP/OpusFilter
OpusFilter - Parallel corpus processing toolkit
natasha/corus
Links to Russian corpora + Python functions for loading and parsing
darija-open-dataset/dataset
darija <-> english dataset
omicsNLP/Auto-CORPus
Auto-CORPus pipeline developed by a University of Nottingham and Imperial College London...
SergeyShk/ruTS
Библиотека для извлечения статистик из текстов на русском языке.