koomri/text-segmentation
Implementation of the paper: Text Segmentation as a Supervised Learning Task
This project helps you automatically break down long, continuous texts into meaningful segments or topics, similar to how a human would. You provide raw text documents, and it outputs the same text but with clear boundaries between different sections. This is useful for researchers, analysts, or anyone who needs to process large volumes of text and understand its underlying structure without manual reading.
265 stars. No commits in the last 6 months.
Use this if you need to automatically divide extensive documents like research papers, articles, or books into coherent, topic-based sections.
Not ideal if you're looking for a simple tool to split text by fixed paragraph breaks or specific keywords, or if your texts are very short.
Stars
265
Forks
57
Language
Python
License
—
Category
Last pushed
Oct 02, 2019
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/nlp/koomri/text-segmentation"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
VietHoang1512/khmer-nltk
Khmer language processing toolkit
PyThaiNLP/attacut
A Fast and Accurate Neural Thai Word Segmenter
UlugbekSalaev/UzTransliterator
UzTransliterator | State-of-the-art machine transliteration tool for Uzbek language
seanghay/KhmerOCR
A Fast Khmer Optical Character Recognition (KhmerOCR)
seanghay/khmerphonemizer
A Free, Standalone and Open-Source Khmer Grapheme-to-Phonemes.