twardoch/split-markdown4gpt
A Python tool for splitting large Markdown files into smaller sections based on a specified token limit. This is particularly useful for processing large Markdown files with GPT models, as it allows the models to handle the data in manageable chunks.
This tool helps developers and data scientists prepare large Markdown documents for processing with GPT models. It takes a Markdown file and splits it into smaller, token-limited sections, ensuring the content fits within the model's input constraints. This is essential for tasks like text generation, data preprocessing, or document analysis when working with extensive text.
No commits in the last 6 months. Available on PyPI.
Use this if you need to feed large Markdown files into a GPT model and are encountering token limit errors.
Not ideal if you are working with text formats other than Markdown or if you don't need to process documents with large language models.
Stars
28
Forks
3
Language
Python
License
Apache-2.0
Category
Last pushed
Sep 01, 2025
Commits (30d)
0
Dependencies
8
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/twardoch/split-markdown4gpt"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
mohamed-chs/convoviz
Convert your ChatGPT export (ZIP) into clean Markdown text files with inline media, and generate...
RICHQAQ/PasteMD
一键将 Markdown 和网页 AI 对话（ChatGPT/DeepSeek等）完美粘贴到 Word、WPS 和 Excel 的效率工具 | One-click paste Markdown...
sugurutakahashi-1234/ai-chat-md-export
Command-line tool for converting ChatGPT and Claude chat history to readable Markdown files
pionxzh/chatgpt-exporter
Export and Share your ChatGPT conversation history
Hugo-COLLIN/SaveMyPhind-conversation-exporter
🚀 Save my Chatbot: Download your ChatGPT, Claude, Perplexity and Phind conversations into...