ayub-kokabi/llmtext

Turns any website into a single LLM-ready markdown file

28
/ 100
Experimental

This tool helps you quickly gather up-to-date information from websites for your AI language models. It takes a website URL (or a list of URLs) and intelligently scrapes the content, including relevant internal links, converting everything into a single, clean Markdown file. This is ideal for researchers, content creators, or analysts who need to provide current web content to LLMs.

No commits in the last 6 months.

Use this if you need to provide a language model with specific, recent information from a website or multiple related web pages that might not be included in its training data.

Not ideal if you only need a small snippet of text from a single page or if you are looking for a visual browser automation tool.

information-gathering content-curation web-research AI-prompt-engineering knowledge-base-creation
Stale 6m No Package No Dependents
Maintenance 2 / 25
Adoption 5 / 25
Maturity 15 / 25
Community 6 / 25

How are scores calculated?

Stars

13

Forks

1

Language

Rust

License

MIT

Last pushed

Aug 03, 2025

Commits (30d)

0

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/ayub-kokabi/llmtext"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.