cameronking4/nextjs-firecrawl-starter
Nextjs 15 Firecrawl app to scrape doc links for an LLM. Use it as a starter kit to build your Firecrawl app. Turn any developer documentation into a GPT knowledge base. Pre-made Github Action to crawl and commit markdown responses to repo.
This tool helps developers and technical writers transform online documentation into a structured knowledge base for AI models. You input a URL, and it provides clean markdown, XML, or zipped markdown files ready for use with LLMs like ChatGPT, OpenAI Assistants, or Claude Artifacts. It's designed for anyone managing or creating technical documentation who wants to easily convert it into a format AI can understand.
No commits in the last 6 months.
Use this if you need to quickly and automatically convert developer documentation or web content into a digestible format for training or enhancing large language models.
Not ideal if you're looking for a general-purpose web scraping tool for unstructured data or if your target content isn't primarily text-based documentation.
Stars
20
Forks
2
Language
TypeScript
License
MIT
Category
Last pushed
May 14, 2025
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/cameronking4/nextjs-firecrawl-starter"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
carlosplanchon/spidercreator
Automated web scraping spider generation using Browser Use and LLMs. Streamline the creation of...
raznem/parsera
Lightweight library for scraping web-sites with LLMs
rednafi/html-to-text
Extract pure text from any webpage
supadata-ai/js
Official TypeScript/JavaScript SDK for the Supadata API.
yeahhe365/JustSearch
基于 Playwright 的自主 AI 搜索智能体。支持迭代式任务规划、深度网页爬取，以及带引用来源的多源知识整合。