teng-lin/agent-fetch

Full-content web fetcher for AI agents — Chrome TLS fingerprinting, browser impersonation, and multi-strategy article extraction

53
/ 100
Established

This tool helps anyone working with AI models or content pipelines to get the full, clean text from any webpage. It takes a URL as input and outputs the complete article, formatted in Markdown, just as a human would see it in a browser. This is ideal for AI researchers, content strategists, or anyone building applications that need reliable web content.

189 stars. Available on npm.

Use this if you need to reliably feed the full, unsummarized, and well-structured content of web articles into AI models like RAG pipelines, LLMs, or NotebookLM.

Not ideal if you only need short summaries or basic plain text extraction, or if you prefer a cloud-based API solution with an API key.

AI-content-sourcing web-content-extraction LLM-data-preparation information-retrieval digital-research
Maintenance 13 / 25
Adoption 10 / 25
Maturity 20 / 25
Community 10 / 25

How are scores calculated?

Stars

189

Forks

10

Language

TypeScript

License

MIT

Last pushed

Mar 15, 2026

Commits (30d)

0

Dependencies

10

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/agents/teng-lin/agent-fetch"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.