MultiX0/froxy
🕸️ Froxy – A chill open-source web indexing engine built with Go, Node.js, and Next.js. Crawls, analyzes, and serves structured web data with TF-IDF magic and Supabase as the brain.
This tool helps you build your own private search engine to organize and explore web content. It takes a list of website URLs as input, crawls them, extracts information, and allows you to semantically search through it. It also features an AI-powered search interface that provides summarized answers with sources, making it useful for researchers, analysts, or anyone managing large amounts of web information.
No commits in the last 6 months.
Use this if you need to create a custom, intelligent search solution for specific web content, providing a private alternative to public search engines.
Not ideal if you're looking for a simple, off-the-shelf search bar for a single website or don't have the technical expertise to set up and manage a full-stack application.
Stars
19
Forks
5
Language
TypeScript
License
MIT
Category
Last pushed
Jun 14, 2025
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/perception/MultiX0/froxy"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
scrapy/scrapy
Scrapy, a fast high-level web crawling & scraping framework for Python.
Altimis/Scweet
A simple and unlimited twitter scraper : scrape tweets, likes, retweets, following, followers,...
lexiforest/curl_cffi
Python binding for curl-impersonate fork via cffi. A http client that can impersonate browser...
plabayo/rama
modular service framework to move and transform network packets
scrapinghub/spidermon
Scrapy Extension for monitoring spiders execution.