Trending Perception Tools

📰 Newspaper4k a fork of the beloved Newspaper3k. Extraction of articles,...

List of libraries, tools and APIs for web scraping and data processing.

OSINT cheat sheet, list OSINT tools, wiki, dataset, article, book , red team...

:rocket: An open source alternative to searx which provides a modern-looking...

Snoop — инструмент разведки на основе открытых данных (OSINT world)

AgentQL is a suite of tools for connecting your AI to the web. Featuring a...

AIPex: AI browser automation assistant, no migration and privacy first....

all-in collection of productivity scripts, CLI tools, utility libraries,...

Scrape data on MtG decks

Latest UserAgents Dumped Various Devices / Platforms

Versammlungen in Berlin: Konservieren historischer Daten.

A scalable, mature and versatile web crawler based on Apache Storm

web spider to scan UR avialbe room and output as csv

List of anti-detect and humanizing tools and browsers, including captcha...

Unofficial NHentai, with other provider like KomikTap and Crotpedia

Scrapes Every Email Address of Every Society in Every University

Extract, crawl, and scrape web data efficiently with a powerful open-source...

📇 A growing collection of html2rss feed configs. Generate configs with the...

📰 Build RSS 2.0 feeds from websites (and JSON APIs) automatically or with a...

Automatic proxy pool for web scraping - crawls, validates, and rotates...

Solve hCaptchas with Bright Data's advanced AI-driven CAPTCHA Solver,...

Ferret CLI

INGenious Playwright Studio

Extract list of results from search engines pages as CSV with a bookmarklet...

RobloxUserInfoExtractor is a powerful tool designed to retrieve...

Best and simplest tool for website change detection, web page monitoring,...

A completely revamped and redesigned fork, reimagined from scratch based on...

🕷️ Advanced news scraper for major Bangladeshi newspapers with...

Board game data scraper

UPDATED 2026: Kemono / Coomer Scraper / Downloader / Auto-Retry / Compression

Web crawling tool that integrates with AI assistants via the MCP

Current Antarctic large iceberg positions derived from ASCAT and OSCAT-2

Auction schedules data miner

A music discovery app and playlist generation tool for streamers on Twitch

A guide on how to scrape JavaScript rendered websites with Python and BeautifulSoup.

💼 Go-based job aggregator that scrapes and consolidates software...

Sharesansar Nepal NEPSE daily share price data scraping with Python. Scrapes...

Extracting the "dot plot" economic projections posted online by the Federal...

Multi-user AIO Proxy Manager

这是一个基于Spring...

A tool for creating Pandoc compatible markdown files of...

Ui.Vision Open-Source RPA Software with Computer Vision, OCR, Anthropic...

JavaScript / TypeScript SDK for Bot Protection Bypass - Automate Akamai,...

A step-by-step tutorial on extracting data from Wayfair’s product pages at...

Repo Python

:movie_camera: R data package to explore Pixar films, the people, and reception data

🌱 goClone - clone websites in seconds

📈 Automate Stock orders for Fidelity, Chase, Vanguard, Schwab, & more across...

Learn how to build your own Google Jobs scraper that simultaneously scrapes...

🔥 The open-source no-code platform for web scraping, crawling, search and AI...

In this tutorial, we showcase how to scrape public Google data with Python...

Lightpanda: the headless browser designed for AI and automation

An API to scrape American court websites for metadata.

The simplest demo of chrome automation by python and selenium in AWS Lambda

Pydoll is a library for automating chromium-based browsers without a...

Run a high-fidelity browser-based web archiving crawler in a single Docker container

Internet search engine for text-oriented websites. Indexing the small, old...

Internet-in-a-Box - Build your own LIBRARY OF ALEXANDRIA with a Raspberry Pi !

Template for creating a City Scrapers project in your area

PHP Curl Class makes it easy to send HTTP requests and integrate with web APIs

scrape data from Google Maps. Extracts data such as the name, address,...

A web scraper that extract curated content from newsletter, making a great...

Spiderbuf 是一个专注于 Python...

Website-downloader is a powerful and versatile Python script designed to...

Scalable Python web scraping scripts for +40 popular domains

Scraping the TikTok discovery web API every 15 minutes using Github Actions...

A Python script that scrapes your Wealthsimple activity history and saves...

Browser fingerprinting tools for anonymizing your scrapers. Developed by Apify.

DPULSE - Tool for complex approach to domain OSINT

The Apify SDK for Python is the official library for creating Apify Actors...

estela Command Line Client 🕸

The repository and website hosting the peer review process for new...

Wyndace's python scraping dev kit

An Unofficial REST API for vlr.gg, a site for Valorant Pro Esports match...

estela, an elastic web scraping cluster 🕸

Educative.io Course Downloader developed using Python and Selenium. Refer...

中央競馬に出走する母父キングヘイローの競走馬を一覧にしたページ

🧰 A collection of automation tools for Instagram 📱| Written in Python 🐍 |...

Lookyloo is a web interface that allows users to capture a website page and...

High-performance HTML5 parser for Ruby based on Lexbor, with support for...

State-of-the-art web crawler 🔱

Scrape, standardize and share public meetings from local government websites

Intervention layer with audit logs for OpenClaw agents. Browser-aware....

Powerful Telegram bot for web scraping and crawling. Fast, easy, and loved...

Ignareo the Carillon, a web crawler/spider template of ultimate high...

A collection of intel and usernames scraped from various cybercrime sources...

Python quick start guides to get the most out of Oxylabs' Web Scraper API free trial.

A curated list of awesome tools, utils and projects using Playwright

Home Assistant custom component for scraping (html, xml or json) multiple...

Scraping publicly-accessible Letterboxd data and creating a movie...

The 4CAT Capture and Analysis Toolkit provides modular data capture &...

Provides a list of fresh, working proxy servers (HTTP, HTTPS, SOCKS4 &...

Wget-AT is a modern Wget with Lua hooks, Zstandard (+dictionary) WARC...

Track changes on websites via git

📰 Diários oficiais brasileiros acessíveis a todos | 📰 Brazilian...

A script that lets you download mangas from mangafox.com

Free Proxy List Updated every 10 minutes

🎸 automatically aggregates Cleveland-area concerts in one place

Anti-detect browser for web scraping and automation. Engine-level...

DeepState Map | Occupied | GeoJSON Multipolygon | Daily update