All Perception Tools

10,540 tools ranked by quality score · Page 2 of 106

Showing 101–200 of 10,540
# Tool Score Tier
101 skernelx/tavily-key-generator

Multi-service toolkit for Tavily and Firecrawl signup automation, key...

61
Established
102 simonw/shot-scraper

A command-line utility for taking automated screenshots of websites

61
Established
103 apify/actor-scraper

House of Apify Scrapers. Generic scraping actors with a simple UI to handle...

61
Established
104 daniel-hauser/moneyman

Automatically save transactions from all major Israeli banks and credit card...

61
Established
105 alperensert/capmonster_python

Capmonster.cloud library for Python3

61
Established
106 axsddlr/vlrggapi

An Unofficial REST API for vlr.gg, a site for Valorant Pro Esports match...

61
Established
107 BITS-Rohit/CamouChat

CamouChat : A stealth-first Python SDK for cross-platform messaging...

61
Established
108 microlinkhq/is-antibot

Detect anti-bot protection from 20+ providers — CloudFlare, Akamai,...

61
Established
109 apache/nutch

Apache Nutch is an extensible and scalable web crawler

61
Established
110 digitalmethodsinitiative/4cat

The 4CAT Capture and Analysis Toolkit provides modular data capture &...

61
Established
111 jikan-me/jikan-rest

The REST API for Jikan

61
Established
112 niklak/dom_query

A Flexible Rust Crate for DOM Querying and Manipulation

61
Established
113 daijro/camoufox

🦊 Anti-detect browser

61
Established
114 OWASP/D4N155

OWASP D4N155 - Intelligent and dynamic wordlist using OSINT

60
Established
115 holgerd77/django-dynamic-scraper

Creating Scrapy scrapers via the Django admin interface

60
Established
116 crawler-commons/crawler-commons

A set of reusable Java components that implement functionality common to any...

60
Established
117 Panniantong/Agent-Reach

Give your AI agent eyes to see the entire internet. Read & search Twitter,...

60
Established
118 City-Bureau/city-scrapers-template

Template for creating a City Scrapers project in your area

60
Established
119 Jieyab89/OSINT-Cheat-sheet

OSINT cheat sheet, list OSINT tools, wiki, dataset, article, book , red team...

60
Established
120 Kaliiiiiiiiii-Vinyzu/patchright-nodejs

Undetected NodeJS version of the Playwright testing and automation library.

60
Established
121 thisisparker/xword-dl

▞ Command line tool to scrape crosswords from online solvers and save them...

60
Established
122 jocmp/mercury-parser

Extract meaningful content from the chaos of a web page

60
Established
123 kevinzg/facebook-scraper

Scrape Facebook public pages without an API key

60
Established
124 champmq/TheScrapper

Scrape emails, phone numbers and social media accounts from a website.

60
Established
125 mawrkus/jason-the-miner

⛏ A versatile Web scraper for Node.js

60
Established
126 EchterAlsFake/eaf_base_api

a base networking component for EchterAlsFake's Porn APIs

59
Established
127 EchterAlsFake/xvideos_api

Unofficial Python client for xvideos.com: search, metadata extraction, and...

59
Established
128 City-Bureau/city-scrapers-core

Core functionality for City Scrapers projects

59
Established
129 scrapy-plugins/scrapy-zyte-smartproxy

Zyte Smart Proxy Manager (formerly Crawlera) middleware for Scrapy

59
Established
130 EchterAlsFake/missAV_api

Unofficial Python client for missav.ws: search, metadata extraction, and...

59
Established
131 crawlab-team/crawlab

Distributed web crawler admin platform for spiders management regardless of...

59
Established
132 JuroOravec/crawlee-one

Production-ready web scraping in a single function call. Built on Crawlee.

59
Established
133 alephdata/memorious

Lightweight web scraping toolkit for documents and structured data.

58
Established
134 adryfish/fingerprint-chromium

An open source fingerprint browser based on Ungoogled Chromium. 指纹浏览器 隐私浏览器

58
Established
135 EchterAlsFake/xhamster_api

a Python API for xhamster.com using web-scraping to provide an easy to use interface

58
Established
136 TheGP/untidetect-tools

List of anti-detect and humanizing tools and browsers, including captcha...

58
Established
137 david96182/ninjemail

Python library for automated email account creation. Create multiple...

58
Established
138 lorien/grab

Web Scraping Framework

58
Established
139 jacebrowning/pomace

Dynamic page objects for browser end-to-end testing.

58
Established
140 john-doherty/selenium-cucumber-js

Browser automation framework written in pure JavaScript using official...

58
Established
141 gocolly/colly

Elegant Scraper and Crawler Framework for Golang

58
Established
142 shaikhsajid1111/facebook_page_scraper

Scrapes facebook's pages front end with no limitations & provides a feature...

58
Established
143 PKHarsimran/website-downloader

Website-downloader is a powerful and versatile Python script designed to...

58
Established
144 internetarchive/Zeno

State-of-the-art web crawler 🔱

58
Established
145 vifreefly/kimuraframework

Write web scrapers in Ruby using a clean, AI-assisted DSL. Kimurai uses AI...

58
Established
146 php-embed/Embed

Get info from any web service or page

58
Established
147 juancarlospaco/faster-than-requests

Faster requests on Python 3

57
Established
148 Magic-Fish-Labs/Ecole-Directe-Plus

A better EcoleDirecte (unaffiliated): more pleasant, functional, and...

57
Established
149 JettChenT/scan-for-webcams

scan for webcams on the internet

57
Established
150 coko7/vegapull

👒 One Piece TCG data scraper written in Rust

57
Established
151 code4craft/webmagic

A scalable web crawler framework for Java.

57
Established
152 haxsysgit/autopahe

Automatically download all your favorite anime from AnimePahe

57
Established
153 pegasi-ai/clawreins

Intervention layer with audit logs for OpenClaw agents. Browser-aware....

57
Established
154 shaikhsajid1111/social-media-profile-scrapers

Fetch user's data across social media

57
Established
155 lkuffo/web-scraping

Más de 50 ejemplos de web scraping utilizando: Requests | Scrapy | Selenium...

57
Established
156 ivan-sincek/scrapy-scraper

Web crawler and scraper based on Scrapy and Playwright's headless browser.

57
Established
157 EchterAlsFake/hqporner_api

Unofficial Python client for hqporner.com: search, metadata extraction, and...

57
Established
158 ZoranPandovski/BookingScraper

:earth_americas: :hotel: Scrape Booking.com :hotel: :earth_americas:

57
Established
159 HarryShomer/Hockey-Scraper

Python Package for scraping NHL Play-by-Play and Shift data

57
Established
160 ScriptSmith/socialreaper

Social media scraping / data collection library for Facebook, Twitter,...

57
Established
161 scrapfly/n8n-nodes-scrapfly

Scrapfly n8n integration

57
Established
162 jiusanzhou/flutter_notification_listener

Flutter plugin to listen for and interact with all incoming notifications...

57
Established
163 Prem-ium/Auto-StockTrader

📈 Automate Stock orders for Fidelity, Chase, Vanguard, Schwab, & more across...

57
Established
164 sangaline/wayback-machine-scraper

A command-line utility and Scrapy middleware for scraping time series data...

57
Established
165 kastaid/getter

A powerful and customizable Telegram userbot built with Telethon

57
Established
166 Anshu78780/ScarperApi

Its a Scarper api that will give you direct movie data in ur local machine...

56
Established
167 Virtual-Browser/VirtualBrowser

Free anti fingerprint browser, 指纹浏览器, 隐私浏览器, 防识别浏览器, 反识别浏览器, 防关联浏览器,...

56
Established
168 EchterAlsFake/EPorner_API

Unofficial Python client for EPorner.com: search, metadata extraction, and...

56
Established
169 cdpdriver/zendriver

A blazing fast, async-first, undetectable webscraping/web automation...

56
Established
170 Xonshiz/comic-dl

Comic-dl is a command line tool to download manga and comics from various...

56
Established
171 a-luna/vigorish

MLB data web scraper, Python CLI application

56
Established
172 minkphp/Mink

PHP web browser emulator abstraction

56
Established
173 AutomaApp/automa

A browser extension for automating your browser by connecting blocks

56
Established
174 EnsembleData/ensembledata-python

Python library to scrape social media data via the EnsembleData API.

56
Established
175 sangaline/scrapy-wayback-machine

A Scrapy middleware for scraping time series data from Archive.org's Wayback Machine.

56
Established
176 hyperbrowserai/examples

Examples for using Hyperbrowser

56
Established
177 arhcoder/Club-de-Programacion-Creativa

🍇 Club de Programación Creativa: Si algo es automatizable, lo automatizamos;...

56
Established
178 alecxe/scrapy-fake-useragent

Random User-Agent middleware based on fake-useragent

56
Established
179 aapatre/Automatic-Udemy-Course-Enroller-GET-PAID-UDEMY-COURSES-for-FREE

Do you want to LEARN NEW STUFF for FREE? Don't worry, with the power of...

56
Established
180 sparklemotion/mechanize

Mechanize is a ruby library that makes automated web interaction easy.

56
Established
181 spmedia/Threat-Actor-Usernames-Scrape

A collection of intel and usernames scraped from various cybercrime sources...

56
Established
182 hackersandslackers/beautifulsoup-tutorial

:sparkles: :ramen: Scrape webpage metadata using BeautifulSoup.

56
Established
183 sananth12/ImageScraper

:scissors: High performance, multi-threaded image scraper

56
Established
184 apify/apify-sdk-python

The Apify SDK for Python is the official library for creating Apify Actors...

56
Established
185 roperi/UpworkScraper

UpworkScraper allows you to scrape your best matches job postings from Upwork.

56
Established
186 httptoolkit/browser-launcher

Detect the browser versions available on your system, and launch them in an...

55
Established
187 hebertcisco/pensador-promise

Frases do Pensador via WebScraping: https://github.com/hebertcisco/pensador-api

55
Established
188 shaikhsajid1111/twitter-scraper-selenium

Python's package to scrap Twitter's front-end easily

55
Established
189 rike422/kirinuki-core

Kirinuki is a library that convert any html to JSON using CSS selectors.

55
Established
190 brendonboshell/supercrawler

A web crawler. Supercrawler automatically crawls websites. Define custom...

55
Established
191 sdl60660/letterboxd_recommendations

Scraping publicly-accessible Letterboxd data and creating a movie...

55
Established
192 ScrapeGraphAI/scrapegraph-py

Official Python SDK for the ScrapeGraph AI API. Smart scraping, search,...

55
Established
193 new92/instatools

🧰 A collection of automation tools for Instagram 📱| Written in Python 🐍 |...

55
Established
194 Tomas2D/puppeteer-table-parser

Scrape and parse HTML tables with the Puppeteer table parser.

55
Established
195 nice-digital/wdio-cucumber-steps

Shared step definitions for Cucumber JS BDD tests in WebdriverIO

55
Established
196 pavanad/emec-api

API Python para consulta na base de dados oficial do e-MEC

55
Established
197 gitrecon1455/fresh-proxy-list

Free Proxy List Updated every 10 minutes

55
Established
198 kichik/email-scraper

Simple Python library to scrape email addresses from HTML

55
Established
199 druzsan/justetf-scraping

Scraping the justETF

55
Established
200 Overmiind/Puppeteer-sharp-extra

Plugin framework for PuppeteerSharp

55
Established