The Perception Directory
Quality-scored directory of 10,540 perception tools, updated daily. Every tool scored on maintenance, adoption, maturity, and community signals.
Perception tools give AI agents eyes and hands on the web — browser automation, web scraping, data extraction, and anti-detection infrastructure.
37
70–100
314
50–69
2,306
30–49
7,883
10–29
Top tools by quality score
| # | Tool | Score |
|---|---|---|
| 1 |
scrapy/scrapy
Scrapy, a fast high-level web crawling & scraping framework for Python. |
|
| 2 |
seleniumbase/SeleniumBase
APIs for browser automation, testing, and bypassing bot-detection. |
|
| 3 |
browser-use/browser-use
🌐 Make websites accessible for AI agents. Automate tasks online with ease. |
|
| 4 |
Altimis/Scweet
A simple and unlimited twitter scraper : scrape tweets, likes, retweets,... |
|
| 5 |
apify/crawlee-python
Crawlee—A web scraping and browser automation library for Python to build... |
|
| 6 |
lexiforest/curl_cffi
Python binding for curl-impersonate fork via cffi. A http client that can... |
|
| 7 |
plabayo/rama
modular service framework to move and transform network packets |
|
| 8 |
intoli/user-agents
A JavaScript library for generating random user agents with data that's... |
|
| 9 |
apify/crawlee
Crawlee—A web scraping and browser automation library for Node.js to build... |
|
| 10 |
scrapinghub/spidermon
Scrapy Extension for monitoring spiders execution. |
|
| 11 |
D4Vinci/Scrapling
🕷️ An adaptive Web Scraping framework that handles everything from a single... |
|
| 12 |
soxoj/maigret
🕵️♂️ Collect a dossier on a person by username from 3000+ sites |
|
| 13 |
firecrawl/firecrawl
🔥 The Web Data API for AI - Turn entire websites into LLM-ready markdown or... |
|
| 14 |
freelawproject/juriscraper
An API to scrape American court websites for metadata. |
|
| 15 |
Kaliiiiiiiiii-Vinyzu/patchright
Undetected version of the Playwright testing and automation library. |
|
| 16 |
0x676e67/wreq-python
An ergonomic Python HTTP Client with TLS fingerprint |
|
| 17 |
fake-useragent/fake-useragent
Up-to-date simple useragent faker with real world database |
|
| 18 |
php-curl-class/php-curl-class
PHP Curl Class makes it easy to send HTTP requests and integrate with web APIs |
|
| 19 |
orangecoding/fredy
❤️ Fredy - [F]ind [R]eal [E]state [D]amn Eas[y] - Fredy keeps searching for... |
|
| 20 |
bellingcat/auto-archiver
Automatically archive links to videos, images, and social media content from... |
|