All Perception Tools

Hybrid tool for passive reconnaissance and attack surface analysis in web...

📋 Chrome extension (MV3) for AdOps teams to bulk-validate ads.txt and...

Web Crawling/Scraping Framework [WIP: Distributed Architecture]

Chaser-Oxide Server - 基于 Tokio + Tonic 的高性能浏览器自动化服务，通过 gRPC/HTTP2 暴露 CDP 接口

A lightweight, dependency free PHP class that acts as wrapper for Crawlbase API

Benson turns a list of URLs into mp3s of the contents of each web page -...

A python project that scrapes data from www.tradingview.com stores it into...

I thought it would be nice to get an email alert when a new job posting...

Real-time Vinted monitor with instant Discord alerts, proxy rotation & a...

Elasticsearch, MongoDB, Tornado Server, RESTful API, Python, Information...

A Scraper, Downloader, & Recorder for static open directories.

Web scraping is simply the process of using a social media web scraper to...

WCXB: Web Content Extraction Benchmark — 2,008 pages, 7 page types, 1,613...

scrapes a website (Selenium, SeleniumBase, undetected chromedriver ...) with...

Latest UserAgents Dumped Various Devices / Platforms

Web scraper to get information about posted jobs in the US from Indeed.com

A browser automation framework written in Kotlin, based on Selenium and Kotest

REST API written in Typescript and Node JS under the concept of Web...

Simple requests based manhwa downloader which uses the Lezhin API.

Scraping selected daily trading data from tsetmc.com (Tehran Stock Exchange)...

:tada: Never miss the lowest price on amazon again!

Utilizing Deep Learning with Web Scraping to solve Amazon CAPTCHA and...

🌐 OpenCrawl: An ethical, high-performance web crawler built for scale A...

A Python-based web application that automates LinkedIn job scraping and...

Schedules tweets using TweetDeck

Dépôt pédagogique du cours "Big Data and Business Intelligence (BIDABI)". Ce...

Scrape and Crawled data from several websites and save data in JSON, CSV,...

Querying, scraping, and parsing of HTML. Good for snapshot testing too!

💼 Scrape freelancer profiles from Free-Work — 18 data fields, Streamlit UI,...

📸 Scrape Instagram profile URLs at scale — auto-scroll, smart filtering,...

Data used in the story 'Libraries lose a quarter of staff as hundreds close'

AI-powered desktop coding assistant built with Tauri (Rust + React) and...

Web Crawler created with Node.js and Puppeteer

A Python package for scraping fantasy football draft rankings across...

Full-stack LinkedIn OSINT toolkit. Four-phase funnel: discover companies by...

Python script- It will simply login into your account and update your status.

CLI for Chrome DevTools Protocol

Scraping YouTube Video Description and Video Likes and Comments and Times...

Selenium Python-based web scraping tool that will allow you to automate google Maps.

Noon.com Search Page and Product Page Scraper. To handle JS rendering and...

Evaluate JavaScript on a URL through headless Chrome browser.

This is web app by streamlit, this app scrape facebook page and show some...

Learning WebScraping using Pandas in python. - Data Science

A Python script that uses Selenium and BeautifulSoup to scrape data from...

Historical Vegas betting lines for the NBA and NFL

Data analysis pipeline using Python, BeautifulSoup, and Jupyter widgets

Web scraping script.

基于 PyQt5 的网络信息抓取工具，支持 Google/Bing/Baidu 多引擎搜索，自动抓取关键词相关内容并保存至本地 | A...

Multi-provider web search CLI for AI agents — Brave, Serper, Exa, Jina,...

Web-Hacking-with-Python

A realtime read-only locator and extraction library for Quora questions and answers.

Self-hosted anti-detect browser profiles. Open-source AdsPower alternative...

Track AWS outages via Git History

Stock Market Sentiment Analysis

See how to easily bypass CAPTCHA tests using Selenium in Python.

Materials to reproduce findings in our story, "Google’s Top Search Result?...

✉️ Use the power of browser-use to contact any person or organization... by...

Insightify is your go-to platform for real-time price comparison,...

🛠️ Streamline your Minecraft experience by routing server connections...

CRM inmobiliario con captación automática de leads · Scraping 4 portales ·...

Extract relevant information of research papers, into a downloadable CSV...

MotoGP Api: Library that reads the results of the MotoGP, 500cc, Moto2 and...

discord bot that monitors the availability of vacancies at unb

SEO Auditing & Rank Tracking Service - Enterprise SEO intelligence platform

Web scraping with Scrapy

Scraper for (german) free dates at the public offices

it is an osint tool which is used to extract information from your facebook...

Weekly scraper of petrol station prices in Spain via MINETUR public API —...

Aggregate business reviews from TrustPilot, BBB, Yelp & Google Places....

Simple, generic web scraper for text written in python3

Girdiğiniz trendyol linkindeki ürünü eğer farklı satıcılar daha ucuz fiyata...

MITM HTTP(S) proxy with integrated load-balancing, rate-limiting and error...

A Python-based web crawler to extract product details (name, price,...

📊 Python tool to scrape real-time information about ETFs from the web and...

Helper functions to use with puppeteer [disclaimer: this is an experimental package]

Job search utility which leverages public Job Scraper APIs and LLM models to...

Intelligent web page comparison tool with Wayback Machine support and visual...

google map scraper. extract title, phone, address, latitude and longitude,...

Hygieia (Desktop Doctor) is a local, private medical diagnosis AI. Runs with...

End-to-end Python ETL pipeline that collects NCAA men's basketball rankings...

Get results from search engines.

Polymarket copy trading bot, wallet tracking, risk controls.

an unofficial simple API from https://distrowatch.com/

A phone number search engine powered by hamsters 🐹

Automated Instagram Followers Scraper using Playwright and GitHub Actions....

A news aggregator app build using django web framework and beautifulsoup...

A Selenium bot that makes purchases for you when an item becomes available...

Xcrap Parser is a parsing package for the Xcrap framework that handles...

Примеры к книге "Сбор данных в Интернете на языке R".

AI-powered Amazon analytics: Get product insights, deal detection, and...

🦀 High-performance HTML parsing library. Rust core with native bindings for...

Herramienta de automatización en Python para extraer ofertas de empleo de...

End-to-end NLP project with news scraping from major Colombian outlets....

Scraping job search results using various APIs

WordpressScraper is a lightweight Python utility that downloads a...

The process of extracting product data from Amazon using Python, including...

Smart desktop application for tracking ADU OBIS grades in real-time....

Data Science Laboratory

A comprehensive project using Python, APIs, web scraping, and data...

In this project, we take you on a journey through the technologies used to...