All Perception Tools

A web parsing script to extract names, addresses, phone numbers, and emails...

OSINT tool to scraping data from someone's Instagram account.

A JavaScript Link Crawler you can inject in the browser.

This repo is mainly for dynamic web (Ajax Tech) crawling using Python,...

HTML parsing and processing tool for PowerShell.

Fancaps Downloader

基于微博用户信息数据的分布式爬虫所做的毕业设计，有一小部分简单的数据分析。这个也是为了纪念大学四年！里面包括了源代码，论文的一稿二稿等等还有查重终稿，UM...

A Python library/CLI for collecting and archiving posts from the Bluesky...

🛒 Fast Rust CLI to search Amazon products with TLS fingerprint emulation....

Facilitates retrieval of large amounts of data from GITAM's results platform

:bar_chart: A web scraping CLI tool for Instagram profiles.

Social Usernames Scraper

Small algorithm for getting Antoine's coefficient to calculate vapor...

A step-by-step tutorial on extracting data from Wayfair’s product pages at...

Check if a Yahoo Email ID is valid using Selenium (Python)

cli for evaluating css and xpath selectors

Browser instructions enable users to execute various Oxylabs' headless...

This project collects Wikipedia articles from a search term entered by the...

Raspagem do Documento de Arrecadação do Simples Nacional MEI

n8n integration with Decodo services, enabling automated web scraping and...

Scrape 99scrape.com with python using curl command and export data as CSV.

Scrapy middleware interface to scrape using ProxyCrawl proxy service

Automated Google Forms submission tool using Selenium WebDriver - 100% success rate

Live train information: scrape-powered API with JSON endpoints for the...

Extract all contacts from any WhatsApp Web group in seconds. Paste a script...

scrapping de imoveis

AI-native browser automation CLI and MCP server for Chrome. 90+ commands....

Build a Web Application that Scrapes Various Websites for Data Related to...

Scala web crawling and scraping using fs2 streams

A nodejs script that scrapes IsaiDub website for Tamil dubbed Movies and TV shows

Scrape websites asynchronously with Python 3.8+, Asyncio, & arsenic (aka...

A web scraping project to track the price of an item on Amazon UK.

Timetable Grabber - SIT is a tool that allows you to grab and export your...

A web crawling programming language

Web-scraping SoundCloud.com tracks' stats using Beautiful Soup and Selenium

A little project that scrapes the discord web client and stores each...

An email crawler written in python.

SOAP - A Sockpuppet Auditing Tool for Very Large Online Platforms

A configurable HTTP/HTTPS proxy written in Go with IPv6 and sticky session support

Amazon Recommendation Scraper

AI-powered job application assistant for Claude Code - fills LinkedIn,...

🌐 Lightweight serverless REST API that scrapes, caches, and returns trending...

Podcast Scraper and Summarizer is an app designed to help users save time...

Scrape Olympedia data efficiently with Threading Concurrency and analyze it...

CLI tool to auto-generate /llm.txt and /llm-full.txt for any website

Tiny package to scrap food recipe from the web

Scrapfly GO SDK for headless browsers and proxy rotation

🧠 A parsing library for Chegg.com written in Python.

A Python script that automatically scrapes email addresses found on websites...

An API to expose Steam games' system requirements. Currently in its first iteration.

Adaptive web agent that run upto 10x faster than pure LLM agents. Learns...

HackerRank challenge solutions

Google images scrapper in full resolution with multi threading speed.

🕸 List of mini projects that involve web scraping 🕸

Python script to fetch Amul Topicals (original:...

An unofficial API for Addgene, the open-source plasmid repository.

Esse repositório é parte dos projetos desenvolvidos pelos membros do...

Bend CSVs to your will with declarative schemas.

Turn any website into clean, structured content that language models can...

npm package scraped from my own web api

This script allows you to download images from posts on the Kemono website...

Get data of stocks and funds that compose the Brazilian stock market.

Keep learning something new

manga translator with support for 100+ languages

Automatically post Github trends on Facebook page

Kotlin Wrapper for Jsoup

Let's build with devtool-parsed CSS!

A dataset of more than 55,000 clothing items in the digikala website and...

A sample dataset of over 1000 TikTok profiles, extracted using the Bright...

HTML parsing with CSS seletors

This project is a set of Python scripts designed to crawl and extract data...

Command line tool for fetching GitHub trending repositories

Web scraping of real estates with Scrapy, pydantic, FastAPI, MongoDB and MinIO

A Python based customizable script for scraping links to videos hosted on...

Fast and reliable Python library to extract and verify payment receipts from...

Repository for the projects needed to complete the Data Analyst Nanodegree.

A collection of tools to (semi-)automatically collect and analyze data from...

Lead generation pipeline for finding potential commercial real estate...

In this Python Web Scraping Tutorial, we will outline everything needed to...

Python web crawler tool

An effective random image scraper for the website image hosting and sharing...

An API wrapper for Scrappey.com written in Python (cloudflare, datadome...

A powerful, stealthy website cloner/scraper built with TypeScript that...

Modern web scraping for when you need the good parts, not the markup soup.

Browser-impersonating HTTP client — TLS, HTTP/2, HTTP/3 fingerprint...

Web scrape of Stephen (Kepano) Trussel's Combined Hawaiian Dictionary for...

Hyper Solutions SDK for Playwright - Bypass Akamai Bot Manager, Incapsula,...

AI-powered web reader for your terminal – Fetch, extract, and summarize...

CLI tool made by reverse engineering Instagram API calls.

JavaScript support and proxy rotation for Scrapy with ScrapingBee.

A fully integrated RSS, ATOM and RDF syndication feed parser

🔴 Web Scraper Application for Pinterest, Made Using TypeScript-Based...

Turn Xiaohongshu links into graph-ready Obsidian knowledge cards with...

covers python basic to advance topics, practice questions, logical problems...

Orchestrate web crawlers to create structured datasets from multiple data...

A Python Windows API for getting the artist, song, and album art for the...

Scrapy middleware interface to a scraper API proxy service

The official CapSolver community node for n8n. This node allows you to...

DotNet Core based declarative web scraping using the Chrome Debugger Protocol

Real Time News Scraping and Recommendation System