All Perception Tools

MultiSites-Scraping

Production-grade HTTP scraping for Go with stable transports, version-aware...

chatbot for BITSAT and BITS

Scrape websites in Python using regex, parse HTML effectively, and handle...

Balanced as all things should be.

A comparative study of various models for prediction of Win/Loss of a...

An effective android library that can be used for web scraping by supplying...

Xiaohongshu user posts scraper tool

This group project analyzes movie data in the box office and award shows,...

A POSIX shell-based web scraper that generates daily call lists of...

🌑 Dark web operations toolkit | Tor hidden services, .onion | NullSec...

A DOM-based browser agent that can tackle anything.

My adventures with python!!

Customize and rotate the User-Agent header in cURL for more effective web...

Scrape DuckDuckGo search results using a free Python scraper or scale with...

Simple web scraping from public website using headless mode.

🏠A Python Streamlit app that provides data visualization and a comprehensive...

A Python automation tool that monitors multiple sources for new SHiFT codes...

Python web-scraping program to obtain data for every tournament played by...

This repository provides all kinds of crawling tools, e.g. image-crawler,...

Web scraper to collect Tesla Supercharger locations. Final project for DSCI 511.

💨 SUPER SONIC WORDPRESS CHECKER

A Command Line Interface to automate/assist the job search and application process.

Competitive analysis tool for tracking competitor websites, features, and...

Web scraper with zero dependencies — CSS selectors, JSON/CSV output, crawl...

A drop-in replacement for playwright-core patched with rebrowser-patches. It...

ScrapySite,go Web Crawler（spider）, scraping，intelligence gathering

An English-Russian dictionary, created with Python and Java. A desktop qt...

web scraping using python. Scrap valuable amd important data from top...

Real estate data gathering and notification

Crawler thống kê danh sách thí sinh đăng kí xét tuyển DH 2015 vào các trường.

Detect every technology behind any website — frameworks, CMS, analytics,...

Perfumehub API with e-mail sending on Render

A handy Web Scraping tool using python

Dynamic xpath building

Filtering Political Bias in American News Media

This tool allows developers to have quick access to the TikTok popular...

Bot avanzado para buscar y analizar empleos en LinkedIn con inteligencia...

Twitter network of members of the 19th German Bundestag

A web scraping application that generates acrostic mnemonic devices by...

This is pretty basic example of web page crawling in java and is not fully...

LLM-based Tinder bot with message-count–driven conversation rules, adaptive...

Tapology Network is a data science project that scrapes MMA fighter data...

Web scraping script (with Python and Selenium) to automatically compile list...

Cara mudah untuk mendapatkan data ulasan pelanggan secara keseluruhan yang...

In these project files, I will host the web scraping examples that I will...

Scrapegraph AI Tutorial; Scrape websites easily with LLaMA AI

Rubiks cube solver using web-browser automation

A Python-based web scraping tool designed for extracting vehicle listings...

Scratch the results of Google traffic images of cities, regions, etc.

This is a simple horoscope API built with Next.js, providing endpoints to...

Flarecrawl CLI — Cloudflare Browser Rendering alternative to Firecrawl,...

Scrape product data from Pinduoduo (拼多多) - China's largest group-buying...

press (news) release scraper for specific company

InstaMOU is an OSINT oriented tool designed to extract publicly accessible...

Dataset, Models, and Demo for Visual Section Detection on Web Pages

Check when my apartment is available scraping airbnb and booking (no browser needed)

🔭 GitHub repository intelligence spider — crawls the GraphQL API to discover...

A robust and easy-to-use Golang client library for the PhantomJsCloud API.

Firecrawl web scraping bridge — crawl, scrape, and extract structured data...

Scrap web HTML using PHP

Extract public emails from Google Search snippets with Python and the...

hianime-api is a Node.js-based API that scrapes data from hianime.to,...

Sort Smarter, Not Harder – AI-Driven Data Sorting & Filtering for Every Web Page.

🤖 Discover 500+ verified bots and web crawlers from CloudFlare Radar for...

Full-stack job discovery and pipeline tracker with multi-source parsing and...

Reverse-engineer web apps into deployable codebases. URL-to-codebase cloning...

n8n community node for AlterLab web scraping API — anti-bot bypass, JS...

🎬 Analyze YouTube creators with unique metrics to determine brand...

Extract Instagram posts, profiles, reels, and comments at scale. Powered by...

Web extraction runtime for browser-driven crawling and durable ingestion

Automated Trustpilot review scraper using Python and Selenium

Pipeline to detect dataset presence in research papers

An GitHub action to capture a screenshot of a webpage.

Automated pipeline that downloads YouTube's weekly music charts, enriches...

WebScraping project for Independent Study at UW Madison - Spring 2020 & Fall 2020

No-code web scraping with plain English — powered by BrightData Scraping...

This repository combines Lectures and Exercises from the Data Science 4...

Implementation of different Information Retrieval Systems to evaluate and...

Chrome extension to capture web pages as WebSketch IR.

Парсер для получения списка игровых ноутбуков с их комплектующими с сайта...

Simple bespoke Python web crawler

Automated LeetCode problem solver using Puppeteer browser automation. Bulk...

💲Make spreadsheets out of Chicago Association of REALTORS® reports

🌍 Discover and access a curated list of public APIs to enhance your...

🎬 Extract detailed IMDb data effortlessly with IscrapeMDB, a robust tool for...

🕷️ Crawl and mirror modern SPAs with optional login, capturing dynamic...

netjsonmon is a CLI for discovering and ranking JSON API endpoints from real...

A high-performance, stealth Instagram Story archiver engineered in Rust....

Arabic Web Scraper for ML — scrape, clean, detect dialect, export...

A Python tool to monitor websites and detect content changes automatically.

Web app for MSRIT results.

A TypeScript web content analyzer with scraping, authentication, and...

Este é o pacote core da Afilimax, ele é responsável por carregar nossas...

Using scrapy library to crawl in Google Play and scrap apps information.

List of best web crawlers to extract data from the web. Find web crawling...

Compare flight prices across countries with VPN-aware search, multi-site...

A high performance web archiving and mirroring tool built with Python,...

SemanticFeed is a full-stack news aggregator built with FastAPI and...

🛬 An automated solution to scrape data from various flight companies using...