All Perception Tools

Xcrap Core is the core package of the Xcrap framework for web scraping,...

Xcrap Puppeteer Client is a package of the Xcrap framework that implements...

A Simple Node App using Cheerio which scrapes YT views from YT video Link

Scrape web pages in parallel, convert them to clean markdown, and navigate...

Scrapy + Playwright Walmart Price & Stock Tracker with Streamlit Dashboard |...

Repository from the text mining tutorial at IIM-L

An ASP.NET web app that automates job search email collection by scraping...

An ASP.NET Web Forms app that discovers and collects email addresses from...

Script that uses WWO's free API to scrape historical weather data.

🔍 Discover archived URLs from the Wayback Machine with this Chrome...

A collection of ASP.NET web crawlers for extracting email addresses from...

A Node.js application to create and manage a personalized calendar TXT file...

Python-based tool for web scraping and content archiving, extracting HTML,...

Crawler for MIT OCW - organized scraping with batch control, timers, and...

🚀 High-performance server for concurrent fetching from multiple web...

Litres promo codes scraper (from lovikod.ru)

An ASP.NET Web Forms app for automated web scraping and email extraction...

Telegram Bot - Mass Group Adder, Telegram Group Scraper and Mass User Messaging.

Proof of Concept of a Price Comparison tool for different suppliers

A Node.js web scraping app with Puppeteer to search job listings and extract...

🤖 Scrape Reddit posts and comments effortlessly with this full-featured...

Creating action recipes to do in browser through ChromeDP by terraform

A script that collects real-time cryptocurrency price, bid-ask spread, and...

:mag_right: This application parses sites and retrieves data associated with...

Sentiment analysis of product reviews posted on https://daraz.pk, an online...

An automated tool for detecting plagiarism in LeetCode coding contests. It...

This code downloads legal filing from Securities Class Action Clearninghouse...

A Node.js application to maintain a personalized calendar TXT file by...

Accuweather APIs free tier allows 50 calls per day. We can bump that number to 100k !

link graber for samehadaku.tv

A news aggregator application

Notifies you when campsites at parks on Recreation.gov become available.

Easy web scraping with AXIOS and JSDOM - this is a mirror of...

Spool: Webscraper

Learn how to extract value from data by ingesting, transforming, storing,...

The Internet of Transport (IoT) aims to provide a toolkit for analysts, data...

Python web-scraping API for Newgrounds

asctb-ct-label-mapper: A package to recommend controlled vocabulary for...

Scraper for Hattrick.org transfer market

ETF Scraper: This script saves you time when searching for Exchange Traded...

A simple Python web scraper that gets lift and run data from any of Vail...

Built a centralized discovery platform that aggregates 1,600+ fan-made...

WEB+DB PRESS Vol.109 特集「速習Puppeteer──ヘッドレスChromeでテスト＆スクレイピング」サンプルコード

Effortlessly extract valuable data from Google Maps with precision and speed...

Mapping sites to AniList and back.

Halo, ini merupakan repository data scraping dari website airlinequality.com...

🌊 datadiver-ai is the ultimate tool for 📊 web scraping, transforming 🕸️...

Garibaldo é um robô escrito em Python que faz buscas periódicas no Google e...

Research Project to analyse the knowledge about Alcoholics Anonymous in public

goodreads.com scraper that written in Python with Scrapy framework

Python API for University of Washington (UW) Course Catalog and Time...

A web crawler built in the Go programming language

a set of samples about Login & Cookie with PhantomJS

Explore a website recursively and download all the wanted documents (PDF, ODT…)

Privacy Shield Browser is a robust, open-source-based solution designed to...

a Facebook comment scraping tool, facilitating the exploration and analysis...

This is the data collection mechanism for the dataset acquisition process of...

Analysis platform for scraping data powered by Docker.

WebGrab is a simple Go library which allows for easy scraping of web pages.

🎬 Download anime episodes automatically from AnimePahe with full control...

DMM モバイル の「データ通信量」を取得してCSVで出力する

🐍 Streamline web scraping with the ScrapeBadger Python SDK for quick and...

🕵️♂️ Generate web scrapers effortlessly with AI-Cursor-Scraping-Assistant,...

Распиши-ка — удобные расписания МПК ТИУ

Sistema de monitorização de preços focado no mercado português. Faz scraping...

Precios Claros (http://preciosclaros.gob.ar) scraper / data downloader

High-performance Python proxy library with SOCKS5/HTTP, async, and zero dependencies.

ruby CLI to scrape hrefs from single webpages

Program that scrapes chosen subreddits for video ideas and generates them...

Web Scraping and Data Parsing Using Beautiful Soup

This package downloads all public GAO reports and returns a cleaned dataset...

Firstly, I like to thank "Ahmed Aly" for making this awesome site. This...

Set college timetable for a week on google calendar,based on the timetable...

A Web Monitor that tracks newly added sneaker raffles on the Sole Retriever...

Product price comparison scrapy crawler

📚 Start enhancing your macroeconomic analysis skills with practical training...

The library provides convenient access to the Outscraper API from...

Typescript type definitions for Nightmare v2.10.0

Download sites with public proxies - threading

Scraping library to retrieve data from useful pages, such as Amazon wishlists

競馬・競艇レースデータの自動収集ツール — Selenium / BeautifulSoup / Docker

I am determined to improve my basic core skills of python and data science...

Redgif Downloader: A Python script to efficiently download videos from...

「小説家になろう」の新着小説をチェックする

manga_down is a tool to download manga from mangareader and mangapanda

This is a simple web scraper for LinkedIn. It goes through all contacts and...

Fastest scraping using multiple apps and user tokens for Twitter API!

Web App that enables users to quickly find jobs they're best suited for.

A lightweight, java class that acts as wrapper for Crawlbase API

Scrape the latest Image from the Wildspitz Roundshot Webcam in Full Quality

Java based web-crawler program which makes use of pool based...

GPRO Setup and Strategy APP/Calculator

Article title, authors, date and body extraction dataset.

Twitter bot that tweets ATP & ITF tennis scores by web scraping data

Cookie Tester is an utility website that helps verifying cookies retention...

Customizable Web Scrapper to get alerts when criteria is met on web sites.

RU Menu Getter and Data Analysis automates fetching daily menus from various...

Raspagem/coleta dos preços de combustíveis em Joinville/SC

This repository houses a Python script that employs Selenium for web...

GitHub scraping tool and library