All Perception Tools

Scraping user comments under posts in certain channels and export in CSV format

A command line interface for scraping GameMaker data files from the GM48 Game Jam.

Cross platform Pastebin scraper developed in C# using .Net Core 3.

Have a favorite dish but want to try something with similar ingredients but...

Automate LinkedIn Easy Apply with stealth browser techniques and AI-driven...

A daily scraper that collects product specifications from Smartprix.com and...

Simple Python script to get current news from teletext, create PDF from it...

A2A agent server for browser automation and web testing using Playwright

Downloads saved Reddit posts

Karanataka Reservoir flow details as reported by Karnataka State Natural...

Data pipeline project that collects and analyzes profiles of successful...

Android Website-Scraping

Allows to bypass Cloudflare checks

A simple scraper for departure time and prices from Jakarta to Bandung from Tiket.com

🚗 Extract and organize vehicle listings from Cars.com into structured data,...

Web scraper for gifcities.org

Applying Optical Character Recogntion, Named Entity Detection, Object...

TikTok scraper used for scraping 2024 European parliament elections....

텍스트 분석용 데이터 수집을 위한 웹스크래핑 도구를 제공합니다.

Distributed web scraping framework

🪡 Social account detection and extraction in ruby, e.g. for crawling/scraping.

Extract data from complex JSON structures using simple query paths. Designed...

🚀 First multimodal AI-powered visual testing plugin for Claude Code. AI that...

An application designed to scrap the web and retrieve information from movie...

UnOfficial Otakudesu API 👀

WebPilot is a powerful, open-source, self-hosted tool that wraps headless...

Easily download anonymous Github repositories from...

Pixurebyte is an open source, self-hostable platform for capturing and...

Deprecated, original repo still maintained. ~~Fork of...

An open source web crawling platform

Get People Also Ask (PAA) questions from Google SERPs with Puppeteer (2019)

Integrate Bright Data's search and scraping APIs with Convex for reactive...

ScrapGen is a "Web-Scraping scripts generator"; an interactive tool, making...

:open_file_folder: Python script to fetch PDF data from Seafile and create a...

Learn how to rotate proxies using JavaScript.

Here is the list of scraping techniques I used to get the data from websites

A web crawler that prints a website to .pdf format

This is a django app for getting the meaning of an English word from command line.

An awesome web scraper powered by CloudScraper to collect video data from jable.tv

The Site Scraper Tool is an ethical hacking program developed in Python that...

scrape, clean and model IPO data with supervised ML

Use Pydoll to scrape JavaScript-heavy sites, bypass Cloudflare, and scale...

A lightweight Telegram bot that fetches news from multiple RSS feeds, stores...

Get the latest MPL-PH Updates from https://ph-mpl.com/

All In One API to easily scrape data from any website, without worrying...

A command line interface to get french :fr: word definitions & synonymes...

Easy to use JQuery-Like API for Web Scraping/Crawling.

First part of real estate prediction price project. - Scraping Immoweb...

A CLI script to check/register courses from KFUPM Banner 9.

A fully functional youtube playlist downloader with no limits.

Official Python SDK for ScrapeBadger - Async web scraping APIs for Twitter and more

Scraping of the MyAnimeList Jikan REST API's internal database (Anime,...

A simple CLI tool to browse GitHub's trending repositories from your terminal.

A Python project that scrapes product data using BeautifulSoup

A blazingly fast 🚀 library for interacting with Stud.IP 📚 written in Rust 🦀

A utility for grabbing the meta tags from a web page.

This is a template repository for building a web scraper using TypeScript...

Web scraping project. We won awards.

Production web scraping agent with JS rendering, rate limiting, proxy...

Data dump + extraction scripts for scraped data from JIC Report 2024 and...

Web scraping do site G1 News

Finds a fork in the tennis matches betting marathonbet and plusminus

A simple shell script written to scrape gym activity data from the PureGym...

In this project, I implemented a Web scraper that extracts product data from...

用python3.5 mongoDB+base64+json格式+python正则表达式+BeautifulSoup库 写的爬取网易音乐的网络爬虫

Package wrapper around Node.js and Puppeteer for web crawling/scraping....

Creating collage of all movie posters from your movies list

This is an awesome tool to scrape and check proxies

Create text effects online , Effects online for free, photo frames, make...

Better visuals for EasyBourse's financial report using scrapping to get the...

API de Resultados das Loterias CAIXA Federal

Product specifications extractor driven by a DOM Classifier.

A web crawler for google scholar authors profiles for authors from Coventry...

Detik News Search Unofficial API

This repository contains a scripts that query MediaCloud for stories and...

This repository contains a Python script that utilizes Beautiful Soup, a...

Tool for retrieving cheapest price for any product comparing across...

A Tumblr-scraping text post bot

This Python script scrapes up to 100 most recent Linkedin job postings of...

Data Analytics Repo: Dive into the world of insights with our collection of...

This script automates the backup process of Notion data into Markdown and...

A tutorial for web scraping with Ruby

Um app para colecta de dados sobre o COVID-19 em Angola.

Random lyrics generator.

What Should I Watch Next? Expert System built using Python/Flask and Prolog.

Crawl DISQUS comments from a blog into a local MongoDB database

Web Scraping and EDA from iFood website data.

Official ZenRows MCP integration

Web Crawler and Scraper

Simple Email Scraper

Music is a powerful language to express our feelings and in many cases is...

🕸→ℹ️ Reap Information from Websites

Go to e-commerce site, select the price, hit the extension button, that's...

API cung cấp thông tin, dữ liệu bệnh nhân về COVID-19!

Este projeto utiliza a linguagem Python e as bibliotecas BeautifulSoup,...

Web scraper and product importer for pharmacy e-commerce data to Shopify....

🛰️ Python-based scraper that automates postal code lookups on the official...

LinkedIn Job Applicant Scraper: A Python-based web scraper using Selenium to...

🌐 LensCore is an open-source, API-first platform for web crawling and...

An awesome list covering PHP scrapers, spiders and crawlers