crawlcore/qcrawl
qcrawl - fast async web crawling & scraping framework for Python.
If you need to automatically gather information from many websites, qCrawl helps you collect that data quickly and efficiently. You provide the web addresses and rules for what information to extract, and it delivers the scraped data in formats like JSON, CSV, or XML. This tool is for developers who build data collection systems for businesses, researchers, or data analysts.
Available on PyPI.
Use this if you are a developer tasked with building a robust and high-performance system for extracting structured data from numerous web pages.
Not ideal if you need a no-code solution for simple, one-off data extraction or if you are not comfortable with Python programming.
Stars
98
Forks
3
Language
Python
License
MIT
Category
Last pushed
Dec 07, 2025
Commits (30d)
0
Dependencies
8
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/perception/crawlcore/qcrawl"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
scrapy/scrapy
Scrapy, a fast high-level web crawling & scraping framework for Python.
Altimis/Scweet
A simple and unlimited twitter scraper : scrape tweets, likes, retweets, following, followers,...
lexiforest/curl_cffi
Python binding for curl-impersonate fork via cffi. A http client that can impersonate browser...
plabayo/rama
modular service framework to move and transform network packets
scrapinghub/spidermon
Scrapy Extension for monitoring spiders execution.