aFunnyStrange/scrapy_cffi
An asyncio-style web scraping framework inspired by Scrapy, powered by curl_cffi, supported TLS, Http/Websocekt.
This framework helps developers build web scrapers that can gather data from websites and WebSockets efficiently. You provide it with instructions on what data to extract, and it outputs the structured information from various online sources. It's designed for Python developers who need to collect data programmatically and at scale.
Available on PyPI.
Use this if you are a Python developer needing to build highly concurrent and scalable web scraping solutions that can handle both standard HTTP and WebSocket data sources.
Not ideal if you need a no-code or low-code solution for web scraping, or if you are not comfortable with Python development.
Stars
7
Forks
—
Language
Python
License
—
Category
Last pushed
Dec 13, 2025
Commits (30d)
0
Dependencies
12
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/perception/aFunnyStrange/scrapy_cffi"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
scrapy/scrapy
Scrapy, a fast high-level web crawling & scraping framework for Python.
Altimis/Scweet
A simple and unlimited twitter scraper : scrape tweets, likes, retweets, following, followers,...
lexiforest/curl_cffi
Python binding for curl-impersonate fork via cffi. A http client that can impersonate browser...
plabayo/rama
modular service framework to move and transform network packets
scrapinghub/spidermon
Scrapy Extension for monitoring spiders execution.