lexiforest/curl_cffi
Python binding for curl-impersonate fork via cffi. A http client that can impersonate browser tls/ja3/http2 fingerprints.
This tool helps developers perform web scraping or automated data collection from websites that use advanced bot detection. It allows you to fetch web pages as if you were a standard web browser like Chrome or Safari, even when those sites are trying to block automated access. It takes a URL and returns the website's content, making it useful for developers building data pipelines or monitoring tools.
5,297 stars. Used by 26 other packages. Actively maintained with 18 commits in the last 30 days. Available on PyPI.
Use this if you are a developer whose automated scripts are being blocked by websites due to their bot detection mechanisms, and you need to access public web data reliably.
Not ideal if you are looking for a simple web browsing experience or a general-purpose HTTP client without advanced impersonation needs.
Stars
5,297
Forks
461
Language
Python
License
MIT
Category
Last pushed
Mar 25, 2026
Commits (30d)
18
Dependencies
2
Reverse dependents
26
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/perception/lexiforest/curl_cffi"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Related tools
scrapy/scrapy
Scrapy, a fast high-level web crawling & scraping framework for Python.
Altimis/Scweet
A simple and unlimited twitter scraper : scrape tweets, likes, retweets, following, followers,...
plabayo/rama
modular service framework to move and transform network packets
scrapinghub/spidermon
Scrapy Extension for monitoring spiders execution.
soxoj/maigret
🕵️♂️ Collect a dossier on a person by username from 3000+ sites