rodolflying/GPT_scraper
This repository provides a way to scrape full user history (or use) ChatGPT through 2 methods: frontend "hidden" API based or Selenium based, both have their own pros. It can be helpful for avoiding the usage of API credits while still using ChatGPT programmatically
This tool helps you retrieve your entire conversation history with ChatGPT, allowing you to save it as structured data. It takes your existing ChatGPT conversations (from your browser session) and outputs them into organized JSON or CSV files. This is ideal for researchers, data analysts, or anyone who wants to analyze or archive their past interactions with ChatGPT without incurring API costs.
136 stars. No commits in the last 6 months.
Use this if you need to programmatically access and save your past ChatGPT conversations for analysis, backup, or integration into other tools without paying for the OpenAI API.
Not ideal if you need a real-time, robust, or interactive programmatic interface for new ChatGPT conversations, as this project is primarily for scraping historical data and has known limitations due to ChatGPT's evolving protections.
Stars
136
Forks
12
Language
Python
License
—
Category
Last pushed
Sep 27, 2023
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/rodolflying/GPT_scraper"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
jamesturk/scrapeghost
👻 Experimental library for scraping websites using OpenAI's GPT API.
Priyanshu-hawk/ChatGPT-unofficial-api-selenium
This is unofficial ChatGPT API using selenium for prompt testing and flow testing purposes
3281448091/easyChatGPT
An unofficial yet elegant interface of the ChatGPT API using browser automation that bypasses...
ryuseisan/auto-chatgpt
Automate interaction with the browser version of ChatGPT.
Ryaang/gpt-web-crawler
A web crawler for GPTs to build knowledge bases 用于GPT构建知识库的网站爬虫