WayneChang65/ptt-crawler
ptt-crawler is a web crawler module designed to scarpe data from Ptt.
This tool helps gather information from Ptt, Taiwan's largest BBS, for analysis. You tell it which Ptt boards and how many pages to look at, and it provides post titles, authors, dates, recommendation counts, and even full content including comments. It's designed for data analysts, researchers, or anyone needing to collect large amounts of public opinion or trend data from Ptt.
Available on npm.
Use this if you need to quickly and efficiently collect structured data from multiple Ptt boards for sentiment analysis, trend tracking, or academic research.
Not ideal if you are not comfortable with basic programming concepts or only need to scrape a few posts manually.
Stars
23
Forks
10
Language
TypeScript
License
MIT
Category
Last pushed
Apr 02, 2026
Commits (30d)
0
Dependencies
6
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/perception/WayneChang65/ptt-crawler"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Related tools
scrapy/scrapy
Scrapy, a fast high-level web crawling & scraping framework for Python.
Altimis/Scweet
A simple and unlimited twitter scraper : scrape tweets, likes, retweets, following, followers,...
lexiforest/curl_cffi
Python binding for curl-impersonate fork via cffi. A http client that can impersonate browser...
plabayo/rama
modular service framework to move and transform network packets
scrapinghub/spidermon
Scrapy Extension for monitoring spiders execution.