leodd/nian-crawler
A web crawler for api.nian.so
This tool helps Nian.so users archive their personal "notebooks" and associated content. You interact with the Nian.so website to initiate a download, which then produces a zip file containing your journal entries, comments, and images. It's designed for anyone who uses Nian.so to document their thoughts, progress, or daily logs and wants a personal, offline backup of their content.
No commits in the last 6 months.
Use this if you are a Nian.so user who wants to download and keep an offline copy of your 'notebook' entries, including text, comments, and images, for personal archiving or reference.
Not ideal if you need to crawl or archive content from websites other than Nian.so, or if you're looking for a general-purpose web scraping solution.
Stars
22
Forks
1
Language
JavaScript
License
—
Category
Last pushed
Mar 27, 2018
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/perception/leodd/nian-crawler"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
scrapy/scrapy
Scrapy, a fast high-level web crawling & scraping framework for Python.
Altimis/Scweet
A simple and unlimited twitter scraper : scrape tweets, likes, retweets, following, followers,...
lexiforest/curl_cffi
Python binding for curl-impersonate fork via cffi. A http client that can impersonate browser...
plabayo/rama
modular service framework to move and transform network packets
scrapinghub/spidermon
Scrapy Extension for monitoring spiders execution.