methylDragon/news-anaCrawler
Article Dataset Generator for Internet News Sites. Crawls news sites, analyses them with NLP (sentiment analysis), and pushes to a database.
This project helps individuals identify potentially misleading or fake news articles by analyzing content from various internet news sites. It takes news articles as input, assesses their legitimacy using natural language processing (sentiment analysis) and other algorithms, and provides a score. This tool is designed for everyday internet users who want to be more informed and verify the accuracy of the news they consume.
No commits in the last 6 months.
Use this if you are concerned about misinformation and want an initial assessment of a news article's trustworthiness and related context before forming an opinion or sharing it.
Not ideal if you need a definitive, legally-binding fact-check from a human expert or if you're looking for an automated system to replace critical human judgment entirely.
Stars
8
Forks
2
Language
Jupyter Notebook
License
GPL-3.0
Category
Last pushed
Oct 25, 2017
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/perception/methylDragon/news-anaCrawler"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
scrapy/scrapy
Scrapy, a fast high-level web crawling & scraping framework for Python.
Altimis/Scweet
A simple and unlimited twitter scraper : scrape tweets, likes, retweets, following, followers,...
lexiforest/curl_cffi
Python binding for curl-impersonate fork via cffi. A http client that can impersonate browser...
plabayo/rama
modular service framework to move and transform network packets
scrapinghub/spidermon
Scrapy Extension for monitoring spiders execution.