Beking0912/distributed-paper-search-engine
🕷️ [Graduation Project] Scrapy-Redis distributed crawler + Elasticsearch search engine + Django full-stack application; 论文搜索引擎（含Scrapy-Redis分布式爬虫、Elasticsearch搜索引擎、Django前端）
This project helps researchers, academics, or anyone needing to find specific academic papers by providing a custom search engine. It automatically collects research papers from various sources and then lets users search through them efficiently. The end result is a collection of relevant research papers easily discoverable through a user-friendly interface.
No commits in the last 6 months.
Use this if you need to build and maintain a specialized search engine for research papers, allowing your team or community to quickly find academic content without relying on public search engines.
Not ideal if you are looking for a general-purpose website search engine or a solution to search arbitrary document types beyond academic papers.
Stars
44
Forks
12
Language
Python
License
—
Category
Last pushed
Feb 18, 2023
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/perception/Beking0912/distributed-paper-search-engine"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
scrapy/scrapy
Scrapy, a fast high-level web crawling & scraping framework for Python.
Altimis/Scweet
A simple and unlimited twitter scraper : scrape tweets, likes, retweets, following, followers,...
lexiforest/curl_cffi
Python binding for curl-impersonate fork via cffi. A http client that can impersonate browser...
plabayo/rama
modular service framework to move and transform network packets
scrapinghub/spidermon
Scrapy Extension for monitoring spiders execution.