imsanjoykb/Data-processing
Scrape Job Portal Data
This helps recruiters, HR professionals, and job market analysts gather specific job posting data from multiple online job portals like Indeed, Monster, and LinkedIn. It takes raw web page content as input and outputs a clean, merged dataset of job listings with consistent columns such as company name, job title, city, experience, skills, and salary. This is for anyone who needs to systematically collect and analyze job market trends or competitive hiring information.
No commits in the last 6 months.
Use this if you need to build a comprehensive dataset of job postings by scraping information from various job board websites and want to ensure the data is cleaned and uniformly structured for analysis.
Not ideal if you only need to look at a few job postings manually or if you require real-time, instantaneous updates for very high-frequency data collection.
Stars
10
Forks
1
Language
Python
License
Apache-2.0
Category
Last pushed
Oct 28, 2021
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/perception/imsanjoykb/Data-processing"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
scrapy/scrapy
Scrapy, a fast high-level web crawling & scraping framework for Python.
Altimis/Scweet
A simple and unlimited twitter scraper : scrape tweets, likes, retweets, following, followers,...
lexiforest/curl_cffi
Python binding for curl-impersonate fork via cffi. A http client that can impersonate browser...
plabayo/rama
modular service framework to move and transform network packets
scrapinghub/spidermon
Scrapy Extension for monitoring spiders execution.