SpareCores/sc-crawler
Pull and standardize data on cloud compute resources.
This tool helps operations managers and cloud cost analysts track and compare compute resource pricing across different cloud providers. It takes raw pricing data from various cloud services and standardizes it into a consistent format. The output is organized, updated data on cloud compute resources, perfect for integration into a database.
Use this if you need to gather, standardize, and maintain an up-to-date database of cloud compute resource pricing for cost analysis or inventory management.
Not ideal if you only need to check current pricing for a single cloud service on an ad-hoc basis, or if you require real-time streaming price updates.
Stars
14
Forks
5
Language
Python
License
MPL-2.0
Category
Last pushed
Mar 18, 2026
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/data-engineering/SpareCores/sc-crawler"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
PrefectHQ/prefect
Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
growthbook/growthbook
Open Source Feature Flags, Experimentation, and Product Analytics
koopjs/koop
Transform, query, and download geospatial data on the web.
pathwaycom/pathway
Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
dagster-io/dagster
An orchestration platform for the development, production, and observation of data assets.