Zizhao-HUANG/financial-llm-dataset-pipeline
Modular pipeline for collecting, processing, and exporting financial data into LLM-ready formats (CPT/SFT/TXT). Built on a raw→silver→gold architecture with built-in auditing.
This project helps quantitative analysts, financial researchers, and data scientists prepare Chinese A-share market data for training large language models. It takes raw financial data, cleans and processes it, then outputs datasets formatted specifically for continued pre-training or instruction fine-tuning of AI models. It is designed for anyone building or fine-tuning AI models with financial market intelligence.
Use this if you need a robust, audited pipeline to transform raw Chinese A-share financial market data into high-quality datasets for training large language models.
Not ideal if you are looking for a tool to perform live trading, direct financial analysis, or work with financial data outside of Chinese A-shares or large language model training.
Stars
8
Forks
—
Language
Python
License
—
Category
Last pushed
Feb 19, 2026
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/nlp/Zizhao-HUANG/financial-llm-dataset-pipeline"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
Shubxam/Nifty-500-Live-Sentiment-Analysis
Live Sentiment Analysis dashboard of NIFTY 500 universe of stocks using plotly and streamlit
lefterisloukas/edgar-crawler
The only open-source toolkit that can download SEC EDGAR financial reports and extract textual...
yya518/FinBERT
A Pretrained BERT Model for Financial Communications. https://arxiv.org/abs/2006.08097
shirosaidev/stocksight
Stock market analyzer and predictor using Elasticsearch, Twitter, News headlines and Python...
databricks-industry-solutions/esg-scoring
In this solution, we offer a novel approach to sustainable finance by combining NLP techniques...