awslabs/awsome-distributed-training
Collection of best practices, reference architectures, model training examples and utilities to train large models on AWS.
This project provides pre-built configurations and example test cases to help you efficiently train large machine learning models using various AWS services like SageMaker HyperPod, AWS ParallelCluster, AWS Batch, and Amazon EKS. It offers reference architectures to set up the necessary cloud infrastructure and includes training scripts for popular frameworks like PyTorch and Megatron-LM. Machine learning engineers and researchers who need to scale their model training across many machines on AWS would use this to get started quickly.
402 stars.
Use this if you need to train large machine learning models on AWS and want ready-to-use infrastructure templates and training examples to save setup time.
Not ideal if you are developing small models that don't require distributed training or if you are not using AWS for your machine learning infrastructure.
Stars
402
Forks
176
Language
Shell
License
MIT-0
Category
Last pushed
Mar 13, 2026
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/mlops/awslabs/awsome-distributed-training"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Related tools
anveshmuppeda/aws
AWS Hands-On Labs Repository
aws-samples/sample-on-demand-workflow-orchestrator
Build a dynamic workflow orchestration engine with Amazon DynamoDB and AWS Lambda
ukairia777/aws-bedrock-tutorial
Develop an AI application utilizing Streamlit, AWS's Bedrock, and Anthropic's Claude2 model.
aws-samples/sample-cross-partition-inference
Enable Amazon Bedrock inference across AWS partitions — securely access commercial-region AI...
thiago534/aws-architecture-design-examples
🏗️ Design practical AWS architectures with real-world use cases, focusing on cost, security,...