JuniMay/llm.rs
An attempt to migrate Karpathy's llm.c to safe rust.
This project helps developers by providing a re-implementation of a core machine learning model training process. It takes existing preprocessed text datasets, like those used for training small language models, and produces a trained model. Software engineers and machine learning practitioners who build or experiment with foundational AI models would use this.
No commits in the last 6 months.
Use this if you are a developer looking for a memory-safe Rust implementation of a GPT-like model training process, specifically exploring alternatives to C implementations.
Not ideal if you are an end-user looking to train large language models without writing code or if you need GPU acceleration right out of the box.
Stars
13
Forks
—
Language
Rust
License
—
Category
Last pushed
Jun 04, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/JuniMay/llm.rs"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
trymirai/uzu
A high-performance inference engine for AI models
justrach/bhumi
⚡ Bhumi – The fastest AI inference client for Python, built with Rust for unmatched speed,...
lipish/llm-connector
LLM Connector - A unified interface for connecting to various Large Language Model providers
keyvank/femtoGPT
Pure Rust implementation of a minimal Generative Pretrained Transformer
ShelbyJenkins/llm_client
The Easiest Rust Interface for Local LLMs and an Interface for Deterministic Signals from...