ngxson/ggml-easy
Thin wrapper around GGML to make life easier
This is a lightweight C++ library designed for developers who integrate machine learning models into their applications. It simplifies the process of loading large language models (LLMs) and executing them on either a CPU or GPU. Developers can input models in GGUF or Safetensors formats and define computational graphs, receiving computed outputs and intermediate debugging results.
Use this if you are a C++ developer needing to embed and run GGML-compatible AI models, especially large language models, within your applications with simplified GPU acceleration.
Not ideal if you are an end-user looking for a ready-to-use application, or if you require a high-performance, fine-tuned GPU solution for specialized deep learning frameworks.
Stars
44
Forks
2
Language
C++
License
MIT
Category
Last pushed
Nov 05, 2025
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/ml-frameworks/ngxson/ggml-easy"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
davisking/dlib
A toolkit for making real world machine learning and data analysis applications in C++
ZigRazor/CXXGraph
Header-Only C++ Library for Graph Representation and Algorithms
mlpack/mlpack
mlpack: a fast, header-only C++ machine learning library
apache/singa
a distributed deep learning platform
hosseinmoein/DataFrame
C++ DataFrame for statistical, financial, and ML analysis in modern C++