LLMFarm and llmfarm_core.swift
About LLMFarm
guinmoon/LLMFarm
llama and other large language models on iOS and MacOS offline using GGML library.
This app allows you to run large language models (LLMs) like LLaMA and GPT2 directly on your iPhone or Mac, without needing an internet connection. You input a chosen language model and receive text generation or responses, enabling private and fast AI interactions. It's designed for anyone who wants to experiment with or use AI language models offline on Apple devices.
About llmfarm_core.swift
guinmoon/llmfarm_core.swift
Swift library to work with llama and other large language models.
This is a Swift library designed for developers who want to integrate large language models (LLMs) like LLaMA into their macOS and iOS applications. It allows you to load various LLMs and configure their behavior with different inference and sampling methods. Developers can use this to build applications that run LLMs directly on Apple devices.
Related comparisons
Scores updated daily from GitHub, PyPI, and npm data. How scores work