llm-connector and llm_client
About llm-connector
lipish/llm-connector
LLM Connector - A unified interface for connecting to various Large Language Model providers
This is a tool for developers who integrate Large Language Models (LLMs) into their applications. It takes your application's prompts and requests and translates them into the specific formats required by different LLM providers like OpenAI or Anthropic, providing a consistent way to interact with various services. Developers use this to streamline connecting their software to different AI models.
About llm_client
ShelbyJenkins/llm_client
The Easiest Rust Interface for Local LLMs and an Interface for Deterministic Signals from Probabilistic LLM Vibes
This project provides a robust and easy-to-use Rust interface for `llama.cpp`'s `llama-server`. It simplifies managing the `llama.cpp` toolchain and interacting with local large language models (LLMs) for tasks like text generation, text infilling, and creating text embeddings. Developers building applications that need to integrate local LLM capabilities would use this.
Related comparisons
Scores updated daily from GitHub, PyPI, and npm data. How scores work