llmjava/llm4j
One API to access Large Language Models in Java
This is a Java library that helps Java developers integrate various large language models (LLMs) like Google PaLM, Cohere, OpenAI, and Hugging Face into their Java or Kotlin applications. It allows developers to send text prompts to different LLM backends and receive text responses, streamlining the process of adding AI capabilities to their software. It is intended for Java and Kotlin developers building applications that leverage LLMs.
No commits in the last 6 months.
Use this if you are a Java or Kotlin developer needing a unified way to access multiple large language models within your application.
Not ideal if you are not a Java or Kotlin developer, or if you only need to interact with a single LLM through its native API.
Stars
11
Forks
—
Language
Java
License
Apache-2.0
Category
Last pushed
Jan 15, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/llmjava/llm4j"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
containers/ramalama
RamaLama is an open-source developer tool that simplifies the local serving of AI models from...
av/harbor
One command brings a complete pre-wired LLM stack with hundreds of services to explore.
RunanywhereAI/runanywhere-sdks
Production ready toolkit to run AI locally
runpod-workers/worker-vllm
The RunPod worker template for serving our large language model endpoints. Powered by vLLM.
foldl/chatllm.cpp
Pure C++ implementation of several models for real-time chatting on your computer (CPU & GPU)