Coolhand-Labs/coolhand-ruby
Zero-config LLM cost & quality monitoring for Ruby apps - automatically log AI API calls and collect user feedback for analysis using Coolhand.
This project helps engineering and product teams building Ruby applications that use AI. It automatically logs all AI API calls and lets you collect user feedback on AI responses, providing insights into cost and quality. You feed in your Ruby application's AI interactions, and it produces structured logs and user feedback for analysis on the Coolhand platform.
Use this if you need to understand how your Ruby-based AI features are performing, what they cost, and how users perceive their quality, without changing existing code.
Not ideal if your application is not built with Ruby or if you only need to monitor internal system metrics without user feedback on AI outputs.
Stars
9
Forks
1
Language
Ruby
License
Apache-2.0
Category
Last pushed
Mar 03, 2026
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/prompt-engineering/Coolhand-Labs/coolhand-ruby"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
genieincodebottle/schemalock
LLM output contract testing CLI, define what your pipeline must return, test it against any...
antsanchez/prompto
Interact with various LLMs in your browser (LangChain.js, Angular)
joshualamerton/prompt-trace
Prompt and response tracing for LLM workflows
suhjohn/llm-workbench
UI for testing prompts across various datasets locally
atjsh/llmlingua-2-js
JavaScript/TypeScript implementation of LLMLingua-2 (Experimental)