Graph-COM/HaystackCraft
Haystack Engineering: Context Engineering for Heterogeneous and Agentic Long-Context Evaluation
This project helps AI researchers and practitioners evaluate how well large language models (LLMs) understand and use very long and complex information. You input your chosen LLM and a dataset of questions or prompts, and it outputs performance metrics showing how accurately the LLM answered based on the provided long-form context. It's designed for those who develop or critically assess advanced LLM applications, especially when dealing with extensive documents or multi-step reasoning.
No commits in the last 6 months.
Use this if you need to rigorously test and compare different LLMs' abilities to extract and synthesize information from extremely long and diverse textual contexts.
Not ideal if you are a general user looking for an out-of-the-box LLM application, rather than a tool for LLM development and evaluation.
Stars
11
Forks
—
Language
Python
License
Apache-2.0
Category
Last pushed
Oct 10, 2025
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/rag/Graph-COM/HaystackCraft"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
chopratejas/headroom
The Context Optimization Layer for LLM Applications
Meirtz/Awesome-Context-Engineering
🔥 Comprehensive survey on Context Engineering: from prompt engineering to production-grade AI...
Huzaifa785/context-compressor
AI-powered text compression library for RAG systems and API calls. Reduce token usage by up to...
puppyone-ai/puppyone
The context file system for agents. Connect, govern, and share context across all agents.
redleaves/context-keeper
🧠 LLM-Driven Intelligent Memory & Context Management System （AI记忆管理与智能上下文感知平台） AI记忆管理平台 |...