All AI Evaluation Tools

216 tools ranked by quality score

Showing 1–100 of 216

#	Tool	Score	Tier	Category	Stars	Language
1	DataDog/dd-trace-js Datadog APM client for Node.js	95	Verified	—	790	JavaScript
2	lmnr-ai/lmnr Laminar - open-source observability platform purpose-built for AI agents. YC S24.	88	Verified	—	2,770	TypeScript
3	mnfst/manifest Smart LLM Routing for OpenClaw. Cut Costs up to 70% 🦞🦚	87	Verified	—	4,268	TypeScript
4	open-telemetry/opentelemetry-rust The Rust OpenTelemetry implementation	81	Verified	—	2,536	Rust
5	tokio-rs/tracing Application level tracing for Rust.	78	Verified	—	6,617	Rust
6	DataDog/dd-trace-go Datadog Go Library including APM tracing, profiling, and security monitoring.	76	Verified	—	843	Go
7	pinpoint-apm/pinpoint APM, (Application Performance Management) tool for large-scale distributed systems.	76	Verified	—	13,819	Java
8	DataDog/dd-trace-py Datadog Python APM Client	76	Verified	—	637	Python
9	open-telemetry/opentelemetry-go OpenTelemetry Go API and SDK	76	Verified	—	6,344	Go
10	jaegertracing/jaeger-ui Web UI for Jaeger	76	Verified	—	1,456	JavaScript
11	DataDog/datadog-agent Main repository for Datadog Agent	76	Verified	—	3,565	Go
12	open-telemetry/opentelemetry-go-instrumentation OpenTelemetry Auto Instrumentation using eBPF	73	Verified	—	995	C
13	opentracing-contrib/nginx-opentracing NGINX plugin for OpenTracing	73	Verified	—	513	C++
14	openzipkin/zipkin Zipkin is a distributed tracing system	73	Verified	—	17,423	Java
15	NVIDIA/garak the LLM vulnerability scanner	72	Verified	—	7,510	HTML
16	winsiderss/systeminformer A free, powerful, multi-purpose tool that helps you monitor system...	72	Verified	—	13,904	C
17	namhyung/uftrace Function graph tracer for C/C++/Rust/Python	72	Verified	—	3,418	C
18	jaegertracing/jaeger CNCF Jaeger, a Distributed Tracing Platform	72	Verified	—	22,666	Go
19	autogluon/fev Forecast evaluation library	72	Verified	—	156	Python
20	confident-ai/deepeval The LLM Evaluation Framework	71	Verified	—	14,681	Python
21	inikep/lzbench lzbench is an in-memory benchmark of open-source compressors	71	Verified	—	1,052	C
22	bpftrace/bpftrace High-level tracing language for Linux	71	Verified	—	10,049	C++
23	gofr-dev/gofr An opinionated GoLang framework for accelerated microservice development....	70	Verified	—	21,601	Go
24	SigNoz/signoz SigNoz is an open-source observability platform native to OpenTelemetry with...	70	Verified	—	26,471	TypeScript
25	GreptimeTeam/greptimedb The open-source Observability 2.0 database. One engine for metrics, logs,...	70	Verified	—	6,136	Rust
26	libbpf/libbpf Automated upstream mirror for libbpf stand-alone build.	70	Verified	—	2,673	C
27	iipeace/guider The All-in-One System Profiling and Fault Detection Tool for Linux & Android	70	Verified	—	668	Python
28	pydantic/logfire AI observability platform for production LLM and agent systems.	69	Established	—	4,158	Python
29	CodSpeedHQ/pytest-codspeed A pytest plugin to create benchmarks	69	Established	—	122	Python
30	dotnet/BenchmarkDotNet Powerful .NET library for benchmarking	69	Established	—	11,389	C#
31	CodSpeedHQ/codspeed-rust Crates to benchmark your Rust code	67	Established	—	59	Rust
32	alibaba/loongsuite-go-agent OpenTelemetry Compile-Time Instrumentation for Golang	66	Established	—	843	Go
33	coroot/coroot Coroot is an open-source observability and APM tool with AI-powered Root...	66	Established	—	7,557	Go
34	flightlessmango/MangoHud A Vulkan and OpenGL overlay for monitoring FPS, temperatures, CPU/GPU load and more.	66	Established	—	8,436	C
35	metrico/gigapipe ⭐️ The Open-Source Polyglot Observability Warehouse: Light, Fast, Cloud...	65	Established	—	1,655	Go
36	TPC-Council/HammerDB HammerDB: The industry standard open-source database benchmark	64	Established	—	745	Tcl
37	DataDog/dd-trace-java Datadog APM client for Java	64	Established	—	703	Java
38	DataDog/dd-trace-php Datadog PHP Clients	64	Established	—	550	PHP
39	DataDog/dd-trace-rb Datadog's client library for Ruby	64	Established	—	392	Ruby
40	jaegertracing/helm-charts Helm Charts for Jaeger backend	64	Established	—	315	Mustache
41	DataDog/dd-sdk-ios Datadog SDK for iOS - Swift and Objective-C.	64	Established	—	279	Swift
42	open-telemetry/opentelemetry-ruby-contrib Contrib Packages for the OpenTelemetry Ruby API and SDK implementation.	64	Established	—	119	Ruby
43	gogf/gf A powerful framework for faster, easier, and more efficient project development.	64	Established	—	13,107	Go
44	RafaelGSS/bench-node A powerful Node.js benchmark library	64	Established	—	182	JavaScript
45	DataDog/dd-trace-dotnet .NET Client Library for Datadog APM	64	Established	—	553	C#
46	open-telemetry/opentelemetry-php The OpenTelemetry PHP Library	64	Established	—	889	PHP
47	reframe-hpc/reframe A powerful Python framework for writing and running portable regression...	63	Established	—	271	Python
48	verifywise-ai/verifywise Complete AI governance and LLM Evals platform with support for EU AI Act,...	63	Established	—	256	TypeScript
49	rabbitmq/rabbitmq-perf-test A load testing tool	63	Established	—	416	Java
50	oushujun/EDTA Extensive de-novo TE Annotator	63	Established	—	438	Perl
51	nowsecure/fsmon Filesystem monitor tool for Linux/Android iOS/macOS	62	Established	—	1,005	C
52	typelevel/natchez functional tracing for cats	62	Established	—	338	Scala
53	cloudflare/ebpf_exporter Prometheus exporter for custom eBPF metrics	62	Established	—	2,549	Go
54	zio/zio-logging Powerful logging for ZIO 2.0 applications, with compatibility with many...	62	Established	—	187	Scala
55	lttng/lttng-tools The lttng-tools project provides a session daemon (lttng-sessiond) that acts...	62	Established	—	343	C++
56	efficios/babeltrace Babeltrace /ˈbæbəltreɪs/ is an open-source trace manipulation toolkit.	62	Established	—	118	C++
57	huggingface/aisheets Build, enrich, and transform datasets using AI models with no code	61	Established	—	1,626	TypeScript
58	typelevel/otel4s An OpenTelemetry library for Scala based on Cats-Effect	61	Established	—	207	Scala
59	fastify/fastify-zipkin Fastify plugin for Zipkin distributed tracing system.	61	Established	—	10	JavaScript
60	dash0hq/otelbin Web-based tool to facilitate OpenTelemetry collector configuration editing...	61	Established	—	526	TypeScript
61	iand675/hs-opentelemetry OpenTelemetry support for the Haskell programming language	60	Established	—	99	Haskell
62	swift-otel/swift-otel An OpenTelemetry Protocol (OTLP) backend for Swift Log, Swift Metrics, and...	60	Established	—	198	Swift
63	godotengine/godot-benchmarks Collection of benchmarks to test performance of different areas of Godot	60	Established	—	147	GDScript
64	cilium/pwru Packet, where are you? -- eBPF-based Linux kernel networking debugger	60	Established	—	3,721	C
65	instana/go-sensor :rocket: Go Distributed Tracing & Metrics Sensor for Instana	60	Established	—	127	Go
66	signalfx/tracing-examples Examples of using third-party tracers with SignalFx	59	Established	—	60	C#
67	signalfx/splunk-otel-java Splunk Distribution of OpenTelemetry Java	59	Established	—	73	Java
68	instana/nodejs Node.js in-process collectors for Instana	59	Established	—	74	JavaScript
69	team-decent/decent-bench A benchmarking framework for decentralized optimization	59	Established	—	5	Python
70	kieker-monitoring/kieker Kieker is an observability framework, that consists of an monitoring and...	59	Established	—	109	Java
71	jonahsnider/benchmark A Node.js benchmarking library with support for multithreading and TurboFan...	59	Established	—	15	TypeScript
72	dynatrace-oss/unguard Unguard is an insecure cloud-native microservices demo application.	59	Established	—	68	TypeScript
73	instana/python-sensor :snake: Python Distributed Tracing & Metrics Sensor for Instana	58	Established	—	69	Python
74	munich-quantum-toolkit/bench MQT Bench - An MQT Tool for Benchmarking Quantum Software Tools	58	Established	—	113	Python
75	ertgl/tapable-tracer Trace the connections and flows between tapable hooks.	58	Established	—	5	TypeScript
76	uio-bmi/immuneML immuneML is a platform for machine learning analysis of adaptive immune...	58	Established	—	74	Python
77	ant-research/EasyTemporalPointProcess EasyTPP: Towards Open Benchmarking Temporal Point Processes	57	Established	—	336	Python
78	nhsengland/evalsense Tools for systematic large language model evaluations	57	Established	—	3	Python
79	instana/ruby-sensor 💎 Ruby Distributed Tracing & Metrics Sensor for Instana	56	Established	—	26	Ruby
80	atesgoral/hrm-solutions Human Resource Machine solutions and size/speed hacks	56	Established	—	458	Assembly
81	bamlab/flashlight 📱⚡️ Lighthouse for Mobile - audits your app and gives a performance score to...	55	Established	—	1,556	TypeScript
82	ldbc/ldbc_snb_docs Specification of the LDBC Social Network Benchmark suite	55	Established	—	60	TeX
83	aliesbelik/load-testing-toolkit Collection of open-source tools for debugging, benchmarking, load and stress...	54	Established	—	237	—
84	unitaryfoundation/metriq-gym metriq-gym is a framework for implementing and running standard quantum...	54	Established	—	29	Python
85	ryncsn/memstrack A memory allocation tracer combined with stack trace.	54	Established	—	175	C
86	GDATASoftwareAG/motornet Motor.NET is a microservice framework based on Microsoft.Extensions.Hosting	54	Established	—	43	C#
87	argonne-lcf/THAPI A tracing infrastructure for heterogeneous computing applications.	54	Established	—	41	C
88	DataDog/nginx-datadog Enhance NGINX Observability and Security with Datadog's Module	54	Established	—	41	C++
89	bencheeorg/benchee Easy and extensible benchmarking in Elixir providing you with lots of statistics!	54	Established	—	1,506	Elixir
90	chirpz-ai/pandaprobe 🐼 Open source agent engineering platform: traces, evals, and metrics to...	54	Established	—	7	Python
91	jnidzwetzki/pg-lock-tracer An eBPF based lock tracer for PostgreSQL	54	Established	—	165	Python
92	cau-se/theodolite Theodolite is a framework for benchmarking the horizontal and vertical...	53	Established	—	56	Java
93	bencherdev/bencher 🐰 Bencher - Continuous Benchmarking	53	Established	—	819	Rust
94	hendriknielaender/zBench 📊 zig benchmark	53	Established	—	199	Zig
95	DataDog/dd-trace-cpp Datadog APM client for C++	53	Established	—	19	C++
96	cmackenzie1/tracing-ndjson A customizable NDJSON format for tracing in Rust	53	Established	—	3	Rust
97	prestodb/pbench Presto/Prestissimo Benchmark Toolset	53	Established	—	8	Go
98	elastic/elastic-otel-dotnet Elastic OpenTelemetry .NET Distribution	53	Established	—	32	C#
99	signalfx/splunk-otel-dotnet Splunk Distribution of OpenTelemetry .NET	52	Established	—	9	C#
100	FrankChen021/bithon A full stack observability platform	52	Established	—	27	Java

1 2 3 Next »