tianzhaotju/EMD
Replication Package for "Large Language Models for Equivalent Mutant Detection: How Far Are We?", ISSTA 2024
This project helps software developers understand how well large language models (LLMs) can identify equivalent mutants in Java code. It takes in pairs of Java code snippets and determines if they are functionally identical, even if their syntax differs. The primary users are software engineers, researchers, and quality assurance professionals interested in advanced testing techniques and the application of AI in software development.
No commits in the last 6 months.
Use this if you are a software engineer or researcher exploring the effectiveness of LLMs for detecting equivalent code mutations.
Not ideal if you are looking for a ready-to-use, production-grade tool for general-purpose mutant detection without an interest in LLM research.
Stars
9
Forks
3
Language
Python
License
—
Category
Last pushed
Nov 19, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/tianzhaotju/EMD"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Featured in
Higher-rated alternatives
open-compass/opencompass
OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral,...
IBM/unitxt
🦄 Unitxt is a Python library for enterprise-grade evaluation of AI performance, offering the...
lean-dojo/LeanDojo
Tool for data extraction and interacting with Lean programmatically.
GoodStartLabs/AI_Diplomacy
Frontier Models playing the board game Diplomacy.
google/litmus
Litmus is a comprehensive LLM testing and evaluation tool designed for GenAI Application...