DataScienceUIBK/llm-reranking-generalization-study
How Good are LLM-based Rerankers? Accepted at EMNLP Findings 2025
This study helps information retrieval specialists evaluate how well different AI-powered systems can reorder search results or document lists. It takes in a list of documents related to a query and tells you which re-ranking models are best at surfacing the most relevant information, especially for new or very recent topics. Information retrieval researchers, search engine developers, and data scientists working on recommender systems would use this to improve their systems.
No commits in the last 6 months.
Use this if you need to understand which re-ranking methods generalize best to novel information, such as very recent news or events not seen during an AI model's training.
Not ideal if you are looking for a plug-and-play solution to build an entire search engine or if your primary concern is re-ranking based on static, well-established knowledge.
Stars
12
Forks
—
Language
—
License
Apache-2.0
Category
Last pushed
Aug 28, 2025
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/DataScienceUIBK/llm-reranking-generalization-study"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
filipnaudot/llmSHAP
llmSHAP: a multi-threaded explainability framework using Shapley values for LLM-based outputs.
microsoft/automated-brain-explanations
Generating and validating natural-language explanations for the brain.
CAS-SIAT-XinHai/CPsyCoun
[ACL 2024] CPsyCoun: A Report-based Multi-turn Dialogue Reconstruction and Evaluation Framework...
wesg52/universal-neurons
Universal Neurons in GPT2 Language Models
ICTMCG/LLM-for-misinformation-research
Paper list of misinformation research using (multi-modal) large language models, i.e., (M)LLMs.