zjukg/KnowPAT
[Paper][ACL 2024 Findings] Knowledgeable Preference Alignment for LLMs in Domain-specific Question Answering
This project helps improve the quality of answers from Large Language Models (LLMs) when used for specific fields like finance or healthcare. It takes your existing questions, several possible answers, and your preferred ranking of those answers, then fine-tunes the LLM to provide better, more knowledgeable responses aligned with human judgment. This is useful for researchers and AI practitioners building specialized question-answering systems.
192 stars. No commits in the last 6 months.
Use this if you are a researcher or AI practitioner working to make LLMs give more accurate and domain-specific answers by incorporating external knowledge and human preferences.
Not ideal if you are a general user looking for an out-of-the-box LLM or if you don't have access to an existing LLM and a dataset of domain-specific questions with human-preferred answers.
Stars
192
Forks
14
Language
Python
License
—
Category
Last pushed
Jun 10, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/transformers/zjukg/KnowPAT"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
RManLuo/graph-constrained-reasoning
Official Implementation of ICML 2025 Paper: "Graph-constrained Reasoning: Faithful Reasoning on...
zjukg/KoPA
[Paper][ACM MM 2024] Making Large Language Models Perform Better in Knowledge Graph Completion
damianoduranti/LLMknowextra
LLM-Driven Knowledge Extraction: Results in Temporal and Description Logics (EKAW 2024)
hhy-huang/GraphJudge
[EMNLP'25 main] This is the official repo for the paper, Can LLMs be Good Graph Judge for...
pat-jj/KG-FIT
[NeurIPS'24] Knowledge Graph Fine-Tuning using LLMs