pkuserc/ChatGPT_for_IE
Evaluating ChatGPT’s Information Extraction Capabilities: An Assessment of Performance, Explainability, Calibration, and Faithfulness
This research evaluates how well ChatGPT performs various information extraction tasks, such as identifying entities, relationships, and events from text. It takes raw text as input and helps you understand ChatGPT's ability to pull out specific data points, how it explains its decisions, and its confidence levels. This is for researchers and practitioners who use large language models for text analysis and data extraction.
144 stars. No commits in the last 6 months.
Use this if you need to understand the strengths and weaknesses of ChatGPT for extracting structured information from unstructured text, especially for tasks like named entity recognition or event detection.
Not ideal if you are looking for a plug-and-play solution or a tool to directly implement information extraction, as this project focuses on assessment rather than deployment.
Stars
144
Forks
9
Language
Python
License
Apache-2.0
Category
Last pushed
Aug 17, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/pkuserc/ChatGPT_for_IE"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
openai/openai-cookbook
Examples and guides for using the OpenAI API
rgbkrk/dangermode
Execute IPython & Jupyter from the comforts of chat.openai.com
CogStack/OpenGPT
A framework for creating grounded instruction based datasets and training conversational domain...
Declipsonator/GPTZzzs
Large language model detection evasion through grammar and vocabulary modifcation.
flypythoncom/python
python is all you need !