nicolay-r/RuSentRel-Leaderboard
This is an official Leaderboard for the RuSentRel-1.1 dataset originally described in paper (arxiv:1808.08932)
This project helps researchers and data scientists working with Russian-language political analysis to evaluate how well different methods extract sentiment relations between entities. You input analytical articles translated into Russian from foreign sources, alongside a list of named entities. The output is a benchmark of performance (F1 scores) for various machine learning approaches in identifying positive or negative sentiment links between these entities.
No commits in the last 6 months.
Use this if you are developing or testing automated methods to detect sentiment relationships between political actors or entities in Russian-language news and analysis, and need to compare their performance against established benchmarks.
Not ideal if you need to perform sentiment analysis on general-purpose Russian text or require a tool for sentiment analysis that isn't focused on inter-entity relations in political articles.
Stars
8
Forks
—
Language
Python
License
MIT
Category
Last pushed
Dec 28, 2023
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/nlp/nicolay-r/RuSentRel-Leaderboard"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
FudanSELab/ClassEval
Benchmark ClassEval for class-level code generation.
microsoft/NeMoEval
A Benchmark Tool for Natural Language-based Network Management
apartresearch/specificityplus
👩💻 Code for the ACL paper "Detecting Edit Failures in LLMs: An Improved Specificity Benchmark"
claws-lab/XLingEval
Code and Resources for the paper, "Better to Ask in English: Cross-Lingual Evaluation of Large...
HICAI-ZJU/SciKnowEval
SciKnowEval: Evaluating Multi-level Scientific Knowledge of Large Language Models