Every Eval Ever: A Unifying Schema and Community Repository for AI Evaluation Results
Paper • 2606.14516 • Published • 5
AI & ML interests
datasets, social impact, bias, evaluation
Recent Activity
View all activity
evijit
authored a
paper 5 days ago
meg
updated a
dataset 17 days ago
evijit
authored a
paper 24 days ago
Post
1140
Weekend mini project! Since commentary on AI is inherently interdisciplinary, we connected the observations in the Pope's encyclical with decades of scholarship in Responsible AI and Ethics research and created an interactive space with these annotations!
Work with @IJ-Reynolds , @yjernite , and @meg
Lots to unpack. We started with 105 annotations. Please submit pull requests for more that we may have missed!
society-ethics/annotated-encyclical
Work with @IJ-Reynolds , @yjernite , and @meg
Lots to unpack. We started with 105 annotations. Please submit pull requests for more that we may have missed!
society-ethics/annotated-encyclical
jjzha
authored 4
papers about 1 month ago
CommonLID: Re-evaluating State-of-the-Art Language Identification Performance on Web Data
Paper • 2601.18026 • Published
UniSkill: A Dataset for Matching University Curricula to Professional Competencies
Paper • 2603.03134 • Published
WorkRB: A Community-Driven Evaluation Framework for AI in the Work Domain
Paper • 2604.13055 • Published
CroCo: Cross-Lingual Contrastive Preference Tuning on Self-Generations
Paper • 2605.26293 • Published • 6
jjzha
submitted a
paper to Daily Papers about 1 month ago
evijit
submitted a
paper to Daily Papers about 2 months ago
KaiserWhoLearns
authored a
paper 2 months ago
KaiserWhoLearns
authored a
paper 3 months ago
KaiserWhoLearns
submitted a
paper to Daily Papers 3 months ago
amupd
authored a
paper 3 months ago
KaiserWhoLearns
authored a
paper 4 months ago
KaiserWhoLearns
submitted a
paper to Daily Papers 4 months ago
KaiserWhoLearns
authored a
paper 5 months ago
yjernite
authored a
paper 5 months ago
Post
4388
🤖 Did you know your voice might be cloned without your consent from just *one sentence* of audio?
That's not great. So with @frimelle , we brainstormed a new idea for developers who want to curb malicious use: ✨The Voice Consent Gate.✨
Details, code, here: https://huggingface.co/blog/voice-consent-gate
That's not great. So with @frimelle , we brainstormed a new idea for developers who want to curb malicious use: ✨The Voice Consent Gate.✨
Details, code, here: https://huggingface.co/blog/voice-consent-gate
- 3 replies
Post
4659
🌎 AI ethics and sustainability are two sides of the same coin.
In our new blog post with Dr. Sasha Luccioni, we argue that separating them (as is too often the case) means missing the bigger picture of how AI systems impact both people and the planet.
Ethical and sustainable AI development can’t be pursued in isolation. The same choices that affect who benefits or is harmed by AI systems also determine how much energy and resources they consume.
We explore how two key concepts, evaluation and transparency, can serve as bridges between these domains:
📊 Evaluation, by moving beyond accuracy or performance metrics to include environmental and social costs, as we’ve done with tools like the AI Energy Score.
🔍 Transparency, by enabling reproducibility, accountability, and environmental reporting through open tools like the Environmental Transparency Space.
AI systems mirror our priorities. If we separate ethics from sustainability, we risk building technologies that are efficient but unjust, or fair but unsustainable.
Read our blog post here: https://huggingface.co/blog/sasha/ethics-sustainability
AIEnergyScore/Leaderboard
sasha/environmental-transparency
In our new blog post with Dr. Sasha Luccioni, we argue that separating them (as is too often the case) means missing the bigger picture of how AI systems impact both people and the planet.
Ethical and sustainable AI development can’t be pursued in isolation. The same choices that affect who benefits or is harmed by AI systems also determine how much energy and resources they consume.
We explore how two key concepts, evaluation and transparency, can serve as bridges between these domains:
📊 Evaluation, by moving beyond accuracy or performance metrics to include environmental and social costs, as we’ve done with tools like the AI Energy Score.
🔍 Transparency, by enabling reproducibility, accountability, and environmental reporting through open tools like the Environmental Transparency Space.
AI systems mirror our priorities. If we separate ethics from sustainability, we risk building technologies that are efficient but unjust, or fair but unsustainable.
Read our blog post here: https://huggingface.co/blog/sasha/ethics-sustainability
AIEnergyScore/Leaderboard
sasha/environmental-transparency
- 1 reply