Hugging Face's logo
Aman Singh Thakur's picture

Aman Singh Thakur

singh96aman
1 2
MrOvkill's profile picture sudanenator's profile picture RuhiJ's profile picture
Ā·

AI & ML interests

Responsible AI and Classical Machine Learning

Recent Activity

upvoted an article 17 days ago
š—š˜‚š—±š—“š—¶š—»š—“ š˜š—µš—² š—š˜‚š—±š—“š—²š˜€: š—˜š˜ƒš—®š—¹š˜‚š—®š˜š—¶š—»š—“ š—”š—¹š—¶š—“š—»š—ŗš—²š—»š˜ š—®š—»š—± š—©š˜‚š—¹š—»š—²š—暝—®š—Æš—¶š—¹š—¶š˜š—¶š—²š˜€ š—¶š—» š—Ÿš—Ÿš— š˜€-š—®š˜€-š—š˜‚š—±š—“š—²š˜€
commentedon a paper about 2 years ago
Judging the Judges: Evaluating Alignment and Vulnerabilities in LLMs-as-Judges
reacted to theirpost with šŸ”„ about 2 years ago
š—š˜‚š—±š—“š—¶š—»š—“ š˜š—µš—² š—š˜‚š—±š—“š—²š˜€: š—˜š˜ƒš—®š—¹š˜‚š—®š˜š—¶š—»š—“ š—”š—¹š—¶š—“š—»š—ŗš—²š—»š˜ š—®š—»š—± š—©š˜‚š—¹š—»š—²š—暝—®š—Æš—¶š—¹š—¶š˜š—¶š—²š˜€ š—¶š—» š—Ÿš—Ÿš— š˜€-š—®š˜€-š—š˜‚š—±š—“š—²š˜€ https://huggingface.co/papers/2406.12624 š‚ššš§ š‹š‹šŒš¬ š¬šžš«šÆšž ššš¬ š«šžš„š¢ššš›š„šž š£š®šš šžš¬ āš–ļø? We aim to identify the right metrics for evaluating Judge LLMs and understand their sensitivities to prompt guidelines, engineering, and specificity. With this paper, we want to raise caution āš ļø to blindly using LLMs as human proxy. Blog - https://huggingface.co/blog/singh96aman/judgingthejudges Arxiv - https://arxiv.org/abs/2406.12624 Tweet - https://x.com/iamsingh96aman/status/1804148173008703509 @singh96aman @kartik727 @Srinik-1 @sankaranv @dieuwkehupkes
View all activity

Organizations

None yet