Open ASR Leaderboard Adds Its First Global South Language: Hindi and Indian English Evaluation Sets
The Open ASR Leaderboard Adds Its First Global South Language
AI BriefingVoice Arena and Hugging Face have partnered to add two evaluation sets, Monsoon en-IN and Monsoon hi-IN, to the Open ASR leaderboard. They cover Hindi and Indian English, with Hindi becoming the first non-European language in the leaderboard's multilingual section. The datasets include public and private splits, cover 4,888 speakers, and record 12 speaker attributes. They aim to reveal disparities in speech recognition errors across regions, ages, genders, and other dimensions.
Source: Hugging Face Community Blog · huggingface.co