Votre recherche
Résultats 3 ressources
-
This paper presents a fine-tuning approach for automatic speech recognition (ASR) that exploits linguistic similarities between dialects to address data scarcity and imbalance in dialectally rich, low-resource languages. The approach is evaluated on Occitan, a low-resource language composed of six main dialects with unevenly distributed resources. For the better-resourced dialects, Languedocien and Gascon, a two-step fine-tuning is applied to improve recognition performance by exploiting inter-dialectal information. For the less-represented dialects, we assess the effectiveness of knowledge transfer from the better-resourced variants, analyzing the model’s ability to generalize to sparsely represented dialects. The results show that leveraging linguistic proximity between dialects is an effective strategy to enhance ASR performance in low-resource settings with high dialectal variability.
-
Automatic Speech Recognition (ASR) has advanced considerably in recent years, largely fueled by breakthroughs in self-supervised learning and the increasing availability of large-scale multilingual speech corpora. Models such as Whisper have demonstrated remarkable performance across numerous languages. However, despite its strong multilingual coverage, performance remains highly variable across languages. In this study, we fine-tune Whisper in four regional languages spoken in France, each selected to represent distinct linguistic and resource conditions: Basque, Occitan, Alsatian, and Shimaore. Performance is increased by fine-tuning for each language, but to significantly varying degrees. This is due to a combination of varying data quantity and quality, language similarity to an already well-covered language, and transcription standardisation: all things that low-resource languages may lack.
-
This paper describes different approaches for developing, for the first time, an automatic speech recognition system for two of the main dialects of Occitan, namely Gascon and Languedocian, and the results obtained in them. The difficulty of the task lies in the fact that Occitan is a less-resourced language. Although a great effort has been made to collect or create corpora of each variant (transcribed speech recordings for the acoustic models and two text corpora for the language models), the sizes of the corpora obtained are far from those of successful systems reported in the literature, and thus we have tested different techniques to compensate for the lack of resources. We have developed classical systems using Kaldi, creating an acoustic model for each variant and also creating language models from the collected corpora and from machine translated texts. We have also tried fine-tuning a Whisper model with our speech corpora. We report word error rates of 20.86 for Gascon and 13.52 for Languedocian with the Kaldi systems and 16.37 for Gascon and 11.74 for Languedocian with Whisper.
Explorer
Langue
- Occitan
- Alsacien (1)
- Guyane (1)
- Multilingue (1)
Type de papier
- Papiers COLaF (2)