Fine-Tuning Whisper for Low-Resource Languages

Type de ressource
Conference Paper
Auteurs/contributeurs
Title
Fine-Tuning Whisper for Low-Resource Languages
Abstract
Automatic Speech Recognition (ASR) has advanced considerably in recent years, largely fueled by breakthroughs in self-supervised learning and the increasing availability of large-scale multilingual speech corpora. Models such as Whisper have demonstrated remarkable performance across numerous languages. However, despite its strong multilingual coverage, performance remains highly variable across languages. In this study, we fine-tune Whisper in four regional languages spoken in France, each selected to represent distinct linguistic and resource conditions: Basque, Occitan, Alsatian, and Shimaore. Performance is increased by fine-tuning for each language, but to significantly varying degrees. This is due to a combination of varying data quantity and quality, language similarity to an already well-covered language, and transcription standardisation: all things that low-resource languages may lack.
Proceedings Title
Journée d'études AFIA-ATALA-AFCP “ Technologies linguistiques pour les langues peu dotées ” (TLLPD)
Publisher
Collège TLH (Traitement du Langage Humain) de l'Association Française pour l'Intelligence Artificielle (AFIA) and Association Française pour le Traitement Automatique des Langues (ATALA) and Association Francophone pour la Communication Parlée (AFCP)
Place
Paris, France
Date
2025-12
Accessed
25/08/2026 09:23
Library Catalog
HAL
Référence
Yaich, M., Bigeard, S., & Ouni, S. (2025, December). Fine-Tuning Whisper for Low-Resource Languages. Journée d’études AFIA-ATALA-AFCP “ Technologies Linguistiques Pour Les Langues Peu Dotées ” (TLLPD). https://hal.science/hal-05570456
Type de papier