Bibliographie complète
Phylogeny-Inspired Soft Prompts For Data-to-Text Generation in Low-Resource Languages
Type de ressource
Conference Paper
Auteurs/contributeurs
- Soto, William (Author)
- Parmentier, Yannick (Author)
- Gardent, Claire (Author)
- Arase, Yuki (Editor)
- Hu, Baotian (Editor)
- Lu, Wei (Editor)
Title
Phylogeny-Inspired Soft Prompts For Data-to-Text Generation in Low-Resource Languages
Abstract
Most work on verbalising Knowledge-Graphs (KG) has focused on high-resource languages such as English, Russian, Czech or Arabic. In this paper, we focus on KG-to-Text generation where the output text is in Breton, Irish or Welsh. To overcome the small size of the parallel training data, we combine the strengths of a multilingual encoder-decoder model with denoising fine-tuning on monolingual data and Soft Prompt fine-tuning on a small quantity of KG/text data. We furthermore structure the soft prompt into multiple sub-prompts designed to capture the similarities and differences between English, Knowledge graphs and the three target languages. Our experiments show that our approach outperforms strong baselines and that all sub-prompts contribute to performance.
Date
2023-11
Proceedings Title
IJCNLP-AACL 2023: The 13th International Joint Conference on Natural Language Processing and the 3rd Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics
Place
Bali, Indonesia
Publisher
ACL
Accessed
01/10/2024 15:32
Library Catalog
HAL Archives Ouvertes
Référence
Soto, W., Parmentier, Y., & Gardent, C. (2023). Phylogeny-Inspired Soft Prompts For Data-to-Text Generation in Low-Resource Languages. In Y. Arase, B. Hu, & W. Lu (Eds.), IJCNLP-AACL 2023: The 13th International Joint Conference on Natural Language Processing and the 3rd Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics. ACL. https://hal.science/hal-04199557
Langue
Tâche
Lien vers cette notice