Preprocessing MediaPipe Joint Annotation for Sign Language Similarity Analysis

Type de ressource
Conference Paper
Auteurs/contributeurs
Title
Preprocessing MediaPipe Joint Annotation for Sign Language Similarity Analysis
Abstract
This paper introduces a preprocessing pipeline for keypoints extracted using MediaPipe, aiming to improve pose annotation consistency in sign language datasets. We evaluate its effectiveness using a sign similarity task based on phonological features, without relying on gloss annotations. Similarity is measured using Dynamic Time Warping (DTW) across videos from sign language dictionaries. Although such similarity analyses can support various sign language processing applications -such as lexical search, clustering, and data enrichment -the main contribution of this work is to standardise pose features across heterogeneous sources, including different signers and backgrounds. Experiments on two dictionary datasets show that our pipeline significantly improves similarity measurements, with promising benefits for other sign language processing tasks.
Proceedings Title
SLTAT 2025: 9th Workshop on Sign Language Translation and Avatar Technologies
Publisher
ACM
Place
Berlin, Germany
Date
2025-09
Pages
1-9
Accessed
25/08/2026 09:22
Library Catalog
HAL
Notes

IVA Adjunct '25: ACM International Conference on Intelligent Virtual Agents

Référence
Manseri, K., Bigeard, S., & Ouni, S. (2025). Preprocessing MediaPipe Joint Annotation for Sign Language Similarity Analysis. SLTAT 2025: 9th Workshop on Sign Language Translation and Avatar Technologies, 1–9. https://doi.org/10.1145/3742886.3756716
Type de papier