Modélisation et Traitement Automatique des Langues des Signes

Sign Language Processing

Current PhD thesis

  • Modelling, traductology
    • 2021-2024 : Camille Challant, "Formal representation and grammatical constraints for French sign language". Supervisor M. Filhol.
  • Animation generation
    • 2021-2024 : Paritosh Sharma, "Synthèse de langue des signes par un système d'animation à granularité décroissante à partir d'AZee". Supervisor M. Filhol.
  • Analysis, recognition, machine learning
    • 2021-2024 : Yanis Ouakrim (AMI, Gipsa-Lab),"Recognition of the continuous LS for the realisation of a gesture server". Supervisors M. Gouiffès (AMI) et D. Beautemps (Gipsa-Lab), co-supervisors A. Braffort et T. Hueber (Gipsa-Lab).
    • 2019-2022 : Hannah Bull,"French Sign Language recognition and automatic alignment with integration of linguistic knowledge". Supervisors M. Gouiffès and A. Braffort.
    • 2017-2020 : H. Chaaban, "Automatic detection of lexical signs in French Sign Language videos". Supervisor M. Gouiffès.

Recently defended thesis

Current projects and collaborations

  • 2021-2024 : Easier - European project Horizon 2020
    Coordination at LISN : M. Filhol.
    EASIER aims to design, develop, and validate a complete multilingual machine translation system that will act as a framework for barrier-free communication among deaf and hearing individuals, as well as provide a platform to support sign language content creation.
  • 2020-2024 : Serveur Gestuel - Projet "PSPC" of BPI France
    Coordination at LISN : A. Braffort.
    The aim is to provide deaf sign language users with the equivalent of a voice server for hearing people, in partnership with the Gipsa-lab and the companies IVèS and 4DViews. The team is involved in both the automatic recognition and the automatic generation parts.
  • Continuous collaboration on movement analysis and sign language synthesis in collaboration with J. McDonald and R. Wolfe (DePaul University, Chicago). Generation of 3D animations from the linguistic representations AZee designed in the team, movement analysis using mocap corpora for modelling and synthesis.

Rencently completed projects

  • 2018-2021 : Rosetta - Projet "PIA Grands défis du numérique" of BPI France
    Coordination at LISN : A. Braffort.
    Development of an automatic generator of multilingual subtitles for television programmes and internet video content for deaf and hard of hearing people, based on artificial intelligence and animation of a virtual signer.

Archives: previous projects, PhD thesis, workshops... (in French) => HERE

Update: 4 march 2022 en flag fr flag