From sign languages to spoken language

The SignON project has received Horizon 2020 funding of €5.6M. SignON is a 3-year project led by ADAPT at DCU to address the communication gap between users of spoken languages and deaf sign language users. Researchers from the Centre for Language and Speech Technology (CLST) of Radboud University will be in charge of the automatic speech recognition component of the system.

The SignON EU consortium has received this award to conduct state of the art research and develop a mobile solution for automatic translation between sign and oral (written and spoken) languages.

SignON

SignON is a user-centric and community-driven project that aims to facilitate the exchange of information among deaf and hard of hearing, and hearing individuals across Europe targeting the Irish, British, Dutch, Flemish and Spanish Sign and English, Irish, Dutch, Spanish oral  languages. There are 5,000 deaf Irish Sign Language (ISL) signers; in the UK around 87,000 deaf signers use British Sign Language (BSL); in Flanders, Belgium some 5,000 deaf people use Flemish Sign Language (VGT); there are approximately 13,000 signers using Sign Language of the Netherlands (NGT); and it is estimated that there are over 100,000 Spanish Sign Language (LSE) signers.

Through collaboration with these European deaf and hard of hearing communities,  researchers will define use-cases, co-design and co-develop the SignON service and application.  The objective of the research project is the fair, unbiased and inclusive spread of information and digital content in European society.

More than an advanced translation system

The SignON communication service will be more than an advanced machine translation system. Behind the scenes, SignON will incorporate sophisticated machine learning capabilities that will allow (i) learning new Sign and oral languages; (ii) style-, domain- and user-adaptation and (iii) automatic error correction, based on user feedback. To the user, SignON will deliver signed conversations via a life-like avatar built with latest graphics technologies.

To ensure wide uptake, improved sign language detection and synthesis, as well as multilingual speech processing for everyone, the project will deploy the SignON service as a smart phone application running on standard modern devices. While the application is designed as a light-weight interface, the SignON framework, will be distributed on the cloud where the computationally intensive tasks will be executed.

The SignON project will commence on 01/01/2021 and the consortium are currently recruiting a wide range of experts in the fields of Natural Language Processing (NLP) Machine Learning (ML) , Deep Learning (DL), Machine Translation (MT)  Linguistics, Deaf studies, education, 3D graphics and others to join the SignON team.

The SignON project will commence on 1 January 2021 and the consortium are currently recruiting a wide range of experts in the fields of Natural Language Processing (NLP) Machine Learning (ML) , Deep Learning (DL), Machine Translation (MT)  Linguistics, Deaf studies, education, 3D graphics and others to join the SignON team. The SignON EU consortium of 17 European partners led by Prof. Andy Way, Professor of Computing at Dublin City University, Ireland (coordinator), and Dr. Dimitar Shterionov Assistant Professor in Cognitive Science and Artificial Intelligence at Tilburg University, The Netherlands.

Meer weten? Neem contact op met

• Persvoorlichting & wetenschapscommunicatie Radboud Universiteit, media@ru.nl, 024 361 6000