SpeechXRays - Multi-channel biometrics combining acoustic and machine vision analysis of speech, lip movement and face

Date: 
01/05/2015 to 30/04/2018

Introduction

The SpeechXRays project will develop and test in real-life environments a user recognition platform based on voice acoustics analysis and audio-visual identity verification. SpeechXRays will outperform state-of-the-art solutions in the following areas:

  • Security: high accuracy solution (cross over accuracy1 of 1/100 ie twice the commercial voice/face solutions)
  • Privacy: biometric data stored in the device (or in a private cloud under the responsibility of the data subject)
  • Usability: text-independent speaker identification (no pass phrase), low sensitivity to surrounding noise
  • Cost-efficiency: use of standard embedded microphone and cameras (smartphones, laptops)

The project will combine and pilot two proven techniques: acoustic driven voice recognition (using acoustic rather than statistical only models) and multi-channel biometrics incorporating dynamic face recognition (machine vision analysis of speech, lip movement and face).

The vision of the SpeechXRays project is to provide a solution combining the convenience and cost-effectiveness of voice biometrics, achieving better accuracies by combining it with video, and bringing superior anti-spoofing capabilities. The technology will be deployed on 2000 users in 3 pilots: a workforce use case, an eHealth use case and a consumer use case. The project lasts 36 months and is coordinated by world leader in digital security solutions for the mobility space.

Week: 
Wednesday, 14 February, 2018

Project type:

News

Outcomes and key themes from ICT 2018 Session on Cybersecurity as key for a Digital Economy and Society

On 5 December 2018, the Digital Single Market of the European Commission sponsored a session on the topic of “Cybersecurity as key for a Digital Economy and Society”. The highly-popular session (over 90 attendees) took place on 5 December 2018 within the flagship ICT2018 Conference in Vienna, Austria.

Khalil Rouhana, Deputy Director General, EC – DG CNECT, kicked off the session with an overview of some of the most pressing issues of the day in cybersecurity: