UNISONO aims to develop a novel system combining an ear-worn sensor with speech recognition. In addition to a continuous measurement of vital parameters, the sensor will be equipped with a speech assistant that enables voice-guided communication. The collected data will be utilized to derive novel vocal biomarkers for AI-driven digital clinical phenotyping of patients with chronic heart failure.
In a very competitive selection, UNISONO made it into the top 8% of projects funded by the German Federal Ministry of Education and Research as part of its programme “KMU-innovativ (programme for innovative SMEs) in “Interactive technologies for health and quality of life”. The 3-year project started on August 1st, 2022, and a first joint meeting was held involving all partners and the project executing agency VDI/VDE Innovation + Technology GmbH.
The innovation of UNISONO consists in leveraging Zana's existing AI platform with novel vocal biomarkers technology through the clinical expertise of the CHFC, while extending Cosinuss° in-ear sensor for speech interaction. Heart failure is characterized by fluid overload and increased intracardiac filling pressures, hence edema in the vocal folds and lungs might affect the patient’s voice. As such, acoustic measures of voice dysfunction and speech characteristics may be early indicators of incipient decompensation or changes in the patient’s health status.
Previous approaches have been used to collect voice-based information in isolation for individual moods, states of mind and health, to associate voice alterations with vital signs, or to deploy voice-driven systems to complete patient questionnaires. “With UNISONO, we are investigating how speech and vital data can be combined to such an extent and how the data quality can be improved by an intelligent assistant in order to use it as a health predictor in heart failure.”, states Dr. Julia Hoxha, CEO of Zana and coordinating partner. She adds: “In doing so, UNISONO brings AI-powered collection of real-world data to core healthcare and clinical research.”
To simultaneously enable voice interaction and measure vital signs (such as body temperature, heart rate, oxygen saturation and respiration rate), the hardware of the patented ear sensor from Cosinuss° will be extended to include microphone and loudspeaker. “This technology enables us to continuously monitor the patient’s vital signs and voice in real time over several weeks without complex cabling, and use it to develop a large database for the development of a voice biomarker for clinical phenotyping”, states Dr. Johannes Kreuzer, CEO of Cosinuss°.
In collaboration with the clinical partner CHFC, digital clinical phenotypes will be identified from the collected data and linked to established factors associated with worse prognosis in heart failure. “Vocal biomarkers have huge potential for improving patient care in heart failure since they are non-invasive, low-cost, easy to collect repetitively, and can be assessed remotely”, explains Dr. Fabian Kerwagen, MPH, leader of project UNISONO at the CHFC. “Combining patient’s voice with ear-worn technology will facilitate comprehensive digital phenotyping of heart failure patients and offer new opportunities for telemonitoring and prevention in heart failure”.
MEDICA-tradefair.com; Source: Universitätsklinikum Würzburg
