Magnetic Skin for Voice Disorders with Real-Time Lip Translation

Research output: Contribution to journalArticlepeer-review

Abstract

The next generation of wearable technology is embodied by flexible, biocompatible magneto-skin that seamlessly integrates with the body, offering tunable permanent magnetic properties to any surface it adheres to. When combined with magnetic sensors, this innovative material transforms into a wearable magnetic system. Drawing inspiration from the adhesion mechanics of octopus suckers, an adhesive magnetic skin designed for speech therapy applications is introduced. This skin-attachable patch adheres securely to both dry and wet skin without causing irritation, providing comfort during extended wear. The system, comprising two small patches attached to the lower lip, a wireless headset with embedded magnetic field sensors, and a mobile application powered by a convolutional neural network, translates lip movements into spoken words. The system predicts successfully 92.54% of the cases with non-seen data and 90.21% of the real-time cases. With customizable patch size and an intuitive user interface, this edge-based device offers a groundbreaking solution for individuals with voice disorders, providing a tailored, non-invasive therapeutic approach that adapts to the unique needs of users and therapists alike.

Original languageEnglish (US)
Article number2400972
JournalAdvanced Intelligent Systems
Volume7
Issue number5
DOIs
StatePublished - May 2025

Bibliographical note

Publisher Copyright:
© 2025 The Author(s). Advanced Intelligent Systems published by Wiley-VCH GmbH.

Keywords

  • convolutional neural network
  • magnetic skin
  • speech and sound diseases
  • voice disorder
  • wearable electronics

ASJC Scopus subject areas

  • Artificial Intelligence
  • Computer Vision and Pattern Recognition
  • Human-Computer Interaction
  • Mechanical Engineering
  • Control and Systems Engineering
  • Electrical and Electronic Engineering
  • Materials Science (miscellaneous)

Fingerprint

Dive into the research topics of 'Magnetic Skin for Voice Disorders with Real-Time Lip Translation'. Together they form a unique fingerprint.

Cite this