Affiliations: [a]
Department of Artificial Intelligence and Data Science, Panimalar Engineering College, Anna University, Chennai, Tamil Nadu, India
| [b]
Department of Computer Science and Engineering, Panimalar Engineering College, Anna University, Chennai, Tamil Nadu, India
Correspondence:
[*]
Corresponding author. S. Vimala, Department of Artificial Intelligence and Data Science, Panimalar Engineering College, Anna University, Chennai-600123, Tamil Nadu, India. E-mail: [email protected].
Abstract: This study proposes a novel method using hybrid CNN-LSTM networks to measure and predict the effectiveness of speech and vision therapy. Traditional methods for evaluating therapy often rely on subjective assessments, lacking precision and efficiency. By combining CNN for visual data and MFCC for speech, alongside LSTM for temporal dependencies, the system captures dynamic changes in patients’ conditions. Pre-processing of audio and visual data enhances accuracy, and the model’s performance outperforms existing methods. This approach exhibits the potential of deep learning in monitoring patient progress effectively in speech and vision therapy, offering valuable insights for improving treatment outcomes. The proposed system’s effectiveness is assessed by various performance metrics. The suggested system’s results are compared with those of other methods already in use. The study’s findings indicate that the suggested approach is more accurate than other existing models. In conclusion, this study offers important new information on how deep learning methods are being used to track patients’ progress in speech and vision therapy.
Keywords: Monitor, speech and vision, deep learning, therapy patient, recording device, CNN-LSTM, categorization
