| Titre : | AI-Powered Emotion & Engagement Tracker with Immersive Technologies for Enhanced Online Therapy |
| Auteurs : | Zohra Lina, Auteur ; Mohamed Chaouki Babahenini, Directeur de thèse |
| Type de document : | Monographie imprimée |
| Editeur : | Biskra [Algérie] : Faculté des Sciences Exactes et des Sciences de la Nature et de la Vie, Université Mohamed Khider, 2026 |
| Format : | 1 vol. (281 p.) / couv. ill. en coul / 30 |
| Langues: | Français |
| Langues originales: | Anglais |
| Résumé : |
Mental health accessibility in Algeria is hindered by geographic barriers, cultural stigma, and the absence of locally tailored digital solutions, while existing teletherapy platforms fail to account for the Algerian context and suffer from high dropout rates. This thesis addresses these challenges by designing and developing Calmia, an accessible, engaging, and clinically informed online therapy platform for both patientsand therapists.Calmia is an online therapy platform that integrates two clinically grounded components: a real-time Facial Emotion Recognition (FER) model embedded within video call sessions, and three immersive VR serious games designed around evidence-based therapeutic approaches for mood regulation, anxiety management, and social exposuretherapy. The FER model, built on a CNN backbone with a cross-attention mechanism and structurally embedded attention heatmaps for interpretability, achieves resultscomparable to current FER research. Together, these position Calmia as a culturally aware contribution to digital mental health in Algeria |
| Sommaire : |
List of Figures 4 List of Tables 7 Introduction 8 1 Foundations of Online Therapy and Emotion-Aware Systems 10 1.1 Teletherapy . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10 1.2 Emotions and Facial Emotion Recognition . . . . . . . . . . . . . 11 1.2.1 Emotion Representation Models . . . . . . . . . . . . . . . 11 1.2.2 Emotion Sensing Modalities . . . . . . . . . . . . . . . . . 13 1.2.3 Facial Emotion Recognition in Therapy . . . . . . . . . . . 13 1.3 Advanced Digital Interventions in Mental Health . . . . . . . . . . 14 1.3.1 Virtual Reality and Game-based Interventions in Healthcare 14 1.3.2 What Is a Serious Game? . . . . . . . . . . . . . . . . . . 15 1.3.3 Therapeutic Immersive Serious Games . . . . . . . . . . . 15 1.3.4 Conclusion . . . . . . . . . . . . . . . . . . . . . . . . . . . 16 2 State of the Art: Teletherapy, Facial Emotion Recognition, and Therapeutic VR 17 2.1 Teletherapy Platforms: Strengths and Challenges . . . . . . . . . 17 2.1.1 Advantages and Effectiveness of Online Therapy . . . . . . 18 2.1.2 Challenges of Existing Teletherapy Platforms . . . . . . . 19 2.2 Facial Emotion Recognition: Relevance, Datasets and Existing Models . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20 2.2.1 Relevance of Facial Emotion Recognition in Therapy . . . 20 2.2.2 Overview and comparison of FER datasets . . . . . . . . . 20 2.2.3 FER Models: Evolution, Pipeline and Benchmarks . . . . 25 2.3 VR Serious Games in Therapeutic Contexts . . . . . . . . . . . . 32 2.3.1 Clinical Evidence for VR Serious Games in Therapy . . . . 32 2.3.2 The Proposed Games in the Context of Existing Therapeutic VR . . . . . . . . . . . . . . . . . . . . . . . . . . . 2.4 Proposed Solution . . . . . . . . . . . . . . . . . . . . . . . . . . . 34 2.4.1 Online Therapy Website . . . . . . . . . . . . . . . . . . . 34 2.4.2 AI FER Model . . . . . . . . . . . . . . . . . . . . . . . . 34 2.4.3 Immersive VR Therapeutic Serious Games . . . . . . . . . 35 2.4.4 Conclusion . . . . . . . . . . . . . . . . . . . . . . . . . . . 35 3 Calmia: System Design, FER Model, and VR Game Development 36 3.1 System Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . 36 3.2 Facial Emotion Recognition Model . . . . . . . . . . . . . . . . . 37 3.2.1 Dataset Selection . . . . . . . . . . . . . . . . . . . . . . . 37 3.2.2 Proposed Architecture . . . . . . . . . . . . . . . . . . . . 38 3.3 VR Serious Games: Concept and Design . . . . . . . . . . . . . . 52 3.3.1 Therapeutic Goals and Game Selection . . . . . . . . . . . 53 3.3.2 Game One: Mindfulness and Positive Reflection . . . . . . 53 3.3.3 Game Two: Breathing-Based Anxiety Regulation . . . . . 54 3.3.4 Game Three: Collaborative Simulation and Crowd Exposure 54 3.4 Online Therapy Platform . . . . . . . . . . . . . . . . . . . . . . . 55 3.4.1 System Design and Platform Actors . . . . . . . . . . . . . 55 3.4.2 Functional and Non-Functional Requirements . . . . . . . 56 3.4.3 AI and VR Integration Architecture . . . . . . . . . . . . . 58 3.4.4 Conclusion . . . . . . . . . . . . . . . . . . . . . . . . . . . 59 4 Evaluation & Analysis of Obtained Results 60 4.1 FER Model Architecture: Design Choices and Obtained Results . 60 4.1.1 Preprocessing Pipeline Output . . . . . . . . . . . . . . . . 61 4.1.2 Model Performance Analysis . . . . . . . . . . . . . . . . . 63 4.1.3 Per-Class Model Evaluation . . . . . . . . . . . . . . . . . 65 4.1.4 Attention-Based Visual Explainability . . . . . . . . . . . 69 4.2 Immersive Therapeutic VR Games . . . . . . . . . . . . . . . . . 72 4.2.1 Environment Walkthrough . . . . . . . . . . . . . . . . . . 73 4.2.2 Therapeutic Goals Coverage . . . . . . . . . . . . . . . . . 78 4.2.3 Immersion and Realism . . . . . . . . . . . . . . . . . . . . 81 4.2.4 Game Cooperation and Extensibility . . . . . . . . . . . . 81 4.3 Online Therapy Platform: Design and Demonstration . . . . . . . 82 4.3.1 Visual Design and Design Language . . . . . . . . . . . . . 82 4.3.2 System Overview . . . . . . . . . . . . . . . . . . . . . . . 82 4.3.3 UML Diagrams . . . . . . . . . . . . . . . . . . . . . . . . 83 4.3.4 Platform Pages and Navigation . . . . . . . . . . . . . . . 88 4.3.5 Conclusion . . . . . . . . . . . . . . . . . . . . . . . . . . . 97 Conclusion and Perspectives 98 FER Model Enhancement . . . . . . . . . . . . . . . . . . . . . . 99 VR Serious Games Expansion . . . . . . . . . . . . . . . . . . . . 99 Platform Upscaling . . . . . . . . . . . . . . . . . . . . . . . . . . 100 References 102 |
| Type de document : | Mémoire master |
Disponibilité (1)
| Cote | Support | Localisation | Statut |
|---|---|---|---|
| MINF/979 | Mémoire master | bibliothèque sciences exactes | Consultable |




