Development of a Gamified Environment with AI for Aphasia Rehabilitation: A Work in Progress

Miguel Bernardino Sousa Borges da Silva; André Delarovera Rezende; Gustavo Arléo Martins; Claudia Simões Pinto da Cunha Lima

doi:10.34178/jbth.v8i6.546

Miguel Bernardino Sousa Borges da Silva
André Delarovera Rezende
Gustavo Arléo Martins
Claudia Simões Pinto da Cunha Lima

DOI: https://doi.org/10.34178/jbth.v8i6.546

Keywords: Gamification, Rehabilitation, Aphasia, Speech Therapy, Artificial Intelligence

Abstract

Introduction: Aphasia is a neurological disorder that significantly impairs communication skills, affecting speech, writing, reading, and comprehension. Current rehabilitation methods often require constant professional supervision and rely on repetitive, non-interactive exercises. Objective: This work proposes an innovative gamified platform to support the rehabilitation of people with aphasia through interactive, 3D environments integrated with advanced speech recognition and artificial intelligence. Methods: The system offers mission-based tasks in which users interact with objects and environments inspired by daily life. Voice commands, captured and transcribed via Google Cloud Speech-to-Text, are interpreted by a natural language AI to enable free-form verbal interaction, going beyond predefined commands. Tasks include object naming, word recognition, and reading activities, with multimodal feedback (visual, verbal, and written). Expected Impact: The platform enables home-based, unsupervised practice while maintaining therapeutic quality, potentially enhancing lexical retrieval, improving patient engagement, and supporting speech-language pathologists in treatment planning. This approach combines gamification, accessibility, and AI-driven personalization to deliver a more dynamic, immersive, and adaptable rehabilitation process.