Brailleeasy - una solución de iomt para aprender braille de manera autónoma

Abstract

With the objective of supporting the user in autonomous learning of the Braille System (SB), the BrailleEasy project integrates a Web Application (WA) as a user interface and an Electromechanical Device (ED), which are part of a solution based on the Internet of Medical Things (IoMT). The project implementation was done by developing an AW accessible from any browser, built with NextJS and designed to integrate with Azure services. This AW communicates with Azure IoT Hub, which manages the interaction with the AZ3166 microcontroller, running a Real-Time Operating System (RTOS) based on Eclipse ThreadX. Access to the AW is possible through a URL, a QR code or NFC technology, all of them integrated in the DE, thus facilitating the user's interaction with the project. Once inside the AW, the user can interact through voice commands in Spanish language, the interface captures the audio generated by the user, extracts the text from the captured audio, processes the user's intention from the text, generates a response according to the instructions received, synthesizes the audio according to the instructions received, and synthesizes the audio according to the instructions received, synthesizes the audio according to the generated response and sends the corresponding characters to the DE so that it drives a set of servomotors that raise and lower a lever mechanism to form a contact surface depending on the character of the selected SB. In this way, the device forms character by character, words or sentences in SB.