Educational training simulator for monitoring reading technique and speed based on speech-to-text (STT) methods

- Barkovska, Olesia (orcid.org/0000-0001-7496-4353), Ivashchenko, Heorhii (orcid.org/0000-0003-1027-5262), Rosinskiy, Dmytro (orcid.org/0000-0002-0725-392X) and Zakharov, Daniil (orcid.org/0009-0006-4676-6599) (2024) Educational training simulator for monitoring reading technique and speed based on speech-to-text (STT) methods Information Technologies and Learning Tools, 5 (103). pp. 21-38. ISSN 2076-8184

Text Олеся Барковська.pdf - Published Version Download (943kB)

Abstract

The work is devoted to a relevant issue – gamification of the educational process of primary school students with the use of digital mobile devices using the example of educational trainer developed to control the technique and speed of reading. The practical novelty of the study lies in its potential to optimize the process of controlling reading techniques for children with various speech disorders, such as lisping, rhotacismus, and dyslalia, which remains an unsolved problem for existing computer linguistic models. The practical significance lies in the fact that the use of information and communication technologies and gamification of the learning process motivates to gain knowledge and encourages learning not only due to the game strategy, but also due to the fact that the child receives approval and the opportunity to perform the task again so to improve skills. The proposed and tested trainer for monitoring the technique and speed of reading of primary school students for a mobile digital device recognizes the child’s voice with high accuracy (up to 94.84%), detects misread words and counts the number of words read in the given time period. The architecture of the proposed system consists of the following modules: preparation module, which ensures the correct functioning of the system regardless of the existing speech disorders; the speech-to-text converter directly converts the voice of the child reading the text on the gadget screen into text; The text comparison module is responsible for comparing the text read aloud with the text obtained as a result of conversion. The results of testing children with lisping and rhotacismus problems showed that the Jaro algorithm has a slightly higher accuracy of comparing two texts (by an average of 1.14%), and, at the same time, a shorter comparison time for large text arrays (by 39%). The results of testing children with dyslalia, meaning the rearrangement of sounds in words when reading, also showed that the Jaro algorithm has a shorter line comparison time for large text arrays (by 7%). The reduced operation time in methods for comparing texts in dyslalia cases is attributed to the absence of text array variations, with evaluations solely focusing on potential permutations of sounds.

Item Type:	Article
Keywords:	computer game; reading technique; mobile devices; editorial distance; speech-to-text.
Subjects:	Science and knowledge. Organization. Computer science. Information. Documentation. Librarianship. Institutions. Publications > 00 Prolegomena. Fundamentals of knowledge and culture. Propaedeutics > 004 Computer science and technology. Computing. Data processing > 004.9 ІКТ ( Application-oriented computer-based techniques ) Science and knowledge. Organization. Computer science. Information. Documentation. Librarianship. Institutions. Publications > 8 Language. Linguistics. Literature > 81 Linguistics and languages
Divisions:	Institute for Digitalisation of Education > Generic resouse
Depositing User:	Алла 1 Алла Почтарьова
Date Deposited:	13 Jan 2025 10:10
Last Modified:	13 Jan 2025 10:10
URI:	https://lib.iitta.gov.ua/id/eprint/744134

Downloads

Actions (login required)

View Item