Development of the computer vision system based on machine learning for educational purposes

- Семеріков, С.О. (orcid.org/0000-0003-0789-0272), Вакалюк, Тетяна Анатоліївна (orcid.org/0000-0001-6825-4697), Мінтій, І.С. (orcid.org/0000-0003-3586-4311), Гаманюк, Віта Анатоліївна (orcid.org/0000-0002-3522-7673), Соловйов, В.М. (orcid.org/0000-0002-4945-202X), Бондаренко, Ольга В. (orcid.org/0000-0003-2356-2674), Нечипуренко, Павло Павлович (orcid.org/0000-0001-5397-6523), Шокалюк, С.В. (orcid.org/0000-0003-3774-1729), Моісеєнко, Н.В. (orcid.org/0000-0002-3559-6081) and Рубан, Вiталiй (orcid.org/0000-0001-9321-6086) (2021) Development of the computer vision system based on machine learning for educational purposes Educational Dimension, 5 (57). pp. 8-60. ISSN 2708-4604

Text eddi_5(57)-8-60.pdf - Published Version Download (31MB)

Abstract

The article provides an overview of the origins and current state of machine vision systems, examples of machine vision problems. The article describes the use of computer vision systems in education in both conventional and pandemic conditions. The COVID-19 pandemic has triggered changes in education that have modified existing educational applications of computer vision systems and spawned new ones, including social distancing, facial mask recognition, detection of infiltration into universities and schools, prevention of vandalism and detection of suspicious objects, attendance monitoring, recognition of emotions on faces in and without masks. Computer vision systems can also be used in education to introduce immersive educational resources. On the basis of the analysis of autonomous libraries for the identification of dynamic objects, it is concluded that in the creation of computer vision systems for educational purposes it is advisable to use computer vision libraries based on in-depth learning (in particular, the implementation of convolutional neural networks). A prototype computer vision system developed on the basis of Microsoft Cognitive Toolkit and deployed in the Microsoft Azure cloud is described. The system allows you to perform with a high degree of reliability the main functions: identification of emotions and the presence of a mask on the face, as well as allows you to determine sex, age, hair color, smile intensity, the presence of makeup, glasses, etc.

Item Type:	Article
Keywords:	computer vision, COVID-19 , mask detection, education
Subjects:	Science and knowledge. Organization. Computer science. Information. Documentation. Librarianship. Institutions. Publications > 00 Prolegomena. Fundamentals of knowledge and culture. Propaedeutics > 004 Computer science and technology. Computing. Data processing > 004.9 ІКТ ( Application-oriented computer-based techniques ) > 004.93 Pattern information processing Science and knowledge. Organization. Computer science. Information. Documentation. Librarianship. Institutions. Publications > 3 Social Sciences > 37 Education > 37.01/.09 Special auxiliary table for theory, principles, methods and organization of education
Divisions:	Institute for Digitalisation of Education > Department of Cloud-Oriented Systems and Artificial Intelligence in Education
Depositing User:	Сергій Олексійович Семеріков
Date Deposited:	06 Jan 2023 17:43
Last Modified:	06 Jan 2023 17:43
URI:	https://lib.iitta.gov.ua/id/eprint/733725

Downloads

Actions (login required)

View Item