Automatic scoring of knowledge gained and shared through Discussion forums: based on the Community of Inquiry model

- Nadeesha, P.A.L. (orcid.org/0009-0005-6329-9091), Weerasinghe, T.A. (orcid.org/0000-0002-7379-3916) and Abeyweera, W.R.N.S (orcid.org/0009-0009-9425-4450) (2025) Automatic scoring of knowledge gained and shared through Discussion forums: based on the Community of Inquiry model Information Technologies and Learning Tools, 1 (105). pp. 85-102. ISSN 2076-8184

Text П.А.Л. Надіша, Т.А. Вірасінгхе, В.Р.Н.С. Абервіра.pdf - Published Version Download (349kB)

Abstract

The Community of Inquiry (CoI) framework has been widely employed for the past two decades to assess the knowledge gained and shared through online discussion forums. The cognitive presence component of the CoI framework helps identify the evidence of thoughtful knowledge reconstructions through meaning-making during inquiry-based learning. Identifying and scoring these cognitive presences is essential for assessing the students’ learning achievements through online discussion forums. Considering the difficulties associated with manual coding and identifying cognitive presences in discussion forums and the limitations in the existing techniques for auto-identifying and scoring cognitive presences, this research attempted to develop a more efficient tool to identify and score cognitive presences in online discussion forums. The research employed the constructive research approach. The methodology integrated Random Forest (RF) classification with TF-IDF feature extraction and Support Vector Machine (SVM) classification with Word2Vec embedding. A rule-based classifier, constructed upon indicator mappings, enriched the classification process. A weighted voting ensemble method was employed to combine the outputs of the individual classifiers. Our approach was trained and tested on two datasets comprising 781 messages containing 47,592 words. This ensemble method demonstrated notable efficacy, achieving a 69% accuracy rate in classification tasks. This highlights the robustness of the combined approach in enhancing classification performance. Furthermore, the study introduces a scoring model that calculates individual student scores based on post categories, enabling detailed evaluations of student engagement and participation. By assigning scores reflective of discussion contributions, this model advances comprehensive assessments of online learning interactions. Our work contributes to the ongoing conversation on leveraging machine learning for cognitive analysis in online learning environments, highlighting the importance of context-specific methodologies in advancing educational assessment practices.

Item Type:	Article
Keywords:	Cognitive presence; Community of Inquiry; Machine Learning; Natural Language Processing; Classification
Subjects:	Science and knowledge. Organization. Computer science. Information. Documentation. Librarianship. Institutions. Publications > 00 Prolegomena. Fundamentals of knowledge and culture. Propaedeutics > 004 Computer science and technology. Computing. Data processing > 004.9 Application-oriented computer-based techniques Science and knowledge. Organization. Computer science. Information. Documentation. Librarianship. Institutions. Publications > 3 Social Sciences > 37 Education > 37.01/.09 Special auxiliary table for theory, principles, methods and organization of education > 37.02 General questions of didactics and method Science and knowledge. Organization. Computer science. Information. Documentation. Librarianship. Institutions. Publications > 3 Social Sciences > 37 Education > 378 Higher education. Universities. Academic study
Divisions:	Institute for Digitalisation of Education > Generic resouse
Depositing User:	Алла 1 Алла Почтарьова
Date Deposited:	06 May 2025 14:12
Last Modified:	06 May 2025 14:12
URI:	https://lib.iitta.gov.ua/id/eprint/745246

Downloads

Actions (login required)

View Item