The Experimental Study of the Effect of Functional-Variational Factors on the Results of Linguistic Testing

- Hryvko, Antonina (orcid.org/0000-0001-9460-4777) and Zhuk, Yurii (orcid.org/0000-0002-6932-2484) (2022) The Experimental Study of the Effect of Functional-Variational Factors on the Results of Linguistic Testing Journal of Сurriculum and Teaching, 1 (11). pp. 45-58. ISSN 1927-2677

Text 21390-71497-1-SM.pdf - Published Version Download (554kB)

Abstract

A feature of the presented study is a comprehensive approach to studying the reliability problem of linguistic testing results due to the several functional and variable factors impact. Contradictions and ambiguous views of scientists on the researched issues determine the relevance of this study. The article highlights the problem of equivalence of diagnostic potential and the complexity of closed and open test tasks. The issues of polymorphism and monomorphism of tests, as well as variability of tests on the sequence of different question forms and their ratio in one test, are revealed. The article authors substantiate the need for in-depth empirical research to further improve the basic quality design principles and improve tests for final testing of high school students. The main purpose of the study was to examine the controlled and uncontrolled factors that affect test results. This article represents a study conducted among the students of the 8th and 9th grades (N=332) and in the subject field of Ukrainian (as a native language). In the first phase of the study the criteria-oriented author's tests and questionnaires were used by the authors as research tools. Data analysis was performed using factor and analysis of variance (and other mathematical and statistical methods), which allowed proving the direct influence of the factor "form of test tasks" on the test results (impact power is up to 35%). The methodology of the study allowed us to determine the combination of forms of tasks that have the lower impact on test results and, accordingly, are characterized by the highest diagnostic reliability. In the second (refining) phase of the study, taking into account the previous results, it was found that the ratio of test questions, as well as their sequence, can also affect the test results and are detected depending on the gender characteristics of the test participants. According to the results of the research, some ideal externally-organized design of Ukrainian language tests for in-school control and classroom-assessment is proposed. It is provided by a combination of the multiple-choice questions and constructed-response questions in equal proportions in descending order of operational complexity of tasks (taking into account gender peculiarities of testing participants). The prospects for continuation and deepening of the research, connected with further study of the optimal empirically valid test structure, are substantiated. In the second (refining) phase of the study, taking into account the previous results, it was found that the ratio of test questions, as well as their sequence, can also affect the test results and are detected depending on the gender characteristics of the test participants. According to the results of the research, some ideal externally-organized design of Ukrainian language tests for in-school control and classroom-assessment is proposed. It is provided by a combination of the multiple-choice questions and constructed-response questions in equal proportions in descending order of operational complexity of tasks.

Item Type:	Article
Keywords:	educational testing, secondary school student evaluation, test format, item order, item difficulty, item analysis, scores.
Subjects:	Science and knowledge. Organization. Computer science. Information. Documentation. Librarianship. Institutions. Publications > 00 Prolegomena. Fundamentals of knowledge and culture. Propaedeutics > 004 Computer science and technology. Computing. Data processing > 004.4 Software Science and knowledge. Organization. Computer science. Information. Documentation. Librarianship. Institutions. Publications > 00 Prolegomena. Fundamentals of knowledge and culture. Propaedeutics > 004 Computer science and technology. Computing. Data processing > 004.9 ІКТ ( Application-oriented computer-based techniques ) Science and knowledge. Organization. Computer science. Information. Documentation. Librarianship. Institutions. Publications > 3 Social Sciences > 37 Education > 37.01/.09 Special auxiliary table for theory, principles, methods and organization of education > 37.09 Organization of instruction Science and knowledge. Organization. Computer science. Information. Documentation. Librarianship. Institutions. Publications > 3 Social Sciences > 37 Education > 373 Kinds of school providing general education Science and knowledge. Organization. Computer science. Information. Documentation. Librarianship. Institutions. Publications > 8 Language. Linguistics. Literature > 81 Linguistics and languages
Divisions:	Institute of Pedagogics > Department of Monitoring and Assessment of the Quality of General Secondary Education
Depositing User:	С.О. Науменко
Date Deposited:	23 Oct 2023 11:48
Last Modified:	23 Oct 2023 11:48
URI:	https://lib.iitta.gov.ua/id/eprint/737122

Downloads

Actions (login required)

View Item