To download article.UDK 371.26-021.4
DOI: 10.15507/1991-9468.096.023.201903.440-457
Development of a Set of Criteria for Analysing Trainee Answers in Expert Control Systems and Assessment of Knowledge
Viktoriya N. Golovachyova
Professor of Software Department, Karaganda State Technical University (56 Mira Avenue, Karaganda 100027, Kazakhstan), Dr. Sci. (Pedagogy), ORCID: https://orcid.org/0000-0002-2024-2109, Scopus ID: 56646538500, Researcher ID: N-9843-2017, This email address is being protected from spambots. You need JavaScript enabled to view it.
Nadezhda I. Tomilova
Associate Professor of Software Department, Karaganda State Technical University (56 Mira Avenue, Karaganda 100027, Kazakhstan), Ph. D. (Engineering), ORCID: https://orcid.org/0000-0001-8782-5627, Scopus ID: 57194212148, Researcher ID: B-2794-2019, This email address is being protected from spambots. You need JavaScript enabled to view it.
Gulnur B. Abildaeva
Senior Teacher of Software Department, Karaganda State Technical University (56 Mira Avenue, Karaganda 100027, Kazakhstan), Master of Engineering, ORCID: https://orcid.org/0000-0003-3262-2552, Researcher ID: B-3194-2019, This email address is being protected from spambots. You need JavaScript enabled to view it.
Introduction. The article deals with the problem of objective knowledge assessment using expert automated systems for monitoring and evaluating knowledge. The relevance of this study is determined by qualitatively improving the monitoring and evaluation of knowledge using a testing method. The purpose of the work was to develop a set of criteria for analysing a test response along with an objective approach to their assessment.
Materials and Methods. The study was conducted on the basis of the system analysis and B. Bloom’s method tracking learning outcomes, as well as the method widely used in the study of the quality of studies on the assessment of educational achievement of students: Program for International Student Assessment. In order to study the problem, 102 teachers and 357 students of two universities – Karaganda State Technical University and Karaganda State University named after E.A. Buketov – in Karaganda, Kazakhstan were interviewed and their responses observed.
Results. The results of the work are of interest to the scientific and pedagogical community, as well as practicing teachers. The article proposes a new approach to constructing a test question to allow a response in a freely-constructed form. Such an answer can be analysed by a set of criteria for its formation based on the developed algorithms for a criterial assessment of their quality. This makes it possible to apply the obtained results to solve the scientific problem of objective k nowledge assessment using testing.
Discussion and Conclusion. The completed study has expanded the representation of the possibilities of using the expert systems for monitoring and evaluating knowledge and increasing the objectivity of knowledge acquired during learning processes. The received results represent the practical importance for teachers involved in the development of expert control systems and assessment of knowledge. The prospect of further study consists in improving the testing method by expanding the set of criteria for assessing knowledge.
Keywords: didactics, testing, forms of designing the test answer, complex of criteria, expert control system and assessment of knowledge, quality of training
For citation: Golovachyova V.N., Tomilova N.I., Abildaeva G.B. Development of a Set of Criteria for Analysing Trainee Answers in Expert Control Systems and Assessment of Knowledge. Integratsiya obrazovaniya = Integration of Education. 2019; 23(3):440-457. DOI: https://doi.org/10.15507/1991-9468.096.023.201903.440-457
Сontribution of the authors:
Viktoriya N. Golovachyova – development of methodology; formulation of the basic research; scientific advising; formulation of the scientific problem and definition of main ways for solving; critical analysis and editing the text; formation of conclusions.
Nadezhda I. Tomilova – general project management; development of methodology; participation in development of the expert control system and assessment of knowledge; drawing up test tasks for carrying out the pedagogical experiment; carrying out critical analysis of materials and formation of the initial conclusions.
Gulnur B. Abildaeva – search of analytical materials in national and foreign sources; conducting testing; collecting and analysis of statistical data; visualisation of data in the text; carrying out analysis and preparation of initial conclusions.
All authors have read and approved the final manuscript.
Submitted 01.02.2019; revised 24.05.2019; published online 30.09.2019.
This work is licensed under a Creative Commons Attribution 4.0 License.