Online citations, reference lists, and bibliographies.

Machine Learning Algorithm For Grading Open-ended Physics Questions In Turkish

Ayşe Çınar, Elif Ince, Murat Gezer, Özgür Yılmaz
Published 2020 · Computer Science
Cite This
Download PDF
Analyze on Scholarcy
Share
Worldwide, open-ended questions that require short answers have been used in many exams in fields of science, such as the International Student Assessment Program (PISA), the International Science and Maths Trends Research (TIMSS). However, multiple-choice questions are used for many exams at the national level in Turkey, especially high school and university entrance exams. This study aims to develop an objective and useful automatic scoring model for open-ended questions using machine learning algorithms. Within the scope of this aim, an automated scoring model construction study was conducted on four Physics questions at a University level course with the participation of 246 undergraduate students. The short-answer scoring was handled through an approach that addresses students’ answers in Turkish. Model performing machine learning classification techniques such as SVM (Support Vector Machines), Gini, KNN (k-Nearest Neighbors), and Bagging and Boosting were applied after data preprocessing. The score indicated the accuracy, precision and F1-Score of each predictive model of which the AdaBoost.M1 technique had the best performance. In this paper, we report on a short answer grading system in Turkish, based on a machine learning approach using a constructed dataset about a Physics course in Turkish. This study is also the first study in the field of open-ended exam scoring in Turkish.
This paper references
10.13189/CSIT.2018.060101
Motivating Energy and Resource Conservation Behavior by Gamification
Huang Li-n (2018)
Package 'e1071
D Meyer
10.1007/978-1-4757-2691-6
Handbook of Modern Item Response Theory
Wim van der Linden (1997)
Free-text input vs menu selection: exploring the difference with a tutorial dialogue system
Jenny McDonald (2012)
10.3115/v1/N15-1111
Effective Feature Integration for Automated Short Answer Scoring
Keisuke Sakaguchi (2015)
KNN approach to unbalanced data distributions : A case study involving information extraction
I. Mani (2003)
Adabag: Applies multiclass AdaBoost.M1, SAMME and bagging
E Alfaro
10.1007/s10639-018-9745-z
Short answer scoring system using automatic reference answer generation and geometric average normalized-longest common subsequence (GAN-LCS)
Feddy Setio Pribadi (2018)
Conceptual Integrated Science
Paul G. Hewitt (2006)
Adabag: Applies multiclass AdaBoost.M1
E. Alfaro (2015)
Deep Learning + Student Modeling + Clustering: a Recipe for Effective Automatic Short Answer Grading
Yuan Zhang (2016)
10.1007/10639.1573-7608
Education and information technologies
Arend J. Visscher (1997)
10.18653/v1/W17-5017
Investigating neural architectures for short answer scoring
Brian Riordan (2017)
10.1007/978-3-540-30228-5_3
Automatic Assessment of Open Ended Questions with a Bleu-Inspired Algorithm and Shallow NLP
Enrique Alfonseca (2004)
10.5753/CBIE.SBIE.2018.1373
Portuguese Automatic Short Answer Grading
Lucas Busatta Galhardi (2018)
10.1613/jair.953
SMOTE: Synthetic Minority Over-sampling Technique
Nitesh V. Chawla (2002)
Package 'class
B Ripley
10.21767/2349-3917.100017
Augmented Reality in Industry 4.0
Francesco De Pace (2018)
10.4304/JSW.5.12.1371-1377
Feature Selection via Correlation Coefficient Clustering
Hui-Huang Hsu (2010)
Measuring and promoting inter-rater agreement of teacher and principal performance ratings.
Matthew J. Graham (2012)
Assessment of Student Achievement
N. E. Gronlund (1997)
10.3115/1631836.1631849
Diagnosing Meaning Errors in Short Answers to Reading Comprehension Questions
Walt Detmar Meurers (2008)
KNN approach to unbalanced data distributions: A case study
J. Zhang (2003)
10.3115/1609067.1609130
Text-to-Text Semantic Similarity for Automatic Short Answer Grading
Michael Mohler (2009)
Package ‘class’. https://cran.r-project.org/web/packages/class/class.pdf
B. Ripley (2019)
Annotating Students' Understanding of Science Concepts
Rodney D. Nielsen (2008)
10.18653/v1/W17-5052
A Large Scale Quantitative Exploration of Modeling Strategies for Content Scoring
Nitin Madnani (2017)
Portuguese automatic short answer grading, VII Congresso Brasileiro de Informática na Educação-CBIE
L. Galhardi (2018)
Automatic evaluation of users’ short essays by using statistical and shallow natural language processing techniques
Diana Rosario Pérez Marín (2004)
The comparison of Accuracy, Precision and F1-Score of the algorithms at ten different random iterations for Question 4 Education and Information Technologies
10.1023/A:1025779619903
C-rater: Automated Scoring of Short-Answer Questions
Claudia Leacock (2003)
Transductive Inference for Text Classification using Support Vector Machines
T. Joachims (1999)
Item response theory: Brief history, common models, and extensions (pp. 1–28)
W. J. Van der Linden (1997)
A Comparison of Features for the Automatic Labeling of Student answers to Open-ended Questions
Jesus Gerardo Alvarado Mantecon (2018)
Short Answer Assessment: Establishing Links Between Research Strands
Ramon Ziai (2012)
10.1007/3-540-47987-2_20
The Architecture of Why2-Atlas: A Coach for Qualitative Physics Essay Writing
K. VanLehn (2002)
UPPER BOUNDS OF THE BLEU ALGORITHM APPLIED TO ASSESSING STUDENT ESSAYS
Diana Pérez
An automated short-free-text scoring system: Development and assessment
O. Bukai (2006)
10.21767/2349-3917.100016
An Efficient Classification Model for Unstructured Text Document
Mona Mowafy (2018)
10.1080/10627197.2015.997617
Contrasting State-of-the-Art in the Machine Scoring of Short-Form Constructed Responses
Mark D. Shermis (2015)
The Myth of Objectivity in Mathematics Assessment
L. Romagnano (2001)
Recursive Partitioning and Regression Trees, Package ‘rpart
T. Therneau (2017)
10.1142/S0218213011000188
Automatic Assessment of Students' Free-Text Answers with Different Levels
Wen-Juan Hou (2011)
10.1162/tacl_a_00236
Powergrading: a Clustering Approach to Amplify Human Effort for Short Answer Grading
Sumit Basu (2013)
10.26499/ICEAP.V2I1.95
UKARA: A Fast and Simple Automatic Short Answer Scoring System for Bahasa Indonesia
Guntur Budi Herwanto (2018)
10.1007/s10639-016-9547-0
Superlative model using word cloud for short answers evaluation in eLearning
Shailaja Jayashankar (2016)
Automatic evaluation of user’s short essays by using statistical and shallow natural
D. Perez-Marin (2004)
Assessment of student achievement (6th ed.)
N. E. Gronlund (1998)
10.1007/978-1-4757-2691-6_1
Item Response Theory: Brief History, Common Models, and Extensions
Wim van der Linden (1997)
10.1007/978-3-642-31537-4_46
Application of Bagging, Boosting and Stacking to Intrusion Detection
Iwan Syarif (2012)
Experiments with a New Boosting Algorithm
Yoav Freund (1996)
10.1007/s40593-014-0026-8
The Eras and Trends of Automatic Short Answer Grading
Steven Burrows (2014)
10.1145/1999747.1999793
Automated assessment of short free-text responses in computer science using latent semantic analysis
Richard Klein (2011)



Semantic Scholar Logo Some data provided by SemanticScholar