Using Machine Learning to Detect 'Multiple-Account'Cheating and Analyze the Influence of Student and Problem Features Articles uri icon

publication date

  • December 2017

start page

  • 112

end page

  • 122

issue

  • 1

volume

  • 12

international standard serial number (ISSN)

  • 1939-1382

abstract

  • One of the reported methods of cheating in online environments in the literature is CAMEO (Copying Answers using Multiple Existences Online), where harvesting accounts are used to obtain correct answers that are later submitted in the master account which gives the student credit to obtain a certificate. In previous research, we developed an algorithm to identify and label submissions that were cheated using the CAMEO method; this algorithm relied on the IP of the submissions. In this study, we use this tagged sample of submissions to i) compare the influence of student and problems characteristics on CAMEO and ii) build a random forest classifier that detects submissions as CAMEO without relying on IP, achieving sensitivity and specificity levels of 0.966 and 0.996, respectively. Finally, we analyze the importance of the different features of the model finding that student features are the most important variables towards the correct classification of CAMEO submissions, concluding also that student features have more influence on CAMEO than problem features.

keywords

  • academic dishonesty; educational data mining; machine learning; moocs; academic dishonesty