Essay question generator based on bloom's taxonomy for assessing automated essay scoring system
No Thumbnail Available
Date
2021
Authors
Journal Title
Journal ISSN
Volume Title
Publisher
Institute of Electrical and Electronics Engineers Inc.
Open Access Color
OpenAIRE Downloads
OpenAIRE Views
Abstract
An automated essay scoring system (AES) is advantageous in evaluating student's learning outcomes since it gives them the chance to exhibit their knowledge. Most of the AES is using machine learning (ML) to enhance student's scores but did not consider the proper construction of the essay questions. This study aims to integrate the cognitive level of Blooms' taxonomy (BT) in constructing essay questions and compare the scores of the student. Identifying the most appropriate ML method in classifying essay exam questions (EEQ) based on BT that will be embedded in the Essay Question Generator (EQG). Using F1-Measure, the evaluation results show that the Support Vector Machine (SVM) (85.7%) outperforms Naïve Bayes (82.6%) and K-Nearest Neighbor (77.6%). Therefore, SVM together with the NLP techniques is applied to automatically extract essay questions from the given text for the teachers to select and apply. The EQG was evaluated using the scores of 375 students who answered two sets of essay exam questions using Bloom's Taxonomy (BT) and without Bloom's taxonomy (NBT). Using frequency distribution, the scores between two types were evaluated and the result shows that most students performed well in answering the essay exam using BT 5.6% of the students obtains a perfect score of 5.0 but nobody got 5.0 for NBT. In a conclusion, this study shows that the essay questions constructed according to BT cognitive level produce higher scores using EQG when compared to exam questions prepared by the teachers. © 2021 IEEE.
Description
Keywords
Blooms taxonomy, Machine learning, Natural language processing, Support vector machine
Turkish CoHE Thesis Center URL
Fields of Science
Citation
1
WoS Q
N/A
Scopus Q
N/A
Source
2021 2nd International Conference on Smart Computing and Electronic Enterprise: Ubiquitous, Adaptive, and Sustainable Computing Solutions for New Normal, ICSCEE 2021 -- 2nd International Conference on Smart Computing and Electronic Enterprise, ICSCEE 2021 -- 15 June 2021 through 16 June 2021 -- Virtual, Online -- 171212
Volume
Issue
Start Page
55
End Page
62