Measuring Engagement Effects of Educational Games and Virtual Manipulatives on Mathematics
Contributor(s)Learning Sciences and Technologies
Evans, Michael A.
Burton, John K.
Potter, Kenneth R.
Full recordShow full item record
AbstractEducational games have been demonstrated to increase engagement and engagement has been demonstrated to increase achievement. Therefore, the researcher attempted to investigate how to better measure engagement and refine the measurement of engagement in this study. To frame the engagement, three domains of engagement â behavioral, cognitive, and emotionalâ are analyzed in detail to be able to examine the qualities of each type. Moreover, three game attributes â clear goals, immediate feedback, and balance between challenges and skills- are presented and discussed as fundamental features of virtual manipulatives and educational games used in this study to make an impact on studentsâ engagement. To measure effects of educational games and virtual manipulatives on three domains of engagement, the researcher designed an engagement survey that examines each domain separately with their sub-domains. The Cronbachâ s alphas for engagement pre-test and post-test were found .89 and .91 respectively. In this pre-test and post-test quasi-experimental design, four fifth-grade classrooms (N=86) from four schools in southwest Virginia were assigned as three experimental groups and one control group. In the first experimental group, participants played an educational game called Candy Factory and in the second experimental group, the students played another educational game called Pearl Diver on iPod Touch for eight days consecutively, for 20 minutes each. In the third experimental group, participants performed activities with virtual manipulatives, whereas in the control group, participants did paper-and-pencil drills for the same duration. All of the groups studied on the same topic, fractions. After taking the engagement pre-test survey data into analysis as a covariate, the study examined the effect of the treatment on engagement post-test data by using analysis of covariance (ANCOVA). According to the results of ANCOVA, experimental group studentsâ engagement scores were found significantly higher than control group studentsâ , F(1,80)=11.568, p=.001. When three domains of engagement were analyzed, significant differences were found among all three domains between experimental and control groups. When the researcher conducted separate analysis for educational games group and virtual manipulatives group, students who played educational games were also found significantly different than control group students in terms of all three domains of engagement and general engagement, F(1, 58)= 8.883, p=.004. In addition to this, students who did activities with virtual manipulatives showed significantly higher engagement than students who did paper-and-pencil drills in control group, F(1, 46)= 7.967, p=.007. Statistical difference was found in emotional and cognitive engagement while the results showed no significant difference in behavioral engagement between virtual manipulatives and control group students. Therefore, all three research hypotheses were supported by the ANCOVA results. Results should be interpreted with caution because the findings apply only to a small portion of the population. The three game attributes were considered as the main determining factors to engage students more to the content. This dissertation contributes to the field by developing more refined measure of engagement and the engagement instrument was tested in the context of educational games and virtual manipulatives. Results showed that studentsâ engagement in three domains increases significantly when media are embedded with appropriate attributes.