Investigating Engagement with In-Video Quiz Questions in a Programming Course
Full recordShow full item record
AbstractThis is the author accepted manuscript. The final version is available from IEEE via http://dx.doi.org/10.1109/TLT.2015.2444374
In-video quizzes are common in many distance learning platforms, including those from Coursera and EdX. However the effectiveness of in-video quizzes has not previously been assessed. In this paper we describe the construction and instrumentation of an Interactive Video Lecture Platform to measure student engagement with in-video quizzes. We also investigate the use of in-video quizzes as an approach to mitigate the lack of feedback available to students and lecturers in videos and traditional lectures. Finally, we evaluate the effectiveness of augmenting video with the ability to answer and receive feedback to quiz questions embedded directly within the video. We observed that student engagement with in-video questions was consistently high (71-86%) across two cohorts (N1=81, N2=84) with a rate of 1 question per 8.7 minutes of video. We identified three broad levels of engagement with the quiz questions and four motivations, including challenge seeking and completionism, which explain some of the observed behaviour. The results from this investigation demonstrate that in-video quizzes were successful in creating an engaging and interactive mode of content delivery. We recommend that in-video quizzes be used to increase the interactivity of video content as well as supporting formative assessment within a flipped classroom environment.
IEEE Transactions on Learning Technologies 2015. doi: 10.1109/TLT.2015.2444374