- Home
- Articles
- Reviews
- About
- Archives
- Past Issues
- The eLearn Blog
Archives
To leave a comment you must sign in. Please log in or create an ACM Account. Forgot your username or password? |
Create an ACM Account |
While use of videos in online and remote courses has exploded since YouTube launched in 2006 [1], viewers tend to disengage or stop watching after 10–12 minutes [2]. Therefore, long videos need to include interactivity, transitions, or segmentations [3]. Tools like Panopto have made this easy for faculty members in the context of higher education.
Panopto is a screen and lecture capture tool that works well with presentation software like PowerPoint. It also offers automatically created “Smart Chapters” for segmentation, and includes an in-video quiz feature, for which faculty members often use interactive knowledge checks. There is no shortage of quizzing tools in the world, but displaying a quiz directly in the video is different from most. In-video quizzes are known to be effective at keeping students watching and helping the lecture content stick in their memory [4].
Behaviorists assume the learning happens through a stimulus-response process, and Cummins et al. stated one of the biggest learning benefits of having an in-video quiz is providing an opportunity for students to receive immediate feedback on correct and incorrect responses [5]. “Immediate” is a key word here. If one creates a knowledge check in an LMS quizzing tool, for example, students would likely finish watching the video, navigate to the quiz and make several mouse clicks to launch it, then have to think back to relevant parts of the video, and complete all of the questions in the quiz before receiving any feedback. In-video quizzes allow instructors to do knowledge checks and give feedback at the point and time of highest relevance.
Other studies have shown out of Moore’s three types of interaction [6], student-content interaction most significantly predicts a student’s retention and perceived learning effectiveness [7, 8], and in-video quizzes change the viewing of pre-recorded lectures from a passive to an active process. Some results indicated those who solved in-video quizzes constantly stayed engaged with the content with a rate of one question per 8.7 minutes of video [9], skipped around the video [10], and watched longer [11].
Research indicates there are four underlying motivations in completing the in-video quizzes [5]:
Keeping this in mind, to maximize the effectiveness of your in-video quizzes, consider the following recommendations.
First, allow learners to access the video navigational controls. Jumping back to an earlier point in the video contributes to in-video retention. As such, encouraging non-linear navigation is particularly important for learners to complete the video and in-video quizzes.
Second, chunk videos into a manageable length and put the quizzes at the end of each segment. This helps to achieve optimal cognitive load, as a recent experiment on segmented videos showed [12]. Viewers were able to retain the presented content and then solve a newly presented problem. Panopto automatically creates chapters, but if your videos are longer than the aforementioned 12 minutes, you may see learners “dropping out” of the video.
Third, we really recommended providing answer feedback. The nature of asynchrony makes it difficult for teachers to offer useful feedback for all students. And while literature pertaining to the effects of feedback on in-video quizzes is scant, the topic of feedback has been widely studied. Without a doubt, feedback plays an integral part in any learning situation, and for low stakes knowledge-checking questions, feedback is a particularly powerful tool [13]. In a physiology course, researchers investigated the impact of quizzes containing feedback. The vast majority of students perceived the online quizzes as a useful learning tool, and there was a correlation between quiz performance and the end-of-semester grade [14].
Quiz feedback should follow these guidelines:
Finally, you may consider making some quizzes ungraded. One study of an introductory psychology course found when it came to final exam grades, students taking ungraded quizzes outperformed students taking a graded form of the quizzes (and students taking no quizzes at all) [16]. In addition, the students taking the ungraded quizzes reported positive feelings about the quizzes. In another study of six undergraduate psychology classes all taught by the same professor, students performed significantly better on exams when they used ungraded quizzes rather than graded quizzes and correct answers to the quizzes were included [17].
Bear in mind that in-video quizzes are an assessment for learning, not an assessment of learning. It is best to use them as knowledge checks that increase learner engagement, rather than as a gatekeeper tool that offers questions so challenging, learners are prevented from moving on.
With a high number of in-video dropouts, it is imperative to help learners stay engaged with your content. When implemented carefully and strategically, Panopto’s in-video quizzes have proven to be an effective way of doing this. Looking forward, we expect to see research on how to maximize engagement for learners with different motivations (e.g., extrinsic versus intrinsic).
"The opinions and assertions expressed herein are those of the author(s) and do not necessarily reflect the official policy or position of the Uniformed Services University or the Department of Defense."
[1] Snelson, C. YouTube across the disciplines: A review of the literature. MERLOT Journal of Online Learning and Teaching 7, 1 (2011).
[2] Kim, J., Guo, P., Seaton, D., Mitros, P., Gajos, K., and Miller, R. Understanding in-video dropouts and interaction peaks in online lecture videos. In Proceedings of the First ACM conference on Learning@ Scale Conference. ACM, New York, 2014, 31–40.
[3] Dong, C. and Goh, P. Twelve tips for the effective use of videos in medical education. Medical Teacher 37, 2 (2015), 140–145.
[4] Kovacs, G. Effects of in-video quizzes on MOOC lecture viewing. In Proceedings of the Third (2016) ACM conference on Learning@ Scale. ACM, New York, 2016, 31–40.
[5] Cummins, S., Beresford, A., and Rice, A. Investigating engagement with in-video quiz questions in a programming course. IEEE Transactions on Learning Technologies 9, 1 (2015), 57–66.
[6] Moore, M. G. Three types of interaction. American Journal of Distance Education 3, 2 (1989).
[7] Hone, K. and El Said, G. Exploring the factors affecting MOOC retention: A survey study. Computers & Education 98, (2016), 157–168.
[8] Peltier, J., Drago, W., and Schibrowsky, J. Virtual communities and the assessment of online marketing education. Journal of Marketing Education 25, 3 (2003), 260–276.
[9] Cummins, S., Beresford, A., and Rice, A. Investigating engagement with in-video quiz questions in a programming course. IEEE Transactions on Learning Technologies 9, 1 (2015), 57–66.
[10] Guo, P. and Reinecke, K. Demographic differences in how students navigate through MOOCs. In Proceedings of the first ACM Conference on Learning@ Scale Conference (2014), 21–30.
[11] Guo, P., Kim, J., and Rubin, R. How video production affects student engagement: An empirical study of MOOC videos. In Proceedings of the First ACM Conference on Learning@ Scale Conference. ACM, New York, 2014, 41–50.
[12] Zheng, H., Jung, E., Li, T., and Yoon, M. Effects of segmentation and self-explanation designs on cognitive load in instructional videos. Contemporary Educational Technology 14, 2 (2022), ep347.
[13] Morris, R., Perry, T., and Wardle, L. Formative assessment and feedback for learning in higher education: A systematic review. Review of Education 9, 3 (2021), e3292.
[14] Marden, N., Ulman, L., Wilson, F., and Velan, G. Online feedback assessments in physiology: Effects on students’ learning experiences and outcomes. Advances in Physiology Education 37, 2 (2013), 192–200.
[15] Haladyna, T., Downing, S., and Rodriguez, M. A review of multiple-choice item-writing guidelines for classroom assessment. Applied Measurement in Education 15, 3 (2002), 309–333.
[16] Khanna, M. Ungraded pop quizzes: Test-enhanced learning without all the anxiety. Teaching of Psychology 42, 2 (2015), 174–178.
[17] Wickline, V. and Spektor, V. Practice (rather than graded) quizzes, with answers, may increase introductory psychology exam performance. Teaching of Psychology 38, 2 (2011), 98–101.
Dr. Eulho Jung has earned a doctorate in instructional systems technology from Indiana University Bloomington. He is currently serving as an assistant professor at the School of Medicine, Uniformed Services University of the Health Sciences (USUHS), a military medical school. His research interests revolve around intersecting expertise development and instructional systems design with the goals of realizing personalized learning.
Greg Snow is an instructional design consultant and doctoral student at Boise State University???s eCampus Center. He specializes in online teaching and course design.
Copyright © ACM 2022
1535-394X/2023/04-3576928 $15.00 https://doi.org/10.1145/3576928
To leave a comment you must sign in. |
Create an ACM Account. |
Tue, 08 Aug 2023
you are very creative person. https://quiclekha.com/Post by johir