Online Learning Assessment and Online Proctoring: A review study
DOI:
https://doi.org/10.14712/23362189.2024.3971Keywords:
online proctoring, review study, online exams, online education, distance education, online assessmentAbstract
This study focuses on research on the use of online proctoring in online education and its impact on maintaining academic integrity. It presents the results of a content analysis of 36 open peer-reviewed studies from the Web of Science database that address proctoring. The analysis includes not only the benefits of proctoring, such as preventing cheating and enhancing the credibility of results, but also the challenges associated with this method. These challenges include concerns about student privacy and increasing levels of examinee anxiety during proctoring. The study also examines the technological and human factors that may affect the effectiveness of online proctoring. The results of the study highlight the need for a balanced approach to the use of this method and show that the evolution of technology and practices related to student privacy are key considerations for the future of online proctoring in online education. From the experiences described in the analysed studies, it can be recommended to use proctoring in those cases where it provides some advantage to students (e.g. when proving the transparency of an online exam to a future employer, etc.). The study opens the way for further research on this issue and highlights the need to pay attention to the legislative, technical and philosophical aspects of online proctoring. The expert article was written with the financial support of the Ministry of Education of the Czech Republic within the project of the National Renewal Plan for the Higher Education Sector for 2022-2024 in the specific objective: SC C2 Security of Distance Education.
References
Almutawa, A. M., & Sruthi, S. (2022). Students' perspective towards online proctoring in exams during COVID-19. Journal of Engineering Research, 10(4A).
Andersen, K., Thorsteinsson, S. E., Thorbergsson, H., & Gudmundsson, K. S. (2020). Adapting engineering examinations from paper to online. In 2020 IEEE Global Engineering Education Conference (EDUCON) (s. 1891-1895). IEEE.
https://doi.org/10.1109/EDUCON45650.2020.9125273
Andreou, V., Peters, S., Eggermont, J., Wens, J., & Schoenmakers, B. (2021). Remote versus on-site proctored exam: Comparing student results in a cross-sectional study. BMC Medical Education, 21(1), 1-9.
https://doi.org/10.1186/s12909-021-03068-x
PMid:34930231 PMCid:PMC8686350
Arnold, I. J. (2022). Online proctored assessment during COVID-19: Has cheating increased?. The Journal of Economic Education, 53(4), 277-295.
https://doi.org/10.1080/00220485.2022.2111384
Arnò, S., Galassi, A., Tommasi, M., Saggino, A., & Vittorini, P. (2021). State-of-the-art of commercial proctoring systems and their use in academic online exams. International Journal of Distance Education Technologies, 19(2), 55-76.
https://doi.org/10.4018/IJDET.20210401.oa3
Cerny, M., & Solcova, D. (2022). Proctoring as a journey to quality education? A critical review of the literature. Journal of Applied Technical and Educational Sciences, 12(4), 1-22.
Conijn, R., Kleingeld, A., Matzat, U., & Snijders, C. (2022). The fear of big brother: The potential negative side‐effects of proctored exams. Journal of Computer Assisted Learning, 38(6), 1521-1534.
https://doi.org/10.1111/jcal.12651
Daftary, M. N., Jorden, J., Habib, M., Pather, I., & Tofade, T. (2020). Implementing virtual experiences and remote assessments during the COVID-19 pandemic: A college experience: Innovation in experiential learning or assessment. Pharmacy Education, 20(2), 54-55.
https://doi.org/10.46542/pe.2020.202.5455
Dawson, P. (2020). Defending assessment security in a digital world: Preventing e-cheating and supporting academic integrity in higher education. Routledge.
https://doi.org/10.4324/9780429324178
Elsalem, L., Al-Azzam, N., Jum'ah, A. A., & Obeidat, N. (2021). Remote E-exams during Covid-19 pandemic: A cross-sectional study of students' preferences and academic dishonesty in faculties of medical sciences. Annals of Medicine and Surgery, 62, 326-333.
https://doi.org/10.1016/j.amsu.2021.01.054
PMid:33520225 PMCid:PMC7825891
Fawns, T., & Schaepkens, S. (2022). A matter of trust: Online proctored exams and the integration of technologies of assessment in medical education. Teaching and Learning in Medicine, 34(4), 444-453.
https://doi.org/10.1080/10401334.2022.2048832
PMid:35466830
Foster, D., & Layman, H. (2013). Online proctoring systems compared. (Online). Dostupné z https://caveon.com.
Halem, N. van, Klaveren, C., & Cornelisz, I. (2021). The effects of implementation barriers in virtually proctored examination: A randomised field experiment in Dutch higher education. Higher Education Quarterly, 75(2), 333-347.
https://doi.org/10.1111/hequ.12275
Hall, E. A., Roberts, M. B., Taylor, K. A., & Havrda, D. E. (2022). Changes in academic performance after transitioning to remote proctoring: A before-after evaluation. Pharmacy, 10(4), 92.
https://doi.org/10.3390/pharmacy10040092
PMid:36005932 PMCid:PMC9416767
Howard, D. (2020). Comparison of exam scores and time taken on exams between proctored on-campus and unproctored online students. Online Learning, 24(4).
Hussein, F., Al-Ahmad, A., El-Salhi, S., Alshdaifat, E., & Al-Hami, M. (2022). Advances in contextual action recognition: Automatic cheating detection using machine learning techniques. Data, 7(9), 122.
https://doi.org/10.3390/data7090122
Hylton, K., Levy, Y., & Dringus, L. P. (2016). Utilizing webcam-based proctoring to deter misconduct in online exams. Computers & Education, 92, 53-63.
https://doi.org/10.1016/j.compedu.2015.10.002
Chin, M. (2020). Exam anxiety: How remote test-proctoring is creeping students out. The Verge, 29.
Chirumamilla, A., Sindre, G., & Nguyen-Duc, A. (2020). Cheating in e-exams and paper exams: The perceptions of engineering students and teachers in Norway. Assessment & Evaluation in Higher Education, 45(7), 940-957.
https://doi.org/10.1080/02602938.2020.1719975
Johri, A., & Hingle, A. (2023). Students' technological ambivalence toward online proctoring and the need for responsible use of educational technologies. Journal of Engineering Education, 112(1), 221-242.
https://doi.org/10.1002/jee.20504
Kaddoura, S., Popescu, D. E., & Hemanth, J. D. (2022). A systematic review on machine learning models for online learning and examination systems. PeerJ Computer Science, 8, e986.
https://doi.org/10.7717/peerj-cs.986
PMid:35634115 PMCid:PMC9137850
Kharbat, F. F., & Abu Daabes, A. S. (2021). E-proctored exams during the COVID-19 pandemic: A close understanding. Education and Information Technologies, 26(6), 6589-6605.
https://doi.org/10.1007/s10639-021-10458-7
PMid:33613081 PMCid:PMC7884061
Lee, J. W. (2020). Impact of proctoring environments on student performance: Online vs offline proctored exams. Journal of Asian Finance Economics and Business, 7(8), 653-660.
https://doi.org/10.13106/jafeb.2020.vol7.no8.653
Lee, K., & Fanguy, M. (2022). Online exam proctoring technologies: Educational innovation or deterioration?. British Journal of Educational Technology, 53(3), 475-490.
https://doi.org/10.1111/bjet.13182
Li, H., Xu, M., Wang, Y., Wei, H., & Qu, H. (2021). A visual analytics approach to facilitate the proctoring of online exams. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (pp. 1-17).
https://doi.org/10.1145/3411764.3445294
Li, M., Luo, L., Sikdar, S., Nizam, N. I., Gao, S., Shan, H., ... & Wang, G. (2021). Optimized collusion prevention for online exams during social distancing. npj Science of Learning, 6(1), 5.
https://doi.org/10.1038/s41539-020-00083-3
PMid:33649355 PMCid:PMC7921656
Mareš, J. (2013). Přehledové studie: jejich typologie, funkce a způsob vytváření. Pedagogická orientace, 23(4), 427-454.
https://doi.org/10.5817/PedOr2013-4-427
Marín García, P. J., Arnau-Bonachera, A., & Llobat, L. (2021). Preferences and scores of different types of exams during COVID-19 pandemic in faculty of veterinary medicine in Spain: A cross-sectional study of paper and e-exams. Education Sciences, 11(8), 386.
https://doi.org/10.3390/educsci11080386
McKenna, S. (2022). Neoliberalism's conditioning effects on the university and the example of proctoring during COVID-19 and since. Journal of Critical Realism, 21(5), 502-515.
https://doi.org/10.1080/14767430.2022.2100612
McMahon, C., Yao, B., Yokota, J., & Garcia, D. (2022, February). Lessons learned from asynchronous online assessment formats in CS0 and CS3. In Proceedings of the 53rd ACM Technical Symposium on Computer Science Education-Volume 1 (s. 640-646).
https://doi.org/10.1145/3478431.3499386
Meulmeester, F. L., Dubois, E. A., Krommenhoek-van Es, C., de Jong, P. G., & Langers, A. M. (2021). Medical students' perspectives on online proctoring during remote digital progress test. Medical Science Educator, 31, 1773-1777.
https://doi.org/10.1007/s40670-021-01420-w
PMid:34611498 PMCid:PMC8483731
Morgan, K., Adams, E., Elsobky, T., Darr, A., & Brackbill, M. (2021). Moving assessment online: Experiences within a school of pharmacy. Online Learning, 25(1), 245-252.
https://doi.org/10.24059/olj.v25i1.2580
Muzaffar, A. W., Tahir, M., Anwar, M. W., Chaudry, Q., Mir, S. R., & Rasheed, Y. (2021). A systematic review of online exams solutions in e-learning: Techniques, tools, and global adoption. IEEE Access, 9, 32689-32712.
https://doi.org/10.1109/ACCESS.2021.3060192
Nigam, A., Pasricha, R., Singh, T., & Churi, P. (2021). A systematic review on AI-based proctoring systems: Past, present and future. Education and Information Technologies, 26(5), 6421-6445.
https://doi.org/10.1007/s10639-021-10597-x
PMid:34177348 PMCid:PMC8220875
Nurpeisova, A., Shaushenova, A., Mutalova, Z., Ongarbayeva, M., Niyazbekova, S., Bekenova, A., ... & Zhumasseitova, S. (2023). Research on the development of a proctoring system for conducting online exams in Kazakhstan. Computation, 11(6), 120.
https://doi.org/10.3390/computation11060120
O'Reilly, G., & Creagh, J. (2015). Does the shift to cloud delivery of courses compromise quality control. In Higher Education in Transformation Conference, Dublin, Ireland, 2015 (s. 417-424).
Patael, S., Shamir, J., Soffer, T., Livne, E., Fogel‐Grinvald, H., & Kishon‐Rabin, L. (2022). Remote proctoring: Lessons learned from the COVID‐19 pandemic effect on the large scale on‐line assessment at Tel Aviv University. Journal of Computer Assisted Learning, 38(6), 1554-1573.
https://doi.org/10.1111/jcal.12746
Pracovní skupina 5. (2024). Analýza konceptu pro realizaci distančního vzdělávání. Projekt Národní plán obnovy - C2 "Bezpečnost distančních forem výuky". Interní materiál.
Prakasha, G. S., Hemalathaa, K. Y., Tamizh, P., Bhavna, B., & Kenneth, A. (2021). Online test anxiety and exam performance of International Baccalaureate Diploma Programme students under e-proctored exams amid COVID-19. Problems of Education in the 21st Century, 79(6), 942.
https://doi.org/10.33225/pec/21.79.942
Prigoff, J., Hunter, M., & Nowygrod, R. (2021). Medical student assessment in the time of COVID-19. Journal of Surgical Education, 78(2), 370-374.
https://doi.org/10.1016/j.jsurg.2020.07.040
PMid:32819868 PMCid:PMC7392154
Purpura, J. E., Davoodifard, M., & Voss, E. (2021). Conversion to remote proctoring of the community English language program online placement exam at Teachers College, Columbia University. Language Assessment Quarterly, 18(1), 42-50.
https://doi.org/10.1080/15434303.2020.1867145
Saba, T., Rehman, A., Jamail, N. S. M., Marie-Sainte, S. L., Raza, M., & Sharif, M. (2021). Categorizing the students' activities for automated exam proctoring using proposed deep L2-GraftNet CNN network and ASO based feature selection approach. IEEE Access, 9, 47639-47656.
https://doi.org/10.1109/ACCESS.2021.3068223
Saucier, D. A., Schiffer, A. A., & Jones, T. L. (2022). "Exams by you": Having students write and complete their own exams during the COVID-19 pandemic. Teaching of Psychology, 00986283221097617.
https://doi.org/10.1177/00986283221097617
PMCid:PMC9082101
Selwyn, N., O'Neill, C., Smith, G., Andrejevic, M., & Gu, X. (2023). A necessary evil? The rise of online exam proctoring in Australian universities. Media International Australia, 186(1), 149-164.
https://doi.org/10.1177/1329878X211005862
Topuz, A. C., Saka, E., Fatsa, Ö. F., & Kurşun, E. (2022). Emerging trends of online assessment systems in the emergency remote teaching period. Smart Learning Environments, 9(1), 17.
https://doi.org/10.1186/s40561-022-00199-6
PMCid:PMC8960687
Yoder-Himes, D. R., Asif, A., Kinney, K., Brandt, T. J., Cecil, R. E., Himes, P. R., ... & Ross, E. (2022). Racial, skin tone, and sex disparities in automated proctoring software. Frontiers in Education, 7, 881449.
