Proctoring v distančním vzdělávání: od provizorních k trvalým řešením
DOI:
https://doi.org/10.14712/23362189.2024.3971Klíčová slova:
online proctoring, přehledová studie, online zkoušky, online vzdělávání, distanční vzdělávání, online hodnoceníAbstrakt
Tato studie se zaměřuje na výzkum využití proctoringu v online vzdělávání a na výzkum jeho vlivu na udržení akademické integrity. Online proctoring (nebo také online dozorování) je metoda využívaná při distančním vzdělávání, která umožňuje monitorování studentů během online testů nebo zkoušek. Studie přináší výsledky obsahové analýzy 36 otevřených odborných studií z databáze Web of Science, které se proctoringu věnují. Analýza zahrnuje nejen výhody proctoringu, jako je prevence podvádění a posílení důvěryhodnosti výsledků, ale také výzvy spojené s touto metodou. Mezi tyto výzvy patří obavy o soukromí studentů a zvyšující se míra úzkosti zkoušených v průběhu proctorovaných zkoušek. Studie zkoumá také technologické a lidské faktory, které mohou ovlivnit efektivitu online proctoringu. Výsledky studie upozorňují na potřebu vyváženého přístupu k použití této metody a ukazují, že vývoj technologií a postupy týkající se soukromí studentů jsou klíčovými aspekty pro budoucnost proctoringu v online vzdělávání. Ze zkušeností popisovaných v analyzovaných studiích lze doporučit využít proctoring v těch případech, kdy poskytuje studentům určitou výhodu (např. při dokladování transparentnosti online zkoušky vůči budoucímu zaměstnavateli). Studie otevírá cestu pro další zkoumání této problematiky a zdůrazňuje potřebu věnovat pozornost legislativním, technickým a filozofickým aspektům online proctoringu.
Reference
Almutawa, A. M., & Sruthi, S. (2022). Students' perspective towards online proctoring in exams during COVID-19. Journal of Engineering Research, 10(4A).
Andersen, K., Thorsteinsson, S. E., Thorbergsson, H., & Gudmundsson, K. S. (2020). Adapting engineering examinations from paper to online. In 2020 IEEE Global Engineering Education Conference (EDUCON) (s. 1891-1895). IEEE.
https://doi.org/10.1109/EDUCON45650.2020.9125273
Andreou, V., Peters, S., Eggermont, J., Wens, J., & Schoenmakers, B. (2021). Remote versus on-site proctored exam: Comparing student results in a cross-sectional study. BMC Medical Education, 21(1), 1-9.
https://doi.org/10.1186/s12909-021-03068-x
PMid:34930231 PMCid:PMC8686350
Arnold, I. J. (2022). Online proctored assessment during COVID-19: Has cheating increased?. The Journal of Economic Education, 53(4), 277-295.
https://doi.org/10.1080/00220485.2022.2111384
Arnò, S., Galassi, A., Tommasi, M., Saggino, A., & Vittorini, P. (2021). State-of-the-art of commercial proctoring systems and their use in academic online exams. International Journal of Distance Education Technologies, 19(2), 55-76.
https://doi.org/10.4018/IJDET.20210401.oa3
Cerny, M., & Solcova, D. (2022). Proctoring as a journey to quality education? A critical review of the literature. Journal of Applied Technical and Educational Sciences, 12(4), 1-22.
Conijn, R., Kleingeld, A., Matzat, U., & Snijders, C. (2022). The fear of big brother: The potential negative side‐effects of proctored exams. Journal of Computer Assisted Learning, 38(6), 1521-1534.
https://doi.org/10.1111/jcal.12651
Daftary, M. N., Jorden, J., Habib, M., Pather, I., & Tofade, T. (2020). Implementing virtual experiences and remote assessments during the COVID-19 pandemic: A college experience: Innovation in experiential learning or assessment. Pharmacy Education, 20(2), 54-55.
https://doi.org/10.46542/pe.2020.202.5455
Dawson, P. (2020). Defending assessment security in a digital world: Preventing e-cheating and supporting academic integrity in higher education. Routledge.
https://doi.org/10.4324/9780429324178
Elsalem, L., Al-Azzam, N., Jum'ah, A. A., & Obeidat, N. (2021). Remote E-exams during Covid-19 pandemic: A cross-sectional study of students' preferences and academic dishonesty in faculties of medical sciences. Annals of Medicine and Surgery, 62, 326-333.
https://doi.org/10.1016/j.amsu.2021.01.054
PMid:33520225 PMCid:PMC7825891
Fawns, T., & Schaepkens, S. (2022). A matter of trust: Online proctored exams and the integration of technologies of assessment in medical education. Teaching and Learning in Medicine, 34(4), 444-453.
https://doi.org/10.1080/10401334.2022.2048832
PMid:35466830
Foster, D., & Layman, H. (2013). Online proctoring systems compared. (Online). Dostupné z https://caveon.com.
Halem, N. van, Klaveren, C., & Cornelisz, I. (2021). The effects of implementation barriers in virtually proctored examination: A randomised field experiment in Dutch higher education. Higher Education Quarterly, 75(2), 333-347.
https://doi.org/10.1111/hequ.12275
Hall, E. A., Roberts, M. B., Taylor, K. A., & Havrda, D. E. (2022). Changes in academic performance after transitioning to remote proctoring: A before-after evaluation. Pharmacy, 10(4), 92.
https://doi.org/10.3390/pharmacy10040092
PMid:36005932 PMCid:PMC9416767
Howard, D. (2020). Comparison of exam scores and time taken on exams between proctored on-campus and unproctored online students. Online Learning, 24(4).
Hussein, F., Al-Ahmad, A., El-Salhi, S., Alshdaifat, E., & Al-Hami, M. (2022). Advances in contextual action recognition: Automatic cheating detection using machine learning techniques. Data, 7(9), 122.
https://doi.org/10.3390/data7090122
Hylton, K., Levy, Y., & Dringus, L. P. (2016). Utilizing webcam-based proctoring to deter misconduct in online exams. Computers & Education, 92, 53-63.
https://doi.org/10.1016/j.compedu.2015.10.002
Chin, M. (2020). Exam anxiety: How remote test-proctoring is creeping students out. The Verge, 29.
Chirumamilla, A., Sindre, G., & Nguyen-Duc, A. (2020). Cheating in e-exams and paper exams: The perceptions of engineering students and teachers in Norway. Assessment & Evaluation in Higher Education, 45(7), 940-957.
https://doi.org/10.1080/02602938.2020.1719975
Johri, A., & Hingle, A. (2023). Students' technological ambivalence toward online proctoring and the need for responsible use of educational technologies. Journal of Engineering Education, 112(1), 221-242.
https://doi.org/10.1002/jee.20504
Kaddoura, S., Popescu, D. E., & Hemanth, J. D. (2022). A systematic review on machine learning models for online learning and examination systems. PeerJ Computer Science, 8, e986.
https://doi.org/10.7717/peerj-cs.986
PMid:35634115 PMCid:PMC9137850
Kharbat, F. F., & Abu Daabes, A. S. (2021). E-proctored exams during the COVID-19 pandemic: A close understanding. Education and Information Technologies, 26(6), 6589-6605.
https://doi.org/10.1007/s10639-021-10458-7
PMid:33613081 PMCid:PMC7884061
Lee, J. W. (2020). Impact of proctoring environments on student performance: Online vs offline proctored exams. Journal of Asian Finance Economics and Business, 7(8), 653-660.
https://doi.org/10.13106/jafeb.2020.vol7.no8.653
Lee, K., & Fanguy, M. (2022). Online exam proctoring technologies: Educational innovation or deterioration?. British Journal of Educational Technology, 53(3), 475-490.
https://doi.org/10.1111/bjet.13182
Li, H., Xu, M., Wang, Y., Wei, H., & Qu, H. (2021). A visual analytics approach to facilitate the proctoring of online exams. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (pp. 1-17).
https://doi.org/10.1145/3411764.3445294
Li, M., Luo, L., Sikdar, S., Nizam, N. I., Gao, S., Shan, H., ... & Wang, G. (2021). Optimized collusion prevention for online exams during social distancing. npj Science of Learning, 6(1), 5.
https://doi.org/10.1038/s41539-020-00083-3
PMid:33649355 PMCid:PMC7921656
Mareš, J. (2013). Přehledové studie: jejich typologie, funkce a způsob vytváření. Pedagogická orientace, 23(4), 427-454.
https://doi.org/10.5817/PedOr2013-4-427
Marín García, P. J., Arnau-Bonachera, A., & Llobat, L. (2021). Preferences and scores of different types of exams during COVID-19 pandemic in faculty of veterinary medicine in Spain: A cross-sectional study of paper and e-exams. Education Sciences, 11(8), 386.
https://doi.org/10.3390/educsci11080386
McKenna, S. (2022). Neoliberalism's conditioning effects on the university and the example of proctoring during COVID-19 and since. Journal of Critical Realism, 21(5), 502-515.
https://doi.org/10.1080/14767430.2022.2100612
McMahon, C., Yao, B., Yokota, J., & Garcia, D. (2022, February). Lessons learned from asynchronous online assessment formats in CS0 and CS3. In Proceedings of the 53rd ACM Technical Symposium on Computer Science Education-Volume 1 (s. 640-646).
https://doi.org/10.1145/3478431.3499386
Meulmeester, F. L., Dubois, E. A., Krommenhoek-van Es, C., de Jong, P. G., & Langers, A. M. (2021). Medical students' perspectives on online proctoring during remote digital progress test. Medical Science Educator, 31, 1773-1777.
https://doi.org/10.1007/s40670-021-01420-w
PMid:34611498 PMCid:PMC8483731
Morgan, K., Adams, E., Elsobky, T., Darr, A., & Brackbill, M. (2021). Moving assessment online: Experiences within a school of pharmacy. Online Learning, 25(1), 245-252.
https://doi.org/10.24059/olj.v25i1.2580
Muzaffar, A. W., Tahir, M., Anwar, M. W., Chaudry, Q., Mir, S. R., & Rasheed, Y. (2021). A systematic review of online exams solutions in e-learning: Techniques, tools, and global adoption. IEEE Access, 9, 32689-32712.
https://doi.org/10.1109/ACCESS.2021.3060192
Nigam, A., Pasricha, R., Singh, T., & Churi, P. (2021). A systematic review on AI-based proctoring systems: Past, present and future. Education and Information Technologies, 26(5), 6421-6445.
https://doi.org/10.1007/s10639-021-10597-x
PMid:34177348 PMCid:PMC8220875
Nurpeisova, A., Shaushenova, A., Mutalova, Z., Ongarbayeva, M., Niyazbekova, S., Bekenova, A., ... & Zhumasseitova, S. (2023). Research on the development of a proctoring system for conducting online exams in Kazakhstan. Computation, 11(6), 120.
https://doi.org/10.3390/computation11060120
O'Reilly, G., & Creagh, J. (2015). Does the shift to cloud delivery of courses compromise quality control. In Higher Education in Transformation Conference, Dublin, Ireland, 2015 (s. 417-424).
Patael, S., Shamir, J., Soffer, T., Livne, E., Fogel‐Grinvald, H., & Kishon‐Rabin, L. (2022). Remote proctoring: Lessons learned from the COVID‐19 pandemic effect on the large scale on‐line assessment at Tel Aviv University. Journal of Computer Assisted Learning, 38(6), 1554-1573.
https://doi.org/10.1111/jcal.12746
Pracovní skupina 5. (2024). Analýza konceptu pro realizaci distančního vzdělávání. Projekt Národní plán obnovy - C2 "Bezpečnost distančních forem výuky". Interní materiál.
Prakasha, G. S., Hemalathaa, K. Y., Tamizh, P., Bhavna, B., & Kenneth, A. (2021). Online test anxiety and exam performance of International Baccalaureate Diploma Programme students under e-proctored exams amid COVID-19. Problems of Education in the 21st Century, 79(6), 942.
https://doi.org/10.33225/pec/21.79.942
Prigoff, J., Hunter, M., & Nowygrod, R. (2021). Medical student assessment in the time of COVID-19. Journal of Surgical Education, 78(2), 370-374.
https://doi.org/10.1016/j.jsurg.2020.07.040
PMid:32819868 PMCid:PMC7392154
Purpura, J. E., Davoodifard, M., & Voss, E. (2021). Conversion to remote proctoring of the community English language program online placement exam at Teachers College, Columbia University. Language Assessment Quarterly, 18(1), 42-50.
https://doi.org/10.1080/15434303.2020.1867145
Saba, T., Rehman, A., Jamail, N. S. M., Marie-Sainte, S. L., Raza, M., & Sharif, M. (2021). Categorizing the students' activities for automated exam proctoring using proposed deep L2-GraftNet CNN network and ASO based feature selection approach. IEEE Access, 9, 47639-47656.
https://doi.org/10.1109/ACCESS.2021.3068223
Saucier, D. A., Schiffer, A. A., & Jones, T. L. (2022). "Exams by you": Having students write and complete their own exams during the COVID-19 pandemic. Teaching of Psychology, 00986283221097617.
https://doi.org/10.1177/00986283221097617
PMCid:PMC9082101
Selwyn, N., O'Neill, C., Smith, G., Andrejevic, M., & Gu, X. (2023). A necessary evil? The rise of online exam proctoring in Australian universities. Media International Australia, 186(1), 149-164.
https://doi.org/10.1177/1329878X211005862
Topuz, A. C., Saka, E., Fatsa, Ö. F., & Kurşun, E. (2022). Emerging trends of online assessment systems in the emergency remote teaching period. Smart Learning Environments, 9(1), 17.
https://doi.org/10.1186/s40561-022-00199-6
PMCid:PMC8960687
Yoder-Himes, D. R., Asif, A., Kinney, K., Brandt, T. J., Cecil, R. E., Himes, P. R., ... & Ross, E. (2022). Racial, skin tone, and sex disparities in automated proctoring software. Frontiers in Education, 7, 881449.