Use of Web-OSCE as an assessment method during the COVID-19 pandemic
DOI:
https://doi.org/10.33448/rsd-v10i12.20232Keywords:
Educational measurement; Medical education; Health education; COVID-19; Pandemics; Teaching.Abstract
Objective: to report the experience of Centro Universitário Christus regarding changes in the application of the Objective Structured Clinical Examination (OSCE) during COVID-19 pandemic. Methodology: experience report of faculty representatives. Results: During the emergency remote teaching (ERT) in COVID-19 pandemic, the assessment processes of the Knowledge, Skills and Attitudes module were adapted to Web-OSCE type assessments, performed synchronously, with students in their homes, using Google Meet®. The stations lasted for 5 minutes. On application day, students were confined to a Google Meet® room for initial orientation. Immediately afterwards, they were divided into virtual rooms with a room supervisor, and they were instructed to keep the camera and microphone connected. The standardized patient (PP) were actors, who were responsible for recording the station and presenting the command to the student on the screen and in the chat. After the student performed the task, the PP ended the recording, and the student left the room. The previously prepared feedback was made available in a short video at the end of the season. The assessment of the students stations performance was carried out by analyzing the recorded videos and filling out a checklist, asynchronously. Conclusion: The Web-OSCE proved to be a feasible method and it has potential for use in other scenarios, including assessment of teleconsultations. This method can be considered complementary and, together with other remote multiple-choice assessments, can estimate the cognitive gain of students during the ERT.
References
Alruwais, N., Wills, G., & Wald, M. (2018). Advantages and challenges of using e-assessment. International Journal of Information and Education Technology, 8(1), 34-37.
Brasil. (2020). Painel Coronavírus. Ministério da Saúde, Secretaria de Vigilância em Saúde, Brasília.
Ceará. (2020). Decreto nº 33.519 de 19 de março de 2020. Intensifica as medidas para o enfrentamento da infecção humana pelo novo coronavírus. Diário Oficial do Estado, 56, 1-2.
Fuller, R., Joynes, V., Cooper, J., Boursicot, K., & Roberts, T. (2020). Could COVID-19 be our ‘There is no alternative’ (TINA) opportunity to enhance assessment? Medical Teacher, 42(7),781-786.
Hodges, C., Moore, S., Lockee, B., Trust, T., & Bond, A. (2020). The difference between emergency remote teaching and online learning. Educause Review.
Hytönen, H., Näpänkangas, R., Karaharju-Suvanto, T., Eväsoja, T., Kallio, A., Kokkari, A., … Lahti, S. (2020). Modification of national OSCE due to COVID-19: Implementation and students' feedback. European Journal of Dental Education, 00, 1-10.
Jaap, A., Dewar, A., Duncan, C., Fairhurst, K., Hope, D., & Kluth, D. (2021). Effect of remote online exam delivery on student experience and performance in applied knowledge tests. BMC Medical Education, 21(1), 86.
Khamisa, K., Halman, S., Desjardins, I., Jean, M. S., & Pugh, D. (2018). The implementation and evaluation of an e-learning training module for objective structured clinical examination raters in Canada. Journal of Educational Evaluation for Health Professions, 15, 18.
Lima, M. M., Oliveira, A. M., de Araújo Freitas, A., Lima, C. S., Bernardes, C. T. V., Sugita, D.M., …Arruda, J. T. (2020). Estratégias avaliativas no ensino remoto: Avaliação terminal ou contínua? Anais do Seminário de Atualização de Práticas Docentes, 2(2), 126-132.
Looi, J. C. L., Maguire, P., Bonner, D., Reay, R. E., Finlay, A. J. F., Keightley, P., … Kramer, D. (2021). Conduct and evaluation of final-year medical student summative assessments in psychiatry and addiction medicine during COVID-19: An Australian University Medical School experience. Australasian Psychiatry: Bulletin of Royal Australian and New Zealand College of Psychiatrists, 00, 1-5.
Lörwald, A. C., Lahner, F-M., Nouns, Z. M., Berendonk, C., Norcini, J., Greif, R., & Huwendiek, S. (2018). The educational impact of Mini-Clinical Evaluation Exercise (Mini-CEX) and Direct Observation of Procedural Skills (DOPS) and its association with implementation: A systematic review and meta-analysis. PloS one, 13(6), e0198009.
Major, S., Sawan, L., Vognsen, J., & Jabre, M. (2020). COVID-19 pandemic prompts the development of a Web-OSCE using Zoom teleconferencing to resume medical students’ clinical skills training at Weill Cornell Medicine-Qatar. BMJ Simulation & Technology Enhanced Learning, 0, 1-2.
Majumder, M. A. A., Kumar, A., Krishnamurthy, K., Ojeh, N., Adams, O. P., & Sa, B. (2019). An evaluative study of objective structured clinical examination (OSCE): students and examiners perspectives. Advances in Medical Education and Practice, 10, 387-397.
Martinho, F. C., & Griffin, I. L. (2020). OSCE online teaching in predoctoral endodontics. Journal of Dental Education, 10.1002/jdd.12418. Advance online publication.
Miao, J. H. (2021). Adapting medical education initiatives through team-based e-learning, telemedicine objective structured clinical exams, and student-led community outreach during the COVID-19 pandemic. JMIR Medical Education, 7(2), e26797.
Novack, D. H., Cohen, D., Peitzman, S. J., Beadenkopf, S., Gracely, E., & Morris, J. (2002). A pilot test of WebOSCE: A system for assessing trainees' clinical skills via teleconference. Medical Teacher, 24(5), 483-487.
Palmer, R. T., Biagioli, F. E., Mujcic, J., Schneider, B. N., Spires, L., & Dodson, L. G. (2015). The feasibility and acceptability of administering a telemedicine objective structured clinical exam as a solution for providing equivalent education to remote and rural learners. Rural and Remote Health, 15(4), 3399.
Santos, S., Freire, C., Barbosa, I., Figueiredo, H., & Costa, M. J. (2020). Assessing transversal competencies for the future of graduate work: An adaptation of the multiple mini-interviews method. Proceedings of ICERI2020 Conference, 4112-4122.
Said, J. T., & Schwartz, A. W. (2021). Remote medical education: Adapting kern's curriculum design to tele-teaching. Medical Science Educator, 31, 805-812.
World Health Organization [WHO]. 2021. Weekly Operational Update on COVID-19, 55, 1-5.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2021 Francisco Theogenes Macêdo Silva; Clarisse Mourão Melo Ponte; Sarah Musy Leitão; Ricardo Eustáquio Magalhães; Anne Carolinne Bezerra Perdigão; Lívia Mendes de Almeida; Rodrigo de Freitas Guimarães Lobato; Arnaldo Aires Peixoto Junior
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
1) Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
2) Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
3) Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work.
