Impact of familiarity with the format of the exam on performance in the OSCE of undergraduate medical students - an interventional study.

Neuwirt, Hannes; Eder, Iris E; Gauckler, Philipp; Horvath, Lena; Koeck, Stefan; Noflatscher, Maria; Schaefer, Benedikt; Simeon, Anja; Petzer, Verena; Prodinger, Wolfgang M; Berendonk, Christoph (2024). Impact of familiarity with the format of the exam on performance in the OSCE of undergraduate medical students - an interventional study. BMC medical education, 24(179) BioMed Central 10.1186/s12909-024-05091-0

[img]
Preview
Text
s12909-024-05091-0.pdf - Published Version
Available under License Creative Commons: Attribution (CC-BY).

Download (832kB) | Preview

BACKGROUND

Assessments, such as summative structured examinations, aim to verify whether students have acquired the necessary competencies. It is important to familiarize students with the examination format prior to the assessment to ensure that true competency is measured. However, it is unclear whether students can demonstrate their true potential or possibly perform less effectively due to the unfamiliar examination format. Hence, we questioned whether a 10-min active familiarization in the form of simulation improved medical students´ OSCE performance. Next, we wanted to elucidate whether the effect depends on whether the familiarization procedure is active or passive.

METHODS

We implemented an intervention consisting of a 10-min active simulation to prepare the students for the OSCE setting. We compared the impact of this intervention on performance to no intervention in 5th-year medical students (n = 1284) from 2018 until 2022. Recently, a passive lecture, in which the OSCE setting is explained without active participation of the students, was introduced as a comparator group. Students who participated in neither the intervention nor the passive lecture group formed the control group. The OSCE performance between the groups and the impact of gender was assessed using X2, nonparametric tests and regression analysis (total n = 362).

RESULTS

We found that active familiarization of students (n = 188) yields significantly better performance compared to the passive comparator (Cohen´s d = 0.857, p < 0.001, n = 52) and control group (Cohen´s d = 0.473, p < 0.001, n = 122). In multivariate regression analysis, active intervention remained the only significant variable with a 2.945-fold increase in the probability of passing the exam (p = 0.018).

CONCLUSIONS

A short 10-min active intervention to familiarize students with the OSCE setting significantly improved student performance. We suggest that curricula should include simulations on the exam setting in addition to courses that increase knowledge or skills to mitigate the negative effect of nonfamiliarity with the OSCE exam setting on the students.

Item Type:

Journal Article (Original Article)

Division/Institute:

04 Faculty of Medicine > Medical Education > Institute for Medical Education
04 Faculty of Medicine > Medical Education > Institute for Medical Education > Assessment and Evaluation Unit (AAE)

UniBE Contributor:

Berendonk, Christoph

Subjects:

300 Social sciences, sociology & anthropology > 370 Education
600 Technology > 610 Medicine & health

ISSN:

1472-6920

Publisher:

BioMed Central

Language:

English

Submitter:

Pubmed Import

Date Deposited:

04 Mar 2024 08:45

Last Modified:

17 Jun 2024 14:17

Publisher DOI:

10.1186/s12909-024-05091-0

PubMed ID:

38395807

Uncontrolled Keywords:

Active participation Elective course Familiarization Medical students OSCE Passive lecture Performance

BORIS DOI:

10.48350/193238

URI:

https://boris.unibe.ch/id/eprint/193238

Actions (login required)

Edit item Edit item
Provide Feedback