Developing an alternative response format for the script concordance test

Lahner, Felicitas-Maria; Nouns, Zineb Miriam; Huwendiek, Sören (March 2015). Developing an alternative response format for the script concordance test. In: 4th Research in Medical Education (RIME) Symposium 2015 (DocRD22). Düsseldorf: German Medical Science GMS Publishing House 10.3205/15rime67

Introduction: Clinical reasoning is essential for the practice of medicine. In theory of development of medical expertise it is stated, that clinical reasoning starts from analytical processes namely the storage of isolated facts and the logical application of the ‘rules’ of diagnosis. Then the learners successively develop so called semantic networks and illness-scripts which finally are used in an intuitive non-analytic fashion [1], [2].

The script concordance test (SCT) is an example for assessing clinical reasoning [3]. However the aggregate scoring [3] of the SCT is recognized as problematic [4]. The SCT`s scoring leads to logical inconsistencies and is likely to reflect construct-irrelevant differences in examinees’ response styles [4]. Also the expert panel judgments might lead to an unintended error of measurement [4].

In this PhD project the following research questions will be addressed:

1.
How does a format look like to assess clinical reasoning (similar to the SCT but) with multiple true-false questions or other formats with unambiguous correct answers, and by this address the above mentioned pitfalls in traditional scoring of the SCT?
2.
How well does this format fulfill the Ottawa criteria for good assessment, with special regards to educational and catalytic effects [5]?

Methods:

1.
In a first study it shall be assessed whether designing a new format using multiple true-false items to assess clinical reasoning similar to the SCT-format is arguable in a theoretically and practically sound fashion. For this study focus groups or interviews with assessment experts and students will be undertaken.
2.
In an study using focus groups and psychometric data Norcini`s and colleagues Criteria for Good Assessment [5] shall be determined for the new format in a real assessment. Furthermore the scoring method for this new format shall be optimized using real and simulated data.

Interest & Impact

Downloads

0 since deposited on 14 Apr 2016
0 in the past 12 months

Citations

5 Citations in Web of Science ®
6 Citations in Scopus

Search

in Google Scholar™

Services

Actions (login required)

Edit item

Actions (login required)

Edit item