From version < 16.1 >
edited by Eric deRuijter
on 2021/11/18 16:57
To version < 15.1 >
edited by Eric deRuijter
on 2021/11/18 16:57
< >
Change comment: There is no comment for this version

Summary

Details

Page properties
Content
... ... @@ -18,6 +18,7 @@
18 18  
19 19  (% style="color:inherit; font-family:inherit; font-size:23px" %)Reliability
20 20  
21 +
21 21  Reliability and evaluation objectivity are special challenges in post box exercises. A meta-analysis based on 16 individual studies showed an interrater reliability of .76 (Whetzel et al. 2014). The assessment of different raters are therefore "good" or "substantial".
22 22  Since chance hits can distort the assessment results, a sufficient number of tasks should be set. Standardization can further increase reliability. In the scenario, an order and a time window for processing should be defined.
23 23