Winkes, Julia; Schaller, Pascale (2022). Generalizability of Written Expression Curriculum-Based-Measurement in the German Language: What Are the Major Sources of Variability? frontiers in Education, Educational Psychology, 7 (7), pp. 1-13. 10.3389/feduc.2022.919756
Text
feduc-07-919756.pdf - Published Version Available under License Creative Commons: Attribution (CC-BY). Download (327kB) |
This study aimed to identify the sources of measurement error that contribute to the intraindividual variability of written expression curriculum-based measurement (CBM-W) and assess how many German writing samples of 3 or 5 min duration are necessary to make sufficiently reliable relative and absolute decisions. Students in grade 3 (N = 128) and grade 6 (N = 118) wrote five CBM-W probes of 5 min each within 1 week, which were scored for commonly used metrics (i.e., words written, correct writing sequences). Analyses within the generalizability theory framework showed that between-student differences accounted for 36–60% of the variance. The student × writing prompt interaction was the largest source of variability, particularly among younger students (44%), while writing prompt per se and writing time explained no variance. Two to four writing samples of 3 min are sufficient for most scoring methods to achieve relative reliability >0.80. CBM-W in German proved inadequate for the grade levels studied for absolute decisions. These findings imply that CBM-W in this form in German-speaking primary grades is suitable as a universal screening tool but not as a tool for progress monitoring of individual students.
Item Type: |
Journal Article (Original Article) |
---|---|
PHBern Contributor: |
Winkes, Julia, Schaller, Pascale |
Language: |
English |
Submitter: |
Jessica Brunner |
Date Deposited: |
13 Feb 2023 10:54 |
Last Modified: |
27 Apr 2023 14:59 |
Publisher DOI: |
10.3389/feduc.2022.919756 |
Uncontrolled Keywords: |
curriculum-based measurement (CBM), writing, generalizability theory, reliability, variability |
PHBern DOI: |
10.57694/6713 |
URI: |
https://phrepo.phbern.ch/id/eprint/6713 |