Displaying 1 - 3 of 3
"The Devereux Student Strengths Assessment Mini" (DESSA-Mini) (LeBuffe, Shapiro, & Naglieri, 2014) efficiently monitors the growth of Social-Emotional Competence (SEC) in the routine implementation of Social Emotional Learning programs. The DESSA-Mini is used to assess approximately half a million children around the world. Since behavior rating scales can have "rater bias", this paper examines rater characteristics that contribute to DESSA-Mini ratings. Rater characteristics and DESSA-Mini ratings were collected from elementary school classroom teachers (n = 72) implementing TOOLBOX in a racially/ethnically diverse California school district. Teachers rated 1,676 students, who scored similarly to a national reference group. Multilevel modeling analysis showed that only 16% of variance in DESSA-mini ratings was attributable to raters. Relationships between teacher characteristics and ratings were estimated to examine rater variance. Collectively, four characteristics of teachers (perceived barriers to student learning, sense of their "typical" student's level of SEC, anticipation of SEL program implementation challenges, and intentions to fully implement a newly adopted SEL program) accounted for bias in teacher-generated DESSA scores, leaving only 10% of the variance unexplained. Identified sources of "rater bias" can be controlled for in research and addressed through thoughtful program selection, training, and implementation.
The Devereux Student Strengths Assessment Mini (DESSA-Mini; Naglieri, LeBuffe, & Shapiro, 2011/2014) was designed to overcome practical obstacles to universal prevention screening. This article seeks to determine whether an entirely strength-based, 8-item screening instrument achieves technical accuracy in routine practice. Data come from a district-wide implementation of a new social emotional learning (SEL) initiative designed to promote students' social-emotional competence. All students, kindergarten through Grade 8, were screened using the DESSA-Mini. A random 5 students per classroom received additional assessment. Concurrent and predictive criterion studies were conducted using the full DESSA as well as administrative records of serious disciplinary infraction. The DESSA-Mini showed excellent internal reliability, exceeding .90. Negligible to small differences were found between scores on the DESSA-Mini screen and the DESSA full assessment. Classification consistency between the DESSA-Mini and the DESSA was high (87%-94%) in routine practice, with sensitivity and specificity estimates exceeding Glascoe's (2005) standards. Finally, predictive validity of the DESSA-Mini was reliable; students screened as having a Need for SEL Instruction at the beginning of the year were 4.5 times more likely to have a record of serious disciplinary infraction at the end of the school year compared with those who were not identified (p < .001). These findings compare quite favorably with other instruments used in schools to screen entire student populations, in cases where such analyses have been conducted, and is consistent with a practice preference of identifying, but not overidentifying, students for accelerated preventative interventions for mental, emotional, and behavioral problems. (PsycINFO Database Record
The Devereux Student Strengths Assessment Mini (DESSA-Mini; Naglieri, LeBuffe, & Shapiro, 2011/2014) was designed to overcome practical obstacles to universal prevention screening. This article seeks to determine whether an entirely strength-based, 8-item screening instrument achieves technical accuracy in routine practice. Data come from a district-wide implementation of a new social emotional learning (SEL) initiative designed to promote students' social-emotional competence. All students, kindergarten through Grade 8, were screened using the DESSA-Mini. A random 5 students per classroom received additional assessment. Concurrent and predictive criterion studies were conducted using the full DESSA as well as administrative records of serious disciplinary infraction. The DESSA-Mini showed excellent internal reliability, exceeding .90. Negligible to small differences were found between scores on the DESSA-Mini screen and the DESSA full assessment. Classification consistency between the DESSA-Mini and the DESSA was high (87%-94%) in routine practice, with sensitivity and specificity estimates exceeding Glascoe's (2005) standards. Finally, predictive validity of the DESSA-Mini was reliable; students screened as having a Need for SEL Instruction at the beginning of the year were 4.5 times more likely to have a record of serious disciplinary infraction at the end of the school year compared with those who were not identified (p < .001). These findings compare quite favorably with other instruments used in schools to screen entire student populations, in cases where such analyses have been conducted, and is consistent with a practice preference of identifying, but not overidentifying, students for accelerated preventative interventions for mental, emotional, and behavioral problems. (PsycINFO Database Record