Journal article
Development and validation of the Intervention Skills Profile - Skills: A brief measure of student social-emotional and academic enabling skills
Journal of school psychology, Vol.83, pp.66-88
12/01/2020
DOI: 10.1016/j.jsp.2020.10.001
PMID: 33276856
Abstract
The purpose of this study was to support the development and initial validation of the Intervention Selection Profile (ISP)-Skills, a brief 14-item teacher rating scale intended to inform the selection and delivery of instructional interventions at Tier 2. Teacher participants (n = 196) rated five students from their classroom across four measures (total student n = 877). These measures included the ISP-Skills and three criterion tools: Social Skills Improvement System (SSIS), Devereux Student Strengths Assessment (DESSA), and Academic Competence Evaluation Scales (ACES). Diagnostic classification modeling (DCM) suggested an expert-created Q-matrix, which specified relations between ISP-Skills items and hypothesized latent attributes, provided good fit to item data. DCM also indicated ISP-Skills items functioned as intended, with the magnitude of item ratings corresponding to the model-implied probability of attribute mastery. DCM was then used to generate skill profiles for each student, which included scores representing the probability of students mastering each of eight skills. Correlational analyses revealed large convergent relations between ISPSkills probability scores and theoretically-aligned subscales from the criterion measures. Discriminant validity was not supported, as ISP-Skills scores were also highly related to all other criterion subscales. Receiver operating characteristic (ROC) curve analyses informed the selection of cut scores from each ISP-Skills scale. Review of classification accuracy statistics associated with these cut scores (e.g., sensitivity and specificity) suggested they reliably differentiated students with below average, average, and above average skills. Implications for practice and directions for future research are discussed, including those related to the examination of ISP-Skills treatment utility.
Details
- Title: Subtitle
- Development and validation of the Intervention Skills Profile - Skills: A brief measure of student social-emotional and academic enabling skills
- Creators
- Stephen P. Kilgus - University of Wisconsin–MadisonWes E. Bonifay - University of MissouriKatie Eklund - University of Wisconsin–MadisonNathaniel P. von der Embse - University of South FloridaCasie Peet - University of South FloridaJared Izumi - University of MissouriHyejin Shim - University of MissouriLauren N. Meyer - University of Wisconsin–Madison
- Resource Type
- Journal article
- Publication Details
- Journal of school psychology, Vol.83, pp.66-88
- Publisher
- Elsevier
- DOI
- 10.1016/j.jsp.2020.10.001
- PMID
- 33276856
- ISSN
- 0022-4405
- eISSN
- 1873-3506
- Number of pages
- 23
- Grant note
- R305A180515 / Institute of Education Sciences, U.S. Department of Education; US Department of Education
- Language
- English
- Date published
- 12/01/2020
- Academic Unit
- Psychological and Quantitative Foundations
- Record Identifier
- 9984371289102771
Metrics
12 Record Views