Book chapter
Measuring test performance with signal detection theory techniques
APA handbook of research methods in psychology: Foundations, planning, measures, and psychometrics, pp.837-858
American Psychological Association, Second Edition
01/01/2023
DOI: 10.1037/0000318-038
Abstract
The development and evaluation of assessment and prediction strategies designed to distinguish two mutually exclusive states are central enterprises in psychological science. Once classic psychometric methods have been used to develop one or more assessment devices, the predictive or criterion validity of the measurement strategies must be evaluated. As a result, researchers increasingly are relying on the methods of signal detection theory, particularly receiver operating characteristic (ROC) analysis and utility-based decision theory approaches. This chapter illustrates issues in evaluating test performance with a data set from the National Comorbidity Survey Replication (NCS-R). It provides an overview of the use of ROC and decision-theory approaches for examination and enhancement of decision making in psychology. The chapter closes with recommendations regarding the reporting of the development of new measures, regard to optimal cutoff values for a range of base rates and several common decision goals. (PsycInfo Database Record (c) 2023 APA, all rights reserved) (Source: create)
Details
- Title: Subtitle
- Measuring test performance with signal detection theory techniques
- Creators
- Teresa A TreatRichard J Viken
- Resource Type
- Book chapter
- Publication Details
- APA handbook of research methods in psychology: Foundations, planning, measures, and psychometrics, pp.837-858
- Edition
- Second Edition
- Publisher
- American Psychological Association
- DOI
- 10.1037/0000318-038
- Language
- English
- Date published
- 01/01/2023
- Academic Unit
- Psychological and Brain Sciences
- Record Identifier
- 9984448056302771
Metrics
7 Record Views