Journal article
Analyses of factors related to positive test bias in software testing
International journal of human-computer studies, Vol.41(5), pp.717-749
11/1994
DOI: 10.1006/ijhc.1994.1079
Abstract
In earlier work, we have shown that software testers exhibit positive test bias. Positive test bias is the pervasive behavioral phenomenon in which hypothesis testers tend to test a hypothesis with data which confirms the hypothesis. However, in software testing this behavior may be counter-productive, since it may be more effective to test with data which are designed to disconfirm the hypothesis.
The first study considered how positive test bias is influenced by the expertise level of the subjects, the completeness of the software specifications and whether or not the programs contained errors. The results demonstrated strong evidence of positive test bias regardless of condition. The effects appear to be partially mitigated by increasingly higher levels of expertise and by increasingly more complete specifications. In some cases, the effect is also increased by the presence of errors. A second study used talk-aloud protocols to explore the kinds of hypotheses testers generate during testing. The results further emphasize that subjects test their programs in a biased way and support the notion that the program specification drives testers' hypotheses. We conclude that positive test bias is a critical concern in software testing and may have a seriously detrimental effect on the quality of testing. The results further emphasize the importance of complete and thorough program specifications in order to enhance effective testing.
Details
- Title: Subtitle
- Analyses of factors related to positive test bias in software testing
- Creators
- Laura Marie LeventhalBarbee Eve TeasleyDiane Schertler Rohlman
- Resource Type
- Journal article
- Publication Details
- International journal of human-computer studies, Vol.41(5), pp.717-749
- DOI
- 10.1006/ijhc.1994.1079
- ISSN
- 1071-5819
- eISSN
- 1095-9300
- Publisher
- Elsevier Ltd
- Language
- English
- Date published
- 11/1994
- Academic Unit
- Occupational and Environmental Health; International Programs; Injury Prevention Research Center
- Record Identifier
- 9984214725202771
Metrics
23 Record Views