Lecture Notes for CS 325
Testing Motivation and Objectives, 26 March 2001
- motivation
- we have a system
- this is a last look at the system
- first crack at the whole system, last crack at finding errors
- is the system good enough to be accepted by the client
- clients accept systems that do what they're supposed to do
- show the system works under certain circumstances - which circumstances
- the ones in which the client might be interested
- error, fault, failure
- error - an observable mismatch between system response and
specification
- failure - the system behavior that resulted in an error
- fault - the part of the system from which a failure arose
- errors imply failures imply faults
- faults may not imply failures may not imply errors
- it is only in their observation that faults imply errors
- no observed errors does not imply no faults
- testing can show the presence of errors, never their absence
- can you test for correctness
- correct systems work under all circumstances - correct systems have
no faults
- what are all circumstances - this is independent of client
- how big is the set of all circumstances
- how long will it take to test the set of all circumstances
- you can't test for correctness in general - omitting circumstances
can lead to missing faults
- costly and difficult - budget 25% to 40% of total resources to testing
- objectives
- testing as an activity itself, instead of an add-on
- testing as a managable activity
- make sure it gets done
- make sure it gets done will
- finding errors - testing
- tracing failures - debugging
- fixing faults - maintenance
- develop the widest, most relevent set of tests possible subject to
resource constraints
- what the customer will accept defines the lower limit
This page last modified on 26 March 2001.