Software Testing

1
Software Testing

• Prajakta Puri
• CSCI 577b

04/25/2005
2
Outline

• Definition software testing
• Test related measures
• Evaluation of the program under test
• Evaluation of the tests performed
• Conclusion
• References

3
Definition

• Software testing is an activity performed for
  evaluating product quality, and for improving it,
  by identifying defects and problems.

4
(No Transcript)
5
Test Related Measures

• Grouped related to
• Evaluation of the program under test
• Evaluation of the tests performed

6
Evaluation of the program under test

• Program measurements to aid in planning and
  designing testing
• Based on program size or structure
• Fault types, classification, and statistics
• Relative frequency with past
• Making quality predictions

7
Evaluation of the program under test

• Fault density
• No. of faults / size of program
• Reliability evaluation
• Reliability growth models
• Failure-count
• Time-between-failure

8
Evaluation of the Tests Performed

• Coverage / thoroughness measures
• Covered elements / total no. elements
• Fault seeding
• Artificially introduced faults
• Estimation of no. of remaining genuine faults

9
Evaluation of the Tests Performed

• Mutation score
• Killed mutants / total no. of generated mutants
• Comparison and relative effectiveness of
  different techniques
• Possible interpretations
• No. of test needed to find the first fault
• No. of faults found through testing / No. of
  faults found during and after testing

10
Conclusion

• Evaluation of the program under test
• Program measurements to aid in planning and
  designing testing
• Fault types, classification, and statistics
• Fault density
• Reliability evaluation
• Evaluation of the Tests Performed
• Coverage / thoroughness measures
• Fault seeding
• Mutation score
• Comparison and relative effectiveness of
  different techniques

11
References

• Guide to the Software Engineering Body of
  Knowledgehttp//www.swebok.org/ironman/pdf/SWEBOK
  _Guide_2004.pdf
• S. L. Pfleeger, Software Engineering Theory and
  Practice, second ed., Prentice Hall, 2001.
• Crosstalk, Feb 2001
• Professional Tester, April 2003

12
Thanks