Non Functional within OAT

1
Non Functional within OAT

• Test Managers Summit - Jan 08
• Stevan Zivanovic
• stevan_at_probatur.com

2
OAT

• Operational Testing
• Testing conducted to evaluate a component or
  system in its operational environment. IEEE 610
• (ISTQB Testing Glossary)
• Testing elements can include
• Service/Operational processes
• Service/Operational error management
• Maintainability
• Can include other NFT types

3
ITIL

• The key purpose of service validation and testing
  is to provide objective evidence that the
  new/changed service supports the business
  requirements, including the agreed SLAs.

• The service is tested explicitly against the
  utilities and warranties set out in the service
  design package, including business
  functionality, availability, continuity,
  security, usability and regression testing.

Source itSMF An Introductory Overview of ITIL V3
4
NFT Types

• Non Functional Testing
• Testing of those requirements that do not relate
  to functionality

Performance / Stress Reliability Security
Memory Management Interoperability Usability
Portability Procedure Compatibility
Maintainability Recovery Disaster Recovery
Installability Configuration Conversion
Source www.testingstandards.co.uk
5
Challenges

• Both need realistic environments
• Both require a greater element of technical
  knowledge
• Need to be run early in the development cycle
• The client is not always aware of these
  requirements

6
For Discussion

• Does it matter where the NFT types are executed?
• Is it relevant to run all these types of testing?
• Who should run these types of tests?
• Who pays for the testing - the project or the
  Service team?
• Can this be off-shored/outsourced?