Other Testing Techniques

1
Other Testing Techniques

• CS2335
• Spring 2002

2
Other Testing

• Integration Testing
• GUI Testing
• VV

3
Integration Testing

• Big Bang
• Top-Down
• Bottom-Up
• Sandwich
• Feature Set

4
Top-Down Strategy
Breadth-First Depth-First
Start with Main and Stubs Replace stubs
incrementally Test at each step Regression Test
Suite
DISADVANTAGE A lot of stub writing
5
Bottom-Up Strategy
M5
M4
Start with driver and atomic module Replace
upper drivers with modules Test each
integration Build-up clusters
M3
M2
M1
DISADVANTAGE No program till integration
complete
6
Feature-Set
M1
M4
M5
M2
Board Display
M3
Select Key Features Organize into
clusters Integrate/Test Feature
Load/Save Game
DISADVANTAGE May be hard to isolate features/
Feature Interaction Problem
7
Integration Coverage
Code Coverage Static Call Graph Coverage
main
usage
parser
insertsymbol
scanner
getnoblank
getsymbol
8
GUI Testing (Paul Gerrard)

• Test Challenges
• Event-Driven System
• Unsolicited Events
• OO with large number of objects
• Hidden Synchronization
• Hidden Dependencies
• Infinite Input Domain
• Many ways in and out
• Window Management

9
GUI Testing

• Phases
• Low-level (Checklist, Navigation)
• Application(Equivalence, Boundary, State,
  Decision Tables)
• Integration (C/S Communications, Desktop
  integration, Synchronization)
• Non-Functional (Load test, Compatibility)

10
Test Types

• Checklist Standards Conformance
• Navigation Reachability, Call/Event Handling
• Equivalence, Boundary - Input validation,
  Rule-based processing
• C/S Tests attaching to net/dbms
• Synchronization data integrity between windows

11
Coverage Criteria
Problem in Non-Modal Windows

• Event-Flow Graphs
• Cover all events

Help
File
Contents
About
Save
Open
New
Print
Test data shows 92 statement coverage
Page Setup
12
Pulling Testing Together (VV)

• Validation
• Customer review of use cases (Requirements
  validation)
• Traceability (match phases to requirements)
• Validation test suite
• Alpha/Beta Tests

13
VV Continued

• Verification
• Reviews/Inspections
• Process Monitoring
• Unit Test Standards
• Integration Test Strategy
• Regression Testing
• System Testing

14
Next Time
JUNIT Test Framework www.junit.org