Alexandre Duarte

1
Multi-Environment Software Testing on the Grid
Universidade Federal de Campina Grande - Brasil

• Alexandre Duarte
• Gustavo Wagner
• Francisco Brasileiro
• Walfredo Cirne

2
Motivation

• There are applications with very time consuming
  test phases
• Rothermel, Untch, and Chu (7 weeks)
• Smart Alarms (36 hours)
• Configuration mistakes in software installation
  are the major reasons for computer system errors
• Pointed by Brown and Patterson in 2001
• Observed in two surveys we have conducted with
  the grid community along the last years

3
Motivation

• Grid applications are supposed to be correctly
  executed on highly heterogeneous and dynamic
  environment
• Traditional ways to qualify test processes are
  based on code coverage metrics

4
Speeding up Test Execution
Distribute
Prioritize
Select
5
Dealing with Configuration Mistakes

• Build several different test environments
• Expensive
• Time consuming
• Does not cover different user and administrative
  policies

6
Agenda

• Motivation
• To present a solution to test grid applications
• How to describe a test of a grid application
• Conclusions and Future Work

7
Environmental Coverage

• Development environments are controlled
• Test applications designed to run on
  heterogeneous environments in a set of different
  production environments

8
GridUnit

• Speeds up test execution by exploring the high
  levels of parallelism provided by the grid
• Provides a way to detect configuration mistakes
  by exploring the heterogeneous nature of the
  grid
• Shared by multiple users
• Without a centralized control unit
• Composed by multiple administrative domains
  (virtual organizations)

9
GridUnit Architecture
10
InGriD

• Builds environments in grid machines
• Manages all environments deployed in the grid
• It is an extension of Smart Framework for Work
  Group (SmartFrog), developed by HP Labs
• Deal with grid machines

11
InGriD Architecture
12
InGriD and a Grid How it works
Job Description File
... Requirements environment seghidro ...
Broker
Peer
Site 1
Site 2
Site N
Machines with seghidro environment
13
Testing a Real Application

• The application creates a web album from a set of
  digital images
• Time consuming
• Photo editing is independent from each other
• Grid nodes have
• Sun JVM 5.0 and JRockit 5.0
• Intel Pentium 4 and Intel Itanium 2
• 4 environments

14
Running the Tests
Environment Description
Grid
InGriD
GridUnit
JUnit Automated Tests Test Session Spec.
15
1. Environment Specifications
16
2. Test Session Specification
17
OurGrid

• Largest computation grid in production in Brazil
  today
• About 30 organizations (UFCG, USP, PUC-RS, UFPE,
  PUC-Minas, UFF, UFPB, UFBA, UCB, LNCC, UNISANTOS,
  ...)
• ? 300 machines

18
GridUnit OurGrid

• Does not require any source code modification
• Open Source
• Free to use and free to join

19
Screenshot Green Bar
20
Screenshot Red Bar
21
Screenshot Gray Bar
22
Conclusions and Future Work

• We presented a proposal of a solution to improve
  the confidence of heterogeneous environment
  applications
• InGriD to describe and deploy test environments
• GridUnit to coordinate and monitor execution of
  test sets
• Environmental coverage metric is complementary
  and orthogonal to test coverage metrics
• Formalization of the environmental coverage
  metric for software testing

23
?? - Thank you Obrigado Merci Danke
Arigato - Gracias

• Additional Information
• Alexandre Duarte alex_at_dsc.ufcg.edu.br
• Gustavo Wagner gugawag_at_gmail.com
• Francisco Brasileiro fubica_at_dsc.ufcg.edu.br
• Walfredo Cirne walfredo_at_dsc.ufcg.edu.br
• http//gridunit.sourceforge.net
• http//sourceforge.net/projects/ingrid-project
• http//www.ourgrid.org