Six Sigma and the CMM

1
Six Sigma and the CMM

• Better Software Development
• Terrence W. Craft
• Omaha SPIN
• June 15, 2004

2
Goals

• Strive for 0 defects
• Proceed systematically
• Check everything
• Improve continuously

Inspect input, observe output
2
3
Whats a Process?
A sequence of steps performed for a given
purpose, for example, the software development
process. - IEEE-STD-610
as compared to
Procedure a written description of a course of
action to be taken to perform a given task.
- IEEE-STD-610
3
4
A Mature Process

• Consistent with the way work actually gets done
• Defined, documented, and continuously improving
• understood
• used
• living
• Supported visibly by management and others
• Well controlledprocess fidelity is audited and
  enforced
• Constructive use of product and process
  measurement
• Disciplined use of technology

4
5
What Are the Benefits of a Mature Process?

• Enables you to focus on the system (and thats
  about 85 of the cause of problems)
• People develop their potential more fully and are
  more effective within the organization
• By defining, measuring, and controlling the
  process, improvements are more successful and
  sustained
• The likelihood increases of appropriate
  technology, techniques, and tools being
  introduced successfully

5
6
Change Is a Process

• Disciplined change is the key to success.
• Improvement includes
• planning
• evaluating improvement proposals and planning
  actions
• establishing process improvement teams
• conducting pilot programs for process improvement
• updating procedures, training, etc.

• Improvements are transferred into everyday
  practice
• across the organization.

6
7
Value of Fixing Defects Early
Error Correction Costs By Phase

Operation
Relative Cost to Correct Error
Validation
Integration
Implementation
DetailedDesign
TIME
8
Taking Dead Aim

• Six Sigma 99.99966 accurate
• Five Sigma 99.9767
• Four Sigma 99.379
• Three Sigma 93.32
• Two Sigma 69.1
• One Sigma 31

Failure is the opportunity to begin again more
intelligently. - Henry Ford
8
9
Why Sigma (s) Levels MatterNumber of defects per
million opportunities

• 6 Sigma 3.4
• 5 Sigma 233
• 4 Sigma 6,210
• 3 Sigma 66, 807
• 2 Sigma 308,537
• 1 Sigma 690,000

Six Sigma process improvement and management
philosophy focused on reducing process output
variation.
9
10
Why Close Isnt Good Enough99 accuracy equals

• 117,000 pieces of lost first-class mail per hour
• 800,000 mishandled personal checks each day
• 23,087 lemons among new computers shipped each
  month
• 7.2 hours per month without electricity

Even if youre on the right track, youll get
run over if you just sit there. - Will Rogers
11
99.9 Quality

• Even at 99.9 quality there would be
• At least 20,000 wrong drug prescriptions per year
• Unsafe drinking water almost 1 hour each month
• No telephone or TV transmission for nearly 10
  minutes each week
• Two long or short landings at OHare each day
• 25,000 lost or incorrectly delivered articles of
  mail per hour
• Over 9,000 wrong felony convictions per year

11
12
D-M-A-I-C
Define Measure Analyze Improve Control
D-M-A-I-C is the roadmap for improving existing
processes.
Reduce defects to improve the capability of a
process to exceed customer expectations
12
13
DMAIC

• Define
• Project charter
• Stakeholder analysis
• SIPOC
• VOC
• Measure
• Data collection
• Validating the measurement system
• Developing a sampling strategy
• Understanding variation
• Process capability
• Analyze
• Organizing potential causes
• Verifying causes
• Hypothesis tests
• Regression analysis
• DOE

• Improve
• Generating solutions
• Assessing risks and piloting solutions
• Planning tools
• Control
• Quality control
• Standardization
• Monitoring control charts
• Evaluating results
• Key learnings
• CMM assessment

Where there is an open mind there will always be
a frontier. - Charles F. Kettering
14
Where To Use DMAIC

• Green Belt efforts
• PITs/PATs/Tiger Teams
• Project management
• Quick hits
• Opening a business

Define, Measure, Analyze, Improve, Control
14
15
Did You Know?
83 not using Six Sigma
Less than 20 of 194 companies monitoring
software quality say they use Six Sigma to
improve the quality of internally developed
applications. InformationWeek Researchs
Software Quality 2003 report.
17 using Six Sigma
15
16
What Are These Things?

• The Capability Maturity Model describes the
  stages through which software organizations
  evolve as they define, implement, measure,
  control, and improve their s/w processes. The
  model provides a guide for selecting process
  improvement strategies by facilitating the
  determination of current process capabilities and
  the identification of issues most critical to s/w
  quality and process improvement.

• Six Sigma is a smarter way to manage a business
  or a department. Six Sigma puts the customer
  first and uses facts and figures to drive better
  solutions. The foundation includes
• Prevent defects.
• Reduce variation.
• Focus on the customer.
• Makes decisions based on facts.
• Encourage teamwork.

16
17
What Is the Capability Maturity Model (CMM)?

• A common-sense application of process management
  and quality improvement concepts to software
  development and maintenance
• A community-developed guide
• A model for organizational improvement
• The underlying structure for reliable and
  consistent CMM-based appraisal methods

17
18
Capability Maturity Model
Result
Key Process Areas
Productivity Quality
Productivity Quality
Level
Characteristic
Key Process Areas
Process change management Technology change
management Defect prevention
Optimizing (5)
Continuous process capability improvement

Software quality management Quantitative process
management
Managed (4)
Product quality planning tracking of measured
software process
Peer reviews Intergroup coordination Software
product engineering Integrated software
management Training program Organization process
definition Organization process focus
Software process defined and institutionalized to
provide product quality control
Defined (3)
Repeatable (2)
Software configuration management Software
quality assurance Software subcontract
management Software project tracking
oversight Software project planning Requirements
management
Management oversight and tracking of
project stable planning and product baselines
Initial (1)
Risk
Ad hoc (success depends on heroes)
"People"
18
19
Six Sigma CMM Relationship
Six Sigma
CMM
It is not necessary to change. Survival is not
mandatory.
W. Edwards Deming
19
20
Working Together

• Showing improvements ROI, quantifiable results.
• Six Sigma tools and focus on measurements
• Requirements the model assumes you have them.
• Maybe not. Six Sigma can help define, quantify,
  and illuminate

Do what you can, with what you have, where you
are. - Theodore Roosevelt
21
Why Use Both?

• CMM is the leading framework for assessing and
  improving an organizations software practices.
  It gives us the what should be done.
• Six Sigma is a business management discipline
  focused on engineering for superior quality as
  defined by the customer needs. Six Sigma gives
  us the tools for how to do it.

21
22
Capability Versus Performance

• Process capability the range of expected
  results that can be achieved by following a
  process, initially established at the
  organization level. A predictor of future
  project outcomes.
• Process performance a measure of the actual
  results achieved from following a process.
  Refers to a particular project in the
  organization.

22
23
Process Variation

• Which pilot would you recommend?
• Why?
• How do you think your processes perform?
• Would you recommend your process?

A project is a problem scheduled for solution -
J. M. Juran
24
THE ROLE OF THE PROCESS OWNER IS TO MANAGE THE
PROCESS LIFECYCLE.
THE PROCESS IMPROVEMENT LIFECYCLE
Develop execute improvement plan
Set performance target
Understand Performance gap
Improve individual performance (training,
tools, attitudes, replacement)
Improve process
Understand Customer needs and benchmark competitor
s
Measure process performance
D M A I C
D M A D V
Modify design
Replace design
Define theprocess
Perform process
24
25
Quick Definitions

• DMAIC Define, Measure, Analyze, Improve,
  Control
• Sometimes seen as DMAIIC Define, Measure,
  Analyze, Improve, Implement, Control
• DMADV Define, Measure, Analyze, Design, Verify

Whatever is worth doing at all is worth doing
well. - Philip Dormer Stanhope
26
PDCA is Where It's At
Credit for PDCA to Walter Shewart also often
attributed to W. Edwards Deming.
26
27
Bottom Line
CMM gives us the what should be done Six Sigma
gives us the how to do it.
When the thinking changes, the organization
changes, and vice versa. - Gerald Weinberg
27
28
Summary

• Using Six Sigma to help implement a CMM will
  provide
• discrete and macro measures to ensure improvement
  targets are achieved,
• a proven way to close process gaps, and
• control processes to insure sustainability

Define, Measure, Analyze, Improve, Control
28
29
Questions, Comments, Concerns?

• in other words, does this make sense?

29
30
Lets Talk

• Email voice
• Terrence.Craft_at_firstdatacorp.com
• Tel. [phone]
• Follow-up
• Thank you for coming today!

30