Title: ??? Maturity Level 4: Quantitatively Managed Process Areas
1???Maturity Level 4Quantitatively Managed
Process Areas
2Table of Contents
- ?? High Maturity ? Level 4 and 5
- ?????? (OPP)
- ?????? (QPM)
- QA
3?? High Maturity ? Level 4 and 5
4Foundation of Level 4 and 5
- Maturity level 2,3, and the generic practices
build the foundation necessary for quantitative
management of processes and control of quality. - This foundation includes
- defined processes to
- achieve consistency across the organization
- provide a detailed understanding of subprocesses
and their relationships - common measures to accumulate meaningful data
across the organization - effective quality assurance to ensure process
fidelity - proactive project management to
- establish quality goals
- manage and control the process
5Foundation of Level 4 and 5 (2)
- Processes evolve
- Requirements analysis, design, code and test are
performed at maturity level 2. - There will be organizational standards, tools,
etc., at maturity level 3. - Maturity levels 4 and 5 describe added
sophistication in how (maturity level 1, 2, and
3) processes are performed.
6Level 4 and 5 Appraisals
- Level 4 and 5 appraisals cover CMMI in its
entirety, not just the level 4 and 5 process
areas.
7What Should You Expect From a High Maturity
Organization?
- Predictability
- the ability to predict cost, schedule, and
defects based on past performance - upper and lower boundaries on expected
performance (intervals, not point estimates) - Recognition of the unknown
- requirements change
- software management risk management
- Willingness to work the customer and end user to
understand needs.
8Trends in Quality Results
Maturity Level Design Faults / KSLOC (Keene) Delivered Defects / FP (Jones) Shipped Defects / KSLOC (Krasner) Relative Defect Density (Williams) Shipped Defects (Rifkin)
5 0.5 0.05 0.5 0.05 1
4 1 0.14 2.5 0.1 5
3 2 0.27 3.5 0.2 7
2 3 0.44 6 0.4 12
1 5-6 0.75 30 1.0 61
Samule Keene, Modeling Software RM
Characteristics. Unpublished report. Capers
Jones, Software Benchmarking, IEEE Computer,
October 1995, pp. 102-103 Herb Krasner,
Self-Assessment Experience at Lockheed, Third
Annual SEPG Workshop, 7 November 1990 Karl D.
Williams, The Value of Software
ImprovementResults! Results! Results! SPIRE97,
4 June 1997 Stan Rifkin, The Business Case for
Software Process Improvement, Fifth SEPG
National Meeting, 26-29 April 1993.
9Measurements for Level 4
- Measurements needed for ML 4 analyses may be
different from that for ML 3 analyses. - Maturity level 4 analyses require a history of
measurements. It may - impact existing measurement programs
- delay maturity level 4 analyses until after
level3 is achieved - delay achieving maturity level 4
10Statistical Quantitative Techniques are Used
- Established a foundation with ML 2 3 practices.
- At ML4, the behavior of the process is
predictable and quantitatively understood. - Confidence in estimates and being able to
predict. - Managers engineers use the data with
statistical other quantitative techniques to
manage the process results.
11Statistical Quantitative Techniques are Used (2)
- Statistical other quantitative method are used,
at both the organizational project level, to - understand past process performance.
- predict future process performance.
- predict future product and service quality.
12Why Use Statistics?
- Most software organizations use average of
previous performance in estimating, planning, and
making commitments - Average is a statistic ? a measure of central
tendency.
13More than Average
- Software organizations usually establish
performance targets for what to expect and where
to do better. - Intervals may be preferred over point targets.
- Voice of Customer describes the performance we
want to achieve.
14Statistics can Lead to Understanding
- Knowing what is possible with the current process
may indicate the kind of action necessary to
achieve those targets!
15Statistical Thinking
- All processes are variable.
- By fact and systematic improvement, understanding
process variation is the basis for management. - Understand the past quantitatively.
- Control the present quantitatively.
- Predict the future quantitatively.
16Process Variations
- Total variation
- Common cause variation Special cause
variation
17Common Cause Variation
- Common cause variation
- The process variation that exists because of
normal expected interactions among the process
components, e.g., people, machines, methods, etc. - Common cause of process variation
- to remove at ML 5.
18Special Cause Variation
- Special cause variation
- Arise from events that are not part of the normal
process, e.g. shifts in the quality of raw
materials, inadequately trained people, tool
failures. - Special cause of process variation
- A cause of defeat that is specific to some
transient circumstance and not an inherent part
of a process. - To remove at ML 4.
19Stable Processes
- Stable process The state in which all special
causes of process variation have been removed
and prevented from recurring so that only the
common causes of process variation of the process
remain.
20Capable and Standard Processes
- Capable process A process that can satisfy its
specified product quality, service quality, and
process performance objectives. - Standard process The basic process that guides
the establishment of a common process in an org.
It is expected to be incorporated to any defined
process.
21Projects at High Maturity
- Projects use measurable objectives to meet the
needs of the customers, end users, and the
organization. - Require a lot of history measurement data.
- Use the data with statistical and other
quantitative techniques in managing the processes
and results.
22Projects at High Maturity (2)
- Addressing process variation
- Apply the principles of statistical process
control. All processes will show same variation
in process and product measures each time they
are executes (the range within which variation
normally occurs)
23??????Organizational Process Performance
24?????? (OPP)
- ??
- ???????????,????????
- ???????????????????????
- ???????????(Baselines)???,????????????????
- The process performance models are used to
represent past and current process performance
and to predict future results of the process.
25Where Does OPP Stand?
26???????????????
27?????? (OPP) (2)
- ????(specific goal, SG)
- SG 1 ?????????
28SG 1 ?????????
- ??????????,????????????????????
29SG 1 ????????? (2)
- ??????(specific practice, SP)
- SP 1.1 ????
- SP 1.2 ????????
- SP 1.3 ???????????
- SP 1.4 ????????
- SP 1.5 ????????
30SG 1 ????????? (3)
Establish Performance Baselines and Models
31SP 1.1 ????
- ???????????????????,?????????(elements)?
- ??????????????????????????????????
32SP 1.1 ???? (2)
- ???????
- ???????????????????
- ??????
- ?
33SP 1.2 ????????
34SP 1.2 ???????? (2)
- ???????
- ?????????????
- ??????
- 1. ??????????????????????????
- 2. ????????????????????
- 3. ??????????????????
- 4. ????????
35SP 1.2 ???????? (3)
- ?????????,????
- ?????????????
- ??????????????
- ?????????????
- ????????
- ???????
- ?????????
- ????????????
- ???????????????????????
36SP 1.3 ???????????
37??????????
- ??
- Improved product quality.
- Increased productivity.
- Decreased cycle time.
- Greater customer and end-user satisfaction.
- Shorter development or production time to change
functionality, add features, or adopt a new
technologies.
38SP 1.3 ??????????? (2)
- ???????
- ???????????
- ??????
- 1. ???????????????????
- 2. ????????????????
- 3. ???????????????????
- 4. ??????????????????????????????,??????????????
- 5. ????????????????????
39SP 1.4 ????????
40SP 1.4 ???????? (2)
- ???????
- ???????????
- ??????
- 1. ?????????????
- 2. ?????????????,???????????????
- 3. ??????????????????,??????
- 4. ??????????????????,?????????
- 5. ???????????????????
- 6. ??????????????
41SP 1.5 ????????
42SP 1.5 ???????? (2)
- ???????
- ??????
- ??????
- 1. ???????????????????,?????????
- 2. ?????????????????,?????????
- 3. ????????,??????????????
- 4. ???????????????
- 5. ????????????
43SP 1.5 ???????? (3)
- ???????
- ?????
- ???
- ?????????
- ????????
- ???????
- ????
- ???????
44SP 1.5 ???????? (4)
- ??????
- ?? ??????
- ?? ???????
- ?? ?????
- ???????????
- ?? ??????
- ?? ???????????
- ?? ?????????
45??????(QPM)
46?????? (QPM)
- ??
- ?????????????????,??????????????????
47Where Does QPM Stand?
48QPM Context
49Advanced Project Management PAs
50?????? (QPM) (2)
- ????(specific goal, SG)
- SG 1 ??????
- SG 2 ??????????????
51SG 1 ??????
52SG 1 ??????
- ??????(specific practice, SP)
- SP 1.1 ??????
- SP 1.2 ???????
- SP 1.3 ???????????????
- SP 1.4 ??????
53SP 1.1 ??????
54SP 1.1 ?????? (2)
- ???????
- ????????????
- ??????
- ???????????????
- ???????????????????,?????????????????
- ???????????
- ?????????????????????
- ?????,??????????,????????,?????????????
- ?????????????????(????????????,??????????)?
- ??????????????????????
- ???????????????????
- ?????????????????
55SP 1.1 ?????? (3)
- ?????????,????
- ?? ???
- ?? ???
- ?? ????
- ?? ???
- ?? ????
- ?? ????
- ?? ???
- ?? ???
56SP 1.2 ???????
- ?????????????,?????????????????
57SP 1.2 ??????? (2)
- ???????
- ????????????????????????
- ???????????????
- ?????????????
- ??????????????????,??????
- ??????
- ???????????????????
- ?????????????????????????,????????????
- ??????????,???????????????????????
- ???????????????????????(????,????????????????????)
?
58SP 1.3 ???????????????
- ?????????,?????????????????
59SP 1.3 ????????????? (2)
- ???????
- 1. ???????????????????
- 2. ?????????????????
- 3. ???????????
- 4. ?????????????????????
- ??????
- 1. ?????????????????????????
- 2. ????????????,?????????????????????????,????????
???????? - 3. ????????????????????
- 4. ????????????????????????
60SP 1.3 ????????????? (3)
- ????????????,????
- ???????????????
- ???????????????
- ???????????????
- ??????????
- ????????????
- ??
61SP 1.4 ??????
- ????,???????????????????,?????????????
62SP 1.4 ?????? (2)
- ???????
- 1. ??????????????????(???)
- 2. ??????????????????
- 3. ?????????,?????????????
- ??????
- 1. ???????????????????????????????,???????????????
????? - 2. ????????????????????????????,??????????????????
?? - 3. ????????????????????
- 4. ??????????????????,????????????????????????????
??????????,?????????????,???????????,????????????
??????,????????????? - 5. ????????????????????????
- 6. ???????????????????????,????????????
63SP 1.4 ?????? (3)
- ??????????????,??????,????
- ???????????,?????????????????????
- ??????????????,??????????(????????????,??????,????
?????????)? - ????????????????????????
- ??????????????????
- ?????
64SG 2 ?????????????
- ???????????????????????????
65SG 2 ???????????
- ??????(specific practice, SP)
- SP 2.1 ?????????
- SP 2.2 ??????????
- SP 2.3 ???????????
- SP 2.4 ????????
66SP 2.1 ?????????
- ??????????????????????????
67SP 2.1 ????????? (2)
- ???????
- 1. ??(?????)??????????????????????
- 2. ?????????????,????????????????
- 3. ???????,???????????????
- 4. ???????????????????
- ??????
- 1. ????????????????,????????
- 2. ????????????,????????????????????
- 3. ??????????????
- 4. ???????????????,?????????????????
- 5. ????????????????????,??????,??????????????,????
???????????? - 6. ??????????????????????????????
- 7. ???????????????????????
- 8. ???????????????
68SP 2.2 ??????????
- ????????????,????????????????????
69SP 2.2 ?????????? (2)
- ???????
- 1. ?????
- 2. ?????????????????????
- 3. ??????????????????????????????
- ??????
- 1. ???????????????,????????????
- 2. ??????,??????????????
- 3. ????????,????????????
- 4. ??????????
- 5. ???????????,???????????
- 6. ????????????,????????????
- 7. ??????????????????,??????????
70SP 2.3 ???????????
- ???????????,???????????????????????,?????????????
71SP 2.3 ???????????(2)
- ???????
- 1. ???????????????????(??)?????
- 2. ??????????
- 3. ????????????????
- ??????
- 1. ????????????????????????
- 2. ???????????,????????????????
- 3. ??????????????
- 4. ?????????????????????
72SP 2.3 ??????????? (3)
- ??????????????????,??????,????
- ???????????,???????????????
- ????????????,??????????(????????????,???????,?????
???????) - ?????????????????????????????
- ??????????????,???????????
73SP 2.4 ????????
74SP 2.4 ???????? (2)
- ???????
- ????????????????????
75QA