SACWIS Implementation: the Role of Quality Management

1
SACWIS Implementation the Role of Quality
Management

• Description and Guidelines

2
Quality ManagementAgenda

• Processes
• Standards
• In-House or Vendor?
• Helpful Links
• State Questions
• ACF Guidelines (updates slides 4 of 4)

3
Quality ManagementProcesses

• Quality Planning
• Quality Assurance (QA)
• Quality Control (QC)
• Independent Verification Validation (IVV)

4
Quality ManagementProcesses
5
Quality ManagementProcesses
6
Quality ManagementProcesses

• Quality Planning Definition
• The process of identifying which standards apply
  to the project and how to meet the standards,
  with a focus on establishing sponsor/ customer
  requirements, designing products and services to
  meet those requirements, establishing quality
  goals, defining processes, and establishing
  controls to use in monitoring the processes.

7
Quality ManagementProcesses

• Quality Assurance (QA) Definition
• A set of activities designed to ensure that the
  development and/or maintenance process is
  adequate to ensure a system will meet its
  objectives. Quality assurance is performed
  throughout the life-cycle of a project.

8
Quality ManagementProcesses

• Quality Control (QC) Definition
• A set of activities designed to evaluate a
  developed work product. QC activities focus on
  finding defects in specific deliverables - e.g.,
  are the defined requirements the right
  requirements.

9
Quality ManagementProcesses

• Independent Verification Validation (IVV)
  Definition
• The process in which the products of the
  software development process are independently
  reviewed by a group that is neither the developer
  nor the acquirer.

10
Quality ManagementStandards

• QA/QC should be based on a standard
• QA/QC staff (internal or vendor) should specify
  the standard that they use

11
Quality ManagementStandards (contd)

• Sources
• Industry standards including
• International Organization for Standardization
  (ISO)
• Institute of Electrical and Electronics
  Engineers, Inc. (IEEE)
• Capability Maturity Model Integration (CMM/CMMI)
• Project Management Institute (PMI)
• State defined standards and procedures for
  quality management

12
Quality ManagementStandards (contd)ISO

• ISO 90002000 series
• ISO 90002000
• ISO 90012000
• ISO 90042000

13
Quality ManagementStandards (contd)ISO
14
Quality ManagementStandards (contd)IEEE

• IEEE Std 10121998
• IEEE Std 7302002
• IEEE Std 10611998
• IEEE Std 982.11988

15
Quality ManagementStandards (contd)CMM/CMMI
16
Quality ManagementStandards (contd)PMI

• ISO 9001
• PMBOK
• ANSI/PMI 99-001-2004
• PMP Certification

17
Quality ManagementStandards (contd)ISO Pros
and Cons

• PROS
• Standard process for evaluating vendors (vendors
  are sanctioned by ISO)
• Certification must be kept up to date
• CONS
• Not recognized by some American vendors
• Requires significant training to internal project
  staff to interpret the model if implemented
  in-house
• Assumes that the internal staff is a
  software/system expert
• Most documentation is difficult to understand and
  interpret

18
Quality ManagementStandards (contd)IEEE Pros
and Cons

• PROS
• Widely recognized
• Standards easily available
• Includes all processes
• CONS
• Uses a specific vocabulary
• Standards are for purchase
• Assumes a standard lifecycle
• Does not include human resources (staffing)

19
Quality ManagementStandards (contd)CMM/CMMI
Pros and Cons

• PROS
• Model is downloadable
• Standard process for evaluating vendors
  (assessors are sanctioned by SEI)
• Training available on the model
• Includes all processes
• CONS
• Not recognized by some commercial vendors
• Requires significant training to interpret the
  model
• Assumes that the internal staff is a
  software/system expert
• Does not include human resources (staffing)

20
Quality ManagementStandards (contd)PMI Pros
and Cons

• PROS
• A good process for certifying Project Managers
• Widely recognized
• Local chapters of PMI
• Includes Human Resource (staffing)
• Certifies PMs
• Special interest groups, IT, construction,
  engineering, etc.
• Requires ongoing training to maintain
  certification
• CONS
• PMBOK (Project Management Body of Knowledge) not
  set up to evaluate contractors
• Includes only management and support processes

21
Quality ManagementIn-House or Vendor?Internal QA

• Have your own people trained in doing QA
• Set up internal Project Management Office
• Train participants in the appropriate standard
• Have members of the office monitor
  products/processes on project including all
  vendor products/processes
• Monitor each deliverable for compliance to
  standard

22
Quality ManagementIn-House or Vendor?
(contd)External QA

• Using external staff
• Select appropriate standard
• May want to require certification from vendors in
  standard
• Make certain that you understand the
  certification process!

23
Quality ManagementIn-House or Vendor?
(contd)Internal QA Pros and Cons

• PROS
• Less costly
• Develop internal expertise
• Internal staff now trained in project management
• CONS
• Independence may be compromised
• Can be disagreement on the interpretation of the
  standard
• The model and the vendor may use different
  terminology and life cycles

24
Quality ManagementIn-House or Vendor?
(contd)External QA

• PROS
• Usually more skilled in project processes
• Usually more knowledgeable of industry standards
• Much more independence
• CONS
• More costly
• Limited by contract terms

25
Quality ManagementUseful Links

• State Systems Profiles
• www.acf.hhs.gov/nhsitrcapps
• Sample PMO sites
• Oregon
• egov.oregon.gov/DHS/admin/pmo/publications/pmo_tem
  plates.shtm
• Tennessee
• www.state.tn.us/finance/oir/qa/safety-qm-plan1.pdf
  
• Texas
• http//www.dir.state.tx.us/eod/qa/template.htm

26
Quality ManagementUseful Links (contd)

• What is ISO 90012000 (in easy-speak)
• www.bsiamericas.com
• Click on link at right hand side for free
  guidance documents
• CMMI and software metrics (in easy-speak)
• http//www.dcs.qmw.ac.uk/norman/papers/qa_metrics
  _article/section_7_standards.html

27
Quality ManagementUseful Links (contd)

• ISO
• www.iso.org
• IEEE
• www.ieee.org
• CMMI
• www.sei.cmu.edu/cmmi
• PMI
• www.pmi.org

28
Quality ManagementState Questions

• Discussion
• How did you decide to go with a vendor vs.
  in-house for QA?
• What is your vendor selection process?
• Do you have examples of management reports that
  you have found useful?
• What were the lessons learned?

29
Quality ManagementACF Guidelines

• Before you begin
• Provide business case to ACF justifying
  (standard) methodology selected describe
  contributing project uniqueness factors

30
Quality ManagementACF Guidelines

• Best Practices
• Management must ensure adherence to roles/
  responsibilities defined in RFP
• Identify and track outputs/artifacts expected to
  monitor and ensure quality
• Ensure plan is followed through rely on defined
  roles/responsibilities, mitigation strategies,
  recommendations
• Inform ACF of any changes throughout the process

31
Quality ManagementACF Guidelines Summary

• In Summary
• Is QM a SACWIS requirement? NO
• Is QM a best practice? YES
• Submit to ACF
• Business case
• QM Plan
• Update ACF of any changes
• Request technical assistance

32

• THE
• END