Ms' Amy Markowich

1
NAVY TE for the FUTURE

• Ms. Amy Markowich
• Deputy DoN TE Executive
• ASN(RDA) / N091

2
Who is the TE Deputy?

• Senior deputy to the DoN TE Executive
• DoN TE Executive, Deputy, specifics
• ASN(RDA) staff position for TE
• Develop/approve SECNAV TE policy
• Develop/coordinate/approve Navy TE inputs to DoD
• Engage senior-level Acquisition and TE
  stakeholders on top level TE-related issues
• Execute TE executive outreach program
• Act for DoN TE Executive, RADM Carr, as needed
• Define TE acquisition workforce requirements
• Naval Technical Authority in TE
• Deputy Director Navy TE, N091C
• TE Program support and resourcing
• Sign Test and Evaluation Master Plans (TEMPs)

Additional responsibilities to be determined
3
Organization Chart
4
Navy TE Org Chart
ASN(RDA)
VCNO
ACMC
PMD
N091 DoN TE Exec
CNR
N091C Deputy DoN TE Exec
ONR
Asst Deputy DoN TE
N912
CNO N091 - TE and Technology Requirements
CNO N912 - TE Division CNR Chief
of Naval Research
ONR Office of Naval Research
5
TE Issues Today
Problem Statement
The perception at upper levels of DOD is that
TE slows the acquisition of systems down.
recent comment by DoD (ATL) official
Current and Real Issues

• Highly complex acquisition systems
• Variety of acquisition strategies and test
  activities
• Cost, schedule and performance pressures
• Rapid acquisitions and TE interface/guidance
• Ever increasing complexity in TE needs
• TE is critical but comes at the end of the
  process

Solution / Goals

• Continuous improvement in TE execution,
  infrastructure and WF
• Earlier TE involvement and integration of
  activities
• Operational testing that finds ready for
  tasking systems

6
TE Initiatives Being Worked

• Workforce
• Competency Alignment
• TE Acquisition Workforce Growth
• OSD ATL Expert Panel on TE
• WSARA DTE Self Assessment
• Yearly Integrated Testing Workshop
• TE University
• Systems Engineering and TE Alignmnt

• Policy
• Navy TE Board of Directors (BoD)
• Strategic Issues
• SECNAVINSTR 5000 Updates
• OSD(ATL) TE Working Group
• DODI 5000/ DAG / IA CXwalk
• ASN RDA Disciplined Program
• Performance Fire Team

• Infrastructure
• Test Resource Requirements
• Navy Major Ranges/Facilities (MRTFB)
• Other Navy Ranges/Facilities
• DTRMC Strategic Plan
• Central TE Imprv. Program
• Tri-Service Board of Directors
• Test Resources Advisor Grp (TRAG)

• Acquisition Programs
• Test and Evaluation Master Plans
• PMD RDA / DASN program support
• Navy program Gate Reviews
• Probability of Program Success (POPS)
• OSD OIPTs and DABs
• Joint Strike Fighter TE Review Team
• TE Executive interaction
• Inside/outside Navy

7
Navy Enterprise TE BoD
SECNAVINST 3900.44

• Major Responsibilities
• Enable the Navy Enterprise
• Develop corporate priorities
• Identify and oversee continuous
• process improvement
• Assure efficiency / effectiveness

DON TE Executive COMOPTEVFOR (Co-chairs)
OPNAV (N1, N6, N8, N4, N091)
NAVSEA
NAVAIR
Fleet Forces Command, Warfare Enterprise
Representative
SPAWAR
MCSC
Navy TE BoD Working Groups
PEO TE Forum Chair
MCOTEA
PEO TE Forum
A Navy Unique TE Integrating Activity
8
Navy TE BoD Strategic Issues

• Competitive Prototyping
• Open Architecture
• Rapid Acquisition
• Major Deficiency Disposition
• Major Def. Outside POR
• DoN TE Annual Report
• Relevance of TE
• TE WIPT Effectiveness

• TE Competency
• MS for E2E Testing
• Enterprise Testing
• Infrastructure Management
• Test in Joint Environment
• TE Assets Availability
• Requirements Testability
• Net Ready KPP

Derived from inputs throughout the TE and
Acquisition Community
Addressed in following slides
9
2 Pass 6 Gate Review Process

• Used by ASN RDA to assess health of major
  programs, determine program performance and
  readiness for OIPTs, DABs, etc.
• TE criteria and Major Deficiencies review
  enhanced for POPS V2.0
• Future Gate 7 to further track status of TE
  Major Deficiencies

Future
Current
Will Use Gate Reviews for Major Deficiency
Disposition
10
Integrated Testing Enhances the Relevance of TE
Goal Integrated Testing and early TE involvement
Issue Implementation will take commitment and
time
High
Low
Moderate
Spectrum of TE Integration in Programs

• Dedicated DT/OT
• Very little test integration
• DT/OT events separate
• OTA held at arms length
• Separate IOTE (large scope)

• Integrated Testing
• Early OTA involvement and planning
• Integrated Test Team (ITT)
• Mission-Based DT and OT Framework
• Continuum of concurrent CT/DT/OT
• Operational realism in early tests
• IT data used to support COI resolution
• Integrated Test Matrix / All data shared
• Configuration tracked in IT database
• Four Part TEMP (with IT events)
• Integrated Test Schedule
• Pedigree of data
• Separate IOTE (reduced scope)

• Combined DT/OT
• Could have early OTA involvement
• DT and OT testers share test events, share
  assets and data
• Some data shared but limited
• Five Part TEMP (no IT events)
• Separate IOTE

• DT Assist
• DT with active involvement of OTA
• Could have early OTA involvement
• Some DT/OT data shared but limited
• Five Part TEMP (no IT events)
• Separate IOTE

11
TE Competency
TE Workforce Status
TE Focused Training
Size and balance of TE workforce in review
Navy Integrated Testing Workshop, July 2009
Washington Liaison Office, Crystal City,
VA Attendees COTF, NAVSEA, NAVAIR, SPAWAR,
MARCOR, MCOTEA, N912, ASN RDA TE, TE Managers
from PEOs
TE Continuing Education

• TE University
• Starting at NAVAIR
• Expand to other SYSCOMs
• Will address TE theory and practice

12
Infrastructure Management
Navy MRTFB
Nanoose Dabob Bay Keyport, WA Subsurfac Systems
Atlantic Test Range Patuxent River, MD Aircraft
Systems
Sea Range Point Mugu, CA Surface Weapons
Atlantic Undersea Test and Evaluation Center
Andros Island, Bahamas Antisubmarine
Undersea Warfare
Pacific Missile Range Facility Barking Sands,
HI Air and Surface Weapons
Land Range China Lake, CA Air Weapons

• Current Issues
• Navy TE resourcing not immune to DoD budget
  reductions
• Reduction of TE resource inefficiencies and
  critical gaps
• Tri-Service Reliance Revitalization improved
  roadmaps
• Working with OUSD-DTE, DOTE, TRMC, other
  Services
• Better use of CTEIP/REP/TE ST funding
• Increased environmental pressures and potential
  restrictions
• At-sea testing acoustics mammals, oil
  exploration for energy
• On-land testing windmills for energy, comm
  frequencies
• New Technology Hypersonics, Directed Energy,
  System of Systems

13
WSARA 2009

• Summary of TE Issues
• Many MDAPs over budget, behind schedule and dont
  meet requirements
• DTE cited as a culprit
• Many systems not ready for IOTE
• Failures result in program delays, increased cost
  and delayed fielding
• Better DTE needed

DTE Improvements Needed

• Other Areas Involved
• Improved integration of System Engineering (SE)
  and TE needed
• TE supports SE by providing validation of the
  design
• SEPs and TEMPs not well coordinated in the past
• How can SE better support TE?
• DASN CHSENG working SE issue with ASN RDA TE
  support

• Ongoing Efforts
• Navy completing its TE personnel self assessment
  report
• Data call to SYSCOM TE Offices
• Access DTE personnel and status
• Numbers and TE certifications
• Other types of personnel involved
• Requirements, test plans and test execution
• Report and brief to DDTE

14
Summary and Conclusions

• Deputy DoN TE Executive office is up, running
  and engaged on major issues
• Working strategic issues to enhance TE
  efficiency and effectiveness
• Involved with acquisition reform initiatives in
  support of ASN RDA
• Early involvement, integration of efforts and
  communication is the key to success in Navy TE
  for the future
• Looking to increase partnership opportunities
  across Navy/MARCOR enterprise, other Services,
  Joint community and Industry