User Acceptance Testing (UAT)

1
User Acceptance Testing (UAT)
Presentation
COMP 8130 Verification and Validation

1. Agus Pudjijono (u4367126)
2. Irwan Krisna (u4485658)
3. Ricky Prajoyo (u4444434)

2
Definition

• Acceptance testing is a user-run test that
  demonstrates the applications ability to meet
  the original business objectives and system
  requirements and usually consists of a subset of
  system tests.
• Source Wiilliam E. Lewis , Software Testing
  and Continuous Quality Improvement, 2nd
  edition,2005
• acceptance testing certifies that the software
  system satisfies the original requirements.
• Source Wiilliam E Lewis , Software Testing and
  Continuous Quality Improvement, 2nd edition,
  2005
• Acceptance testing is defined as that testing,
  which when completed successfully, will result in
  the customer accepting the software and giving us
  their money.
• Source Lee Copeland , A Practitioners guide
  to Software Test Design, 2004

COMP8130 VV - User Acceptance Test (UAT) 2-17
3
Definition ( cont..)

• We have identified several keywords related to
  UAT
• final step before rolling out the application,
• final stage of testing in application,
• fitness purposes,
• meet acceptance criteria,
• meet the original business objectives and system
  requirements.
• readiness for operational use.
• Therefore, we conclude that the User Acceptance
  Testing is
• A final testing phase that is conducted
  during the life cycle of software development, in
  order to determine whether the developed system
  meets the agreed requirements and to evaluate the
  readiness for operational use .

COMP8130 VV - User Acceptance Test (UAT) 3-17
4
Testing Types
Software Testing and Continuous Quality
Improvement, Wiilliam E Lewis
COMP8130 VV - User Acceptance Test (UAT) 4-17
5
The Use of UAT

• It is performed after the software has
  successfully completed systems testing
• A formal UAT is not compulsory, when the end
  users are satisfied with the other system tests
  and have been involved continuously throughout
  the development lifecycle (implicitly conduct
  acceptance test)

COMP8130 VV - User Acceptance Test (UAT) 5-17
6
UAT Activities

• Some steps when doing the UAT
• User Acceptance Test Planning
• Designing UAT Test Cases
• Review/Approve Acceptance Test Plan
• Executing Test Cases
• Documenting the defects found during UAT
• Resolving the Defects Fixing
• Sign Off

COMP8130 VV - User Acceptance Test (UAT) 6-17
7
UAT Deliverables

• Test plan - outlines the testing strategy
  (Acceptance Testing, Entry and Fail Criteria,
  Test Execution Team, Test Script Developer)
• Test cases - guides the team to effectively test
  the application
• Test Log - records all the test cases executed
  and the actual results
• User Sign Off - indicates that the customer are
  satisfied with the product.

COMP8130 VV - User Acceptance Test (UAT) 7-17
8
UAT Methodologies

• Structured testing
• Conducted based on the test plan and test
  procedures.
• It consists various tests against agreed
  requirements.
• Unstructured testing
• A test that is conducted by not referring to the
  test plan
• It is a free form test which tests the software
  with the idea of breaking it.

COMP8130 VV - User Acceptance Test (UAT) 8-17
9
Structured Testing

• Advantages
• written statements of expected behaviour
• provides repeatability
• cost effective technique to deliver a high
  quality of product
• a risk mitigation strategy
• Disadvantages
• testing coverage limitation
• requires more efforts and expense during the
  preparation testing executions

COMP8130 VV - User Acceptance Test (UAT) 9-17
10
Unstructured Testing

• Advantages
• Flexibility in detecting system anomalies
• it does not require much effort on the
  preparation phase of testing
• Disadvantages
• In general,errors could not be reproduced
• difficult to measure the success criteria of the
  testing activity
• test coverage is unknown

COMP8130 VV - User Acceptance Test (UAT) 10-17
11
UAT Team Members

• Team Leader
• Test Analyst
• User Representative
• Testers
• Test Observers

COMP8130 VV - User Acceptance Test (UAT) 11-17
12
Issues of UAT Management

• Insufficient number of testers
• Inexperienced user representative
• Incompetent Testers

COMP8130 VV - User Acceptance Test (UAT) 12-17
13
Types of User Acceptance Tester

• Ideal User acceptance Tester
• Background
• Has the experience of user operations and in the
  use of IT facilities, independent thinker
• Skills
• good communicator, need to expect system to fail
• Independence
• not involved in the IT project and also in the
  user specifications, need to be a self-starter.
• Attitude
• need to be an optimistic thinker, neutral, need
  to be analytical.
• Availability
• Fully dedicated in doing the Tests

COMP8130 VV - User Acceptance Test (UAT) 13-17
14
Types of User Acceptance Tester ( Cont..)

• Typical User Acceptance Tester
• Background
• Involved in the IT project and also in the user
  specifications
• Skills
• Non technical and technical persons
• Attitude
• Pragmatic
• Availability
• Testing is not the main job

COMP8130 VV - User Acceptance Test (UAT) 14-17
15
Reasons why it is not possible to find Ideal User
acceptance tester

• Lack of Software Project Management Knowledge
• Not always possible to have independent User
  Acceptance testers
• Generally, testing is not their main job
• Too busy with operational activities

COMP8130 VV - User Acceptance Test (UAT) 15-17
16
Rules of Thumb for UAT

• Teamwork is essential
• We are not good at finding errors in our own work
• A successful test is one that finds errors
• Define testing criteria when defining business
  requirements
• Detachment - during development testers can look
  but not touch (review only)
• Not everyone does testing well
• Its almost never right at the first time

COMP8130 VV - User Acceptance Test (UAT) 16-17
17
Summary

• The user acceptance test as the last testing
  phase process is important to evaluate the
  software deliverable against the users
  requirements.
• When customers have already involved in
  development activities and implicitly
  implementing acceptance test, UAT is not a
  compulsory step to accomplish. However if we
  conduct UAT, this will take satisfaction in
  product deliverable for both of user and vendor
• There are several phases in conducting user
  acceptance test activities, such as planning,
  designing test cases, forming a testing team,
  executing test cases, documenting defects,
  resolving the issues, and signing off the test.
  
• Moreover, UAT can be conducted either in
  structured or unstructured ways.
• For several reasons, it is not possible to have
  ideal User Acceptance tester

COMP8130 VV - User Acceptance Test (UAT) 17-17
18

• Thank You