SilkPerformer Lite Positioning

1
SilkPerformer Lite Positioning

• Segue Product ManagementKlaus Fellner
  klaus_at_segue.at
• October 20, 2003

2
The Cost of Software Bugs

• 59.5 billion annually to the U.S economy
• Increasing complexity and decreasing product life
  expectancy intensified costs of errors
• 80 of development costs go into bug fixing
• Over half the costs are borne by end users
• The average cost of unplanned downtime for a
  mission-critical application is 100,000 per hour

Austrian Banks Jan 2002 Conversion to Euro
created larger than anticipated cash
demand Cause Insufficient testing Cost
Embarrassment to government loss of trust in
banking system
World Cup Soccer Sites 2 weeks in June 2002 Site
outages Cause Inadequate performance and
capacity planning Cost Lost opportunity to
convert non-sophisticated users
A third of these costs could be eliminated by
improved testing
Source NIST and Gartner studies
3
When Is Load and Stress Testing Needed?

• Analyzing an applications quality of service--
  prior to its launch
• Performance (response times)
• Scalability (throughput)
• Reliability (availability over time)

• Load testing answers critical questions
• What is the best architecture to support the
  expected load?
• What is the appropriate software and hardware?
• How can I tune my applications before going live?
  
• Where are the bottlenecks in my multi-tier
  environment?
• How can I avoid errors that usually only occur
  under load?
• Will users get acceptable response times, even at
  peak hours?
• Will the application meet defined service levels?
• What system capacity is needed to handle the
  expected load?
• Is my application ready for full deployment

4
Manual Testing is Problematic
Difficult to synchronize
Go!
ResultAnalysis?

• Resource intensive
• Testing staff
• Client computers

Coordinator
Internet
Repeatability?
Tester
System Under Test
5
Automated Testing SilkPerformer Lite
Most accurate, cost-effcient, and easy to use
load and stress testing tool for Web applications

• Maximize uptime with end-to-end testing of
  HTTP(S)/HTML applications with up to 100 VUs
• Create realistic test scenarios quickly easily
• Ensures meaningful test results with unmatched
  accuracy
• Accelerate problem resolution with rapid
  root-cause analysis
• Take the affordable cost-effective approach
• Protect your investment

6
End-to-End Reliability Testing
Test dynamic load conditions with up to 100 VUs
Analyze scalability reliability of back-end
servers
SystemUnder Test
Analyze reliability from the VU perspective
SilkPerformer Lite Controller
Analyze Performance from the VU perspective
7
Easily Create Realistic Test Scenarios
Web Browser
SilkPerformer Script Recorder
Web Server
Manual scripting available for power users
No manual programmingrequired
Script
Client
Server
8
Built-In Guidance Simplifies Usage
Guides you through each step of your testing
process
9
Reliable Results Trough Unrivaled Accuracy

• Accurate load simulation
• Correctly simulate connection behavior, cookie
  management and caching strategies of real
  browsers
• True cache technology guarantees realistic
  simulation for returning Web users
• TrueModem technology correctly simulates multiple
  connection speeds through continuous throttling
• Health monitors protect from overloading the test
  agent
• Accurate error detection
• Verification Under Load detects all kinds of
  application errors in addition to system errors
• Realistic workload models
• Tests Web apps under real world load conditions

10
Accuracy TrueCache Technology
Without cache
200
SilkPerformer TrueCache Technology
150
Real user
100
HTTP hits on server
50
Cache not emulating conditional requests
0
25
50
75
0
100
Percentage of users who visit Web site more than
once
11
Rapid Root Cause Analysis

• In-depth analysis for uncovering a problems root
  cause
• Correlate end-user and system performance metrics
• Visual click path to analyze error situations
  from the virtual users perspective (TrueLog On
  Error)
• Page break down for analyzing slow page download
  times
• Accelerate problem resolution with accurate and
  comprehensive test results in real time
• Especially important for tuning activities
• Quickly interpret test results through a Web
  based management report
• Easy to share, customize and reuse
• Enables results interpretation by non-technical
  decision makers

12
Overview Report TrueLog On Error
Request header exactly shows the user input data
13
Web Page Break Down
What kind of components take up the most time?
How long does the server need to build the page?
Find out the reasons why thresholds have not
been met
Analyze caching efficiency
Is the image size appropriate?
Is there a bottleneck at the application server?
Availableacross all useres or for errornous
users only
14
Cost Efficiency

• SilkPerformer Lite is derived directly from the
  enterprise-class tool SilkPerformer
• Same code base and setup
• Same tool just different licenses
• Inherits the power of SilkPerformers TrueScale
  Engine
• Requires only a single standard computer to run
  large, complex 100 VU load tests
• Significantly reduces the costs of your testing
  infrastructure
• Allows smooth migration to SilkPerformer
• Leverage your existing test scripts and tool
  knowledge
• Scale up to a greater number of VUs
• Load test non-Web applications

15
Return On Investments

• Maximize the quality and performance of Web
  applications before they go live quickly,
  easily, and affordably!
• Find the root cause of performance bottlenecks
  and system failures for rapid resolution
• Test against service levels to ensure a positive
  user experience and meet Service Level Agreements
  in production
• Minimize hardware and software costs by
  accurately predicting system capacity
• Offload your technical staff by capitalizing on
  SilkPerformer Lites intuitive visual technology
  and delegating load tests to non-programmers
• Gain confidence in your Web applications
• Ensure a smooth migration path to SilkPerformer
  for enterprise-class load testing

16
Thank You! Questions and Answers