Enterprise JavaBeans EJB Architecture ScalabilityLoad Test

1
Enterprise JavaBeans (EJB) Architecture
Scalability/Load Test

• Ted Osborne
• tosborne_at_rswsoftware.com
• RSW Software, Inc.
• www.rswsoftware.com

2
Agenda

• The Current Landscape Performance Testing EJBs
• Example Case Study using EJB-test
• Survey EJB Performance Test Strategies
  Techniques

3
Performance Testing EJBs
Presentation tier
Data tier
Middle tier
web client
EJB server
web server
database server
web client
web client
client
client
client
4
Our "OrderEntry" Example
WebLogic 5.1.0 EJB server
Cloudscape database server
ltltrequestsgtgt
ltltresponsesgtgt
5
EJB-test

• Strategy
• Create Java driver "client" for EJB under test
• Goal time method requests on EJB's interface
  (business methods)
• Automate code generation through Java Reflection
  API EJB code patterns
• Simulate load using that client
• Run the client in multithreaded load generator
• Map in data from tables (or use generated data)
• Aggregate log data
• Response times
• Exceptions
• Data actual vs. expected

6
Select the EJB to be tested from the Jars in your
classpath
7
EJB-test automatically generates a Java Test
Client specific to the selected EJB and optimized
for WebLogic or WebSphere
8
The automatically generated Java Test Client
times the method calls to the selected EJB
9
Define the load to execute and run the test.
10
Select the results to view
11
Select the response time data to view
12
Compare 2 test executions
13
OEVendor vs. OELoad

• A simple response time comparison reveals which
  bean is the bottleneck
• Potential sources of bottleneck
• Design
• Deployment
• Environment

14
Comparing EJB Deployments
OEProduct ejb-jar.xml37 lttrans-attributegtSup
ports OEVendor ejb-jar.xml37
lttrans-attributegtRequired weblogic-cmp-rdbms-jar.x
ml29 lttransaction-isolationgtTRANSACTION_SERI
ALIZABLE
15
Strategies Techniques

• Load Testing
• Data-driven Load Testing
• Multithreaded Multi-JVM Loads
• Distributed Load Testing
• Scenario (Multi-bean) Testing
• Other Interesting EJB Tests

16
EJB Load Testing

• Objective
• Measure EJB's ability to server increasing number
  of client requests
• Most Common Metrics
• Transactions per Second (TPS)throughput
• Response timeclient-side
• Other Interesting Metrics
• Error rate (exceptions)
• Correctness (expected vs. actual values)
• Method-level response times

17
Data-driven EJB Load Testing

• Objective
• Test EJBs with realistic data sets
• Approach
• Particular data combinations often comprise a
  "use-case"
• Data set triggers business rules or call graphs
  of interest
• Automation Leverage Data from CSV "maps" into a
  static client driver
• Hurdles
• Marrying clients to data sets

18
EJB Load Testing System Topology
19
Multithreaded Multi-JVM Load Generation

• Objective
• Better simulation of load
• Approach
• Multithreaded load generation simulates a
  multi-client load (concurrent requests)
• Dividing load across JVMs creates multiple socket
  connections to server
• Hurdles
• Thread safety execution coordination

20
Distributed Load Testing

• Objective
• Generate a load simulation that is large enough
• Approach
• Distribute client JVMs across multiple machines
• Hurdles
• Still have thread safety and client coordination
• Aggregating result logs
• Client execution environment

21
Distributed Load Testing Nirvana
22
Other Interesting EJB Tests

• Stress Testing
• Mixed/Randomized Loads
• Scenario Testing
• Security Testing
• Configuration Testing

23
Anatomy of an EJB Test Client Driver
24
Anatomy of an EJB Test Client Driver
25
(No Transcript)