Title: SIP Testing Methodology
1 Elie Cohen ProLab PM 17/01/2003
SIP Testing Methodology
2Agenda
- SIP Testing Overview
- SIP Test Topology
- SIP Server and SIP User Agent Testing
- Building a Practical SIP Testing Environment
- ProLab TestManagement Suite
3SIP Testing OverviewRequirement
4The Importance of Early Bug Detection
- Early detection of software and hardware defects
is crucial for mainlining development costs low
Test early Test often
Cost of bug fixes
Software Cycle
5SIP Testing System Challenges
- Minimize testing time improve time-to-market
- Testing throughout the development cycle
- Perform comprehensive testing
- Load and stress
- Protocol compliance
- Error conditions
- Network simulation
- Test both signaling and media
6SIP Testing System Challenges
(cont.)
- Flexibility to change tests as needed
- Change test parameters quickly
- Change test topology
- Ease-of-use for developers and QA engineers
- Full network simulation
- One or more endpoints SIP User agent
- Simulate Full SIP Server application
- RTP Network Simulation
- Varying network topology
7SIP Testing System Challenges
(cont.)
- High performance and scalability
- Generate very high rates of calls/transactions
per second - Standards compliant
- Based on SIP RFC3261 for User agent
8SIP Test Topology
9SIP Test Environment
- Simulates an endpoint capable of handling
thousands of calls
Scenario
SIP protocol
Test results
IP
System Under Test
Test results
SIP protocol
Scenario
10SIP Functional Test Topology
IP
11SIP Stress Test Topology
- Verify that the system performs under extreme
conditions and test to see that system can handle
intended load
IP
DUT
12SIP Server and User Agent Testing
13SIP Server Functional Test Topics
- Proxy testing
- Request and response forwarding
- State full and Stateless
- Reject responses (Forwarding, registration)
- Server functionality routing with address
resolution (forking) loose routing - Redirect Server Functionality Returns Contact
this address response - Message Validation and Invalid response handling
- Record route
- Outbound proxy
14SIP Server Performance Metrics
- SIP servers typically need to handle high
transaction rates - Transactions statistics
- Total Transactions per second
- Total Transactions Capacity
- Transactions failed per second
- Percentage Transactions rejected
- Calls statistics
- Calls requested per second
- Calls Connected per second
- Call establishment time (call setup delay)
15SIP Server Performance Metrics
(cont.)
- Registration statistics
- Total Registrations per second
- Percentage Registrations rejected
- Registrations requested per second
- Registrations confirm per second
16SIP Server Registrar Test
- Registrar location database
- Different types of expiration
- Different type of TO header
- Registration with other contact
- Unregistration (expires0)
- Update existing registration
- Registration with multiple contact
- Multiple registration
17SIP Server Registrar Test
(cont.)
- Security
- Authentication header
- Different type of nonce and Realm
- Existing and non existing user
- User expired
18High Volume of Concurrent Calls
- Capability to send and receive thousands of
concurrent calls from single or multiple
endpoints - Capability to simulate thousands of media calls
simultaneously - Capability to send thousands of concurrent
registrations to an SIP Server - Capability to simulate different scenarios
simultaneously
19SIP Stress Method Testing
- Burst Testing (multiple invite simultaneous)
- Poisson Call distribution
- Poisson Call duration
- Constant Call distribution (X Calls per second)
- Constant call duration
- Load testing
- Stress Test using only signaling
- Stress Test using signaling and media
20SIP User Agent Testing
- Methods (invite,re-invite, cancel, bye, info,
notify, subscribe, options, re-invite, refer , ) - Retransmission mechanism
- Provisional response
- Register and authentication
- Add contact to register
- Timer configuration
- Atypical testing
- SIP Parsing coding and decoding headers
- Non standard message
- Call Flow - State Machine
- Reject response handling
- Multipart mime
- Body message
- SIP headers test
- TCP UDP Interface
21SDP Packet
- Session information
- Session name and purpose.
- Time(s) the session is active.
- Media information
- Type of media, such as video and audio. Transport
protocol, such as RTP/UDP/IP and H.320. Media
format, such as H.261 video and MPEG video. - SDP With different type of Media information
- SDP with Telephone-event
- Different Type of SDP
22Response Message
- RESPONSE TYPES
- Provisional (1xx class)provisional responses are
used by the server to indicate progress, but they
do not terminate SIP transactions - Final (2xx, 3xx, 4xx, 5xx, 6xx classes)final
responses terminate SIP transactions.
- CLASSES
- 1xx provisional, searching, ringing, queuing
etc. - 2xx success
- 3xx redirection, forwarding
- 4xx request failure (client mistakes)
- 5xx server failures
- 6xx global failure (busy, refusal,not
available anywhere)
23Advanced RTP Testing
- RTP Simulation
- Packet loss , Duplicate Packets , Packets
ordering - Corrupted packet SSRC Corrupted
- Delay, Jitter
- Stop Sending RTP and resume.
- DTMF in band and RFC 2833, DTMF in band
24Advanced RTP Testing
(cont.)
- RTP Monitoring and statistics
- Packet loss and Packet distribution (sender
receiver) - RTP General information (Payload, low seq ,High
Seq , SSRC, UDP, ) - Different Codecs G711, g728, G729, G722, G723.1,
H261, H263,. - RTCP
- Jitter, Cumulative lost , fractional lost,
25Building a Practical SIP Testing Environment
26SIP Testing Environment
User Agent Client 1..X
Test Management
SIP Server
SIP Server
IP
Device Under Test
User Agent Server 1..X
Media Testing
27Testing Lab Components
- Test Management
- Script and configuration Management (typical and
Atypical) - Control Test Execution (Saving result,
Notification ) - Test Scheduling ( Test Scheduler, Compare test
result) - SIP Server
- Full SIP Server Simulation (Proxy, Registrar,
Location DB, Authentication) - Positive and negative response
- Multi SIP Server
28Testing Lab Components
(cont.)
- SIP User Agent Client/Server P Server
- Simulation UAC and UAS
- Media Testing
- Full Media Network simulation and media monitoring
29ProLab Test Management Suite
30ProLab Test Management Suite
ProLab Test Manager
ProLab SIP Server Agent
ProLab SIP Test Agent
ProLab Gatekeeper Agent
ProLab H.323 Test Agent
ProLab RTP Analyzer
ProLab Test Scheduler
Voice and Video Over IP Complete Test Solution
31ProLab Advantage
- Full Network simulation (SIP UAC/UAS, SIP Server
, Advanced RTP and full automation) - Closely synchronized with protocol updates
- Distributed Solution
- SIP H.323 Advanced Testing
- Script Driven
- Script Result management
- High performance and volume of calls
32ProLab Application
33Summary
- Testing Media Signaling over IP is typically
complicated and costly if not done thoroughly - Cost effective for Media over IP
- Script-driven is highly flexible and good
solution for full automation - Numerous powerful testing capabilities for both
SIP UAC/UAS, SIP Server, SDP and RTP. - Full SIP Network Simulation
34Thank You
Booth 1 RADVISION www.radvision.com elic_at_radvisio
n.com