StarTrinity.comMeasuring quality |
Basic steps to run a simple active SIP stress test using graphical user interface (GUI) are:
Alternatively you can use command line interface (CLI) with .bat scripts or windows service mode (StarTrinity.SIPTester.Service.install.bat) with Web API to run automated tests
The program is installed with web installer which copies program files into
specified directory. Multiple instances can be installed to multiple directories on same server, each instance having different SIP and HTTP ports.
This directory is also used to store settings, backups, CallXML scripts, recordings, logs, .pcap and CDR files.
SIP Tester can be installed on any Windows OS. It needs .NET Framework and
winpcap library to be installed.
Windows Server is preferred over Windows 7 or Windows XP because it allows much better performance of UDP/IP stack.
Also, real servers or laptops are preferred over virtual machines. A virtual machine may have poor performance and have delays in NIC drivers.
You can find more details about SIP Tester's performance here.
The SIP Tester is able to run as Windows Service - run in background with web interface, start automatically with Windows. To set up it as Windows Service, run StarTrinity.SIPTester.Service.install.bat, to uninstall service - StarTrinity.SIPTester.Service.uninstall.bat
SIP Tester simulates multiple SIP user agents (SIP softphones, IP PBX extensions) by sending multiple SIP REGISTER messages to destination server(s). The REGISTER messages are sent on startup, on change of parameters, and re-sent on registration timer expiry. UAC registration settings are configured on this screen:
SIP Tester simulates SIP server (IP PBX) by accepting multiple SIP REGISTER messages from SIP phones (extensions). The registered contact addresses of the extensions can be accessed in CallXML script via substitution $ext(x); UAS registration settings are configured on this screen:
SIP tester acts like a stress call generator. It has a timer which triggers execution of CallXML script. A default pre-installed script generates a call to specified destination(s), plays WAV file and aborts call. The parameters are configured on this screen:
The SIP Tester is able to receive multiple SIP calls and simulate IVR servers by executing CallXML script. A default pre-installed script makes a delay, accepts or rejects a call, plays a WAV file and aborts the call within specified period of time. The script is wrapped into user-friendly GUI which is configured is same way as script for outgoing calls
This screen displays SIP calls which are still in progress and which have been in progress recently. The screen dynamically updates itself so it is possible to monitor current status of test. Call-ID column shows SIP messages' trace which is also dynamically updated. Description of columns is here
This screen displays audio quality measurements for calls which are still in progress and which have been in progress recently. Description of columns is here
Caller CDR fields contain information about RTP stream which comes from call initiator (origination side). Called CDR fields contain information about RTP stream which comes from destination (termination side). For Caller fields measured at origination side it means self-checking of the software: it checks by winpcap libraries whether UDP packets are really transmitted using winsockets sendto() function.
The CDR data could be saved to your database via ODBC driver. Format of connection string is: Driver={SQL Server};Server=localhost\SQLEXPRESS;Database=TestCDR;Uid=xx;Pwd=yyy; Default name of table is "StarTrinitySipTesterCdrs", it is configurable in settings. If table does not exist or if a column is missing, the software automatically creates the table or inserts the missing column.This screen displays completed calls ordered by quality indicators, it has same fields as CDR report.
Clicking button for each quality indicator opens popup window with history and histogram chart of the indicator:
The screen also contains a button "Save to HTML file", with option to save history charts. Here is example of exported HTML report. Reported DOM elements have unique IDs for additional HTML processing with javascript.Indicator | Green (good) value | Red (bad) value | Yellow value |
---|---|---|---|
Packet loss | 0% | 1.5% | |
G.107 MOS | 3.8 | 1.0 | |
G.107 R-factor | 75 | 5 | |
Max RTP delta | 40ms | 290ms | |
Max RFC3550 jitter | 0ms | 50ms | |
Mean RFC3550 jitter | 0ms | 25ms | |
SDP-RTP delay | 0ms | 5000ms | |
100 response delay | 0ms | 5000ms | |
Answer delay | 0ms | N/A | 10000ms |
-24dB delay | 0ms | N/A | 10000ms |
RTCP RTT | 0ms | 500ms | |
Media threads delay | 0ms | 150ms | |
Signaling thread delay | 0ms | 5000ms | |
GUI thread delay | 0ms | 5000ms |
Shows distribution of call quality and call load, demonstrates load capacity of VoIP system.
The points on chart represent each step in "stepwise testing". To generate the performance chart with the lines of percentiles you need to do this:
Executes stress test by automatic incrementing number of concurrent calls. Is used to discover dependency between call load and call quality
This screen is used to do some operations with current calls by clicking buttons manually.
This screen is used to simulate SIP and RTP packet loss, RTP jitter, also simulate unexpected loss of connectivity or crash of SIP trunk by terminating SIP Tester.
This screen is used to configure various settings and operation modes.
This screen is used for detailed control of the program's execution. You can insert log elements in your CalXML script and monitor its execution in real time through the log. Show log files link opens a directory with log files. The files contain debugging information; by default error logs and GUI activity reports are sent to StarTrinity developers via encrypted channel. If you want to disable error reports, please set "DisableAnonymousReports" = "1" in settings tab.
This screen displays information about license for current installation. For information about prices please contact sales manager by email.
The SIP tester has a command line interface which is available with StarTrinity.SIPTester.CLI.exe.
This executable runs in command prompt, it has following parameters:
(if a parameter is not specified, it is taken from XML settings file)