A Case study: Automated Testing of X-Lite SIP Softphone

Already some while ago we made a joint case study with Conformiq Inc. to show an end-to-end testing automation in TTCN-3 environment using Conformiq Qtronic™ and Elvior MessageMagic. As we have not posted it here yet, we will give a short overview of it and provide a full link to the case study. 

Executive Summary

TTCN-3 (Test and Test Control Notation version 3) is a programming language for developing tests in telecommunications domain. SIP (Session Initiation Protocol) is a key protocol standard in the modern convergent telecommunications systems. UML (Unified Modeling Language) is one of the most widely used modeling notations for describing requirements and design beyond natural language. Conformiq Qtronic is a tool for generating executable tests automatically from high-level system models, developed by Conformiq Inc. MessageMagic is a TTCN-3 test development and execution platform developed by Elvior Ltd.

This case study demonstrates how model-based testing approach can be applied in TTCN-3 environment to achieve full testing automation, from test design to test execution. Using commercial tools for automated test design such as Conformiq Qtronic and Elvior MessageMagic for automatic execution of these test cases, TTCN-3 driven test environment can now take full advantage of end-to-end test automation.
We tested a publicly available SIP softphone, X-Lite from CounterPath, using TTCN-3 as testing language. The testing involved automatically generating TTCN-3 test cases using Conformiq Qtronic and executing those test cases using MessageMagic.

We started by creating a system model, based on SIP specifications, in UML and Java compatible notation action language. This model is required by Conformiq Qtronic in order to automatically generate TTCN-3 test suite. Then we implemented a system adapter, needed to connect MessageMagic TTCN-3 execution environment to CounterPath’s X-Lite softphone, and executed this test suite against the X-Lite softphone using MessageMagic.

Keywords: Model-Based Testing, TTCN-3, SIP, UML, Automated Test Design