ETSI TS 186 025-4 V2.1.1 (2011-07)

Telecommunications and Internet Converged Services and Protocols for Advanced Networking (TISPAN); IMS/PES Performance Benchmark; Part 4: Reference Load network quality parameters

DTS/TISPAN-06053-4-NGN-R2

General Information

• Status: Published
• Publication Date: 28-Jul-2011
• Technical Committee: TISPAN 6 - TISPAN Testing
• Current Stage: 12 - Completion
• Due Date: 05-Aug-2011
• Completion Date: 29-Jul-2011

Standards Content (Sample)

Technical Specification
Telecommunications and Internet converged Services and
Protocols for Advanced Networking (TISPAN);
IMS/PES Performance Benchmark;
Part 4: Reference Load network quality parameters

2 ETSI TS 186 025-4 V2.1.1 (2011-07)

Reference
DTS/TISPAN-06053-4-NGN-R2
Keywords
IMS, performance, service
ETSI
650 Route des Lucioles
F-06921 Sophia Antipolis Cedex - FRANCE

Tel.: [phone] Fax: [phone]

Siret N° 348 623 562 00017 - NAF 742 C
Association à but non lucratif enregistrée à la
Sous-Préfecture de Grasse (06) N° 7803/88

Important notice
Individual copies of the present document can be downloaded from:
http://www.etsi.org
The present document may be made available in more than one electronic version or in print. In any case of existing or
perceived difference in contents between such versions, the reference version is the Portable Document Format (PDF).
In case of dispute, the reference shall be the printing on ETSI printers of the PDF version kept on a specific network drive
within ETSI Secretariat.
Users of the present document should be aware that the document may be subject to revision or change of status.
Information on the current status of this and other ETSI documents is available at
http://portal.etsi.org/tb/status/status.asp
If you find errors in the present document, please send your comment to one of the following services:
http://portal.etsi.org/chaircor/ETSI_support.asp
Copyright Notification
No part may be reproduced except as authorized by written permission.
The copyright and the foregoing restriction extend to reproduction in all media.

© European Telecommunications Standards Institute 2011.
All rights reserved.
TM TM TM
DECT , PLUGTESTS , UMTS and the ETSI logo are Trade Marks of ETSI registered for the benefit of its Members.
TM
3GPP and LTE™ are Trade Marks of ETSI registered for the benefit of its Members and
of the 3GPP Organizational Partners.
GSM® and the GSM logo are Trade Marks registered and owned by the GSM Association.
ETSI
3 ETSI TS 186 025-4 V2.1.1 (2011-07)
Contents
Intellectual Property Rights . 4
Foreword . 4
1 Scope . 5
2 References . 5
2.1 Normative references . 5
2.2 Informative references . 5
3 Definitions and abbreviations . 6
3.1 Definitions . 6
3.2 Abbreviations . 7
4 Metrics and design objectives . 7
4.1 Delay probability - non-ISDN or mixed (ISDN - non-ISDN) environment . 7
4.2 Call processing performance objectives . 24
4.2.1 Premature release . 24
4.2.2 Release failure . 24
4.2.3 Incorrect charging or accounting . 24
4.2.4 Misrouting. 24
4.2.5 No tone . 24
4.2.6 Other failures . 24
4.3 Transmission performance . 24
4.3.1 64 kbit/s switched connections . 24
4.4 Slip rate . 25
4.4.1 Normal conditions . 25
4.4.2 Temporary loss of timing control . 25
4.4.3 Abnormal conditions at the exchange input . 25
History . 26

ETSI
4 ETSI TS 186 025-4 V2.1.1 (2011-07)
Intellectual Property Rights
IPRs essential or potentially essential to the present document may have been declared to ETSI. The information
pertaining to these essential IPRs, if any, is publicly available for ETSI members and non-members, and can be found
in ETSI SR 000 314: "Intellectual Property Rights (IPRs); Essential, or potentially Essential, IPRs notified to ETSI in
respect of ETSI standards", which is available from the ETSI Secretariat. Latest updates are available on the ETSI Web
server (http://ipr.etsi.org).
Pursuant to the ETSI IPR Policy, no investigation, including IPR searches, has been carried out by ETSI. No guarantee
can be given as to the existence of other IPRs not referenced in ETSI SR 000 314 (or the updates on the ETSI Web
server) which are, or may be, or may become, essential to the present document.
Foreword
This Technical Specification (TS) has been produced by ETSI Technical Committee Telecommunications and Internet
converged Services and Protocols for Advanced Networking (TISPAN).
The present document is part 4 of a multi-part deliverable covering the IMS/NGN Performance Benchmark, as
identified below:
Part 1: "Core Concepts";
Part 2: "Subsystem Configurations and Benchmarks";
Part 3: "Traffic Sets and Traffic Profiles";
Part 4: "Reference Load network quality parameters".
ETSI
5 ETSI TS 186 025-4 V2.1.1 (2011-07)
1 Scope
The present document is for an initial release of a PSTN/ISDN Emulation Sub-system (PES) performance benchmark.
The same tests can be used also for legacy PSTN/ISDN networks or for inter-working tests between PSTN/ISDN
emulation subsystem and legacy PSTN and ISDN. The metrics measured and reported are for performance of this
subsystem under a communications application load.
The present document is the fourth part of the multi-part deliverable which consists four parts.
TS 186 025-1 [i.1] contains the overall benchmark descriptions, architectures, processes, and information models that
are common to all specific benchmarking scenarios.
TS 186 025-2 [i.2] contains the specific benchmarking use-cases and scenarios, along with scenario specific metrics and
design objectives. It also defines the SUT configuration parameters. This part also contains any required extensions to
the overall descriptions present in the present document, if necessary for the specific scenario.
TS 186 025-3 [i.3] defines an initial benchmark test through the specification of a traffic set, traffic-time profile and
benchmark test procedure.
TS 186 025-4 [i.4] defines Reference Load network quality parameters for the use cases defined in TS 186 025-2 [i.2].
2 References
References are either specific (identified by date of publication and/or edition number or version number) or
non-specific. For specific references, only the cited version applies. For non-specific references, the latest version of the
reference document (including any amendments) applies.
Referenced documents which are not found to be publicly available in the expected location might be found at
http://docbox.etsi.org/Reference.
NOTE: While any hyperlinks included in this clause were valid at the time of publication, ETSI cannot guarantee
their long term validity.
2.1 Normative references
The following referenced documents are necessary for the application of the present document.
[1] ETSI TS 101 563: "Speech and multimedia Transmission Quality (STQ); IMS/PES exchange
performance requirements".
[2] ITU-T Recommendation Q.543: "Digital exchange performance design objectives".
[3] ETSI TS 183 036: "Telecommunications and Internet converged Services and Protocols for
Advanced Networking (TISPAN); ISDN/SIP interworking; Protocol specification".
[4] ETSI TS 124 229: "Digital cellular telecommunications system (Phase 2+); Universal Mobile
Telecommunications System (UMTS); LTE; IP multimedia call control protocol based on Session
Initiation Protocol (SIP) and Session Description Protocol (SDP); Stage 3 (3GPP TS 24.229)".
[5] ETSI TS 183 043: "Telecommunications and Internet converged Services and Protocols for
Advanced Networking (TISPAN); IMS-based PSTN/ISDN Emulation; Stage 3 specification".
2.2 Informative references
The following referenced documents are not necessary for the application of the present document but they assist the
user with regard to a particular subject area.
[i.1] ETSI TS 186 025-1: "Telecommunications and Internet converged Services and Protocols for
Advanced Networking (TISPAN); IMS/PES Performance Benchmark; Part 1: Core Concepts".
ETSI
6 ETSI TS 186 025-4 V2.1.1 (2011-07)
[i.2] ETSI TS 186 025-2: "Telecommunications and Internet converged Services and Protocols for
Advanced Networking (TISPAN); IMS/PES Performance Benchmark; Part 2: Subsystem
Configurations and Benchmarks".
[i.3] ETSI TS 186 025-3: "Telecommunications and Internet Converged Services and Protocols for
Advanced Networking (TISPAN); IMS/PES Performance Benchmark; Part 3: Traffic Sets and
Traffic Profiles".
[i.4] ETSI TS 186 025-4: "Telecommunications and Internet Converged Services and Protocols for
Advanced Networking (TISPAN); IMS/PES Performance Benchmark; Part 4: Reference Load
network quality parameters".
[i.5] ITU-T Recommendation Q.541: "Digital exchange design objectives - General".
[i.6] ITU-T Recommendation G.812: "Timing requirements of slave clocks suitable for use as node
clocks in synchronization networks".
[i.7] ITU-T Recommendation G.823: "The control of jitter and wander within digital networks which
are based on the 2048 kbit/s hierarchy".
3 Definitions and abbreviations
3.1 Definitions
For the purposes of the present document, the following terms and definitions apply:
background load: workload applied to an SUT during a benchmark test, for the purpose of consuming SUT resources
during a benchmark test and changing the traffic intensity at which the capacity of the SUT is reached
benchmark report: documented generated at the conclusion of a test procedure containing the metrics measured
during the execution of the test and/or computed from the data collected in the benchmark log
benchmark test: procedure by which a test system interacts with a System Under Test to measure its behaviour and
produce a benchmark report
configuration: specification of a subset of IMS/PES architectural elements and metrics for which collection of
benchmark tests can be defined
design objective: probabilistic model of delay and failure requirements for an SUT, associated with a use-case,
specified by threshold values and probabilities for delay and scenario failure
idle load: load that is not dependent on the traffic or other external activities
maximum capacity: smallest scenario arrival rate at which the successful scenario rate cannot be increased
metric: performance measurement of an SUT reported in a benchmark report
parameter: attribute of a SUT, test system, system load, or traffic set whose value is set externally and prior to a
benchmark test, and whose value affects the behaviour of the benchmark test
processor load: the part of time the processor executes work, normally expressed in percent. The processor load
consists of Idle load, Traffic load and Usage load
Reference Call (RC): is defined as a basic ISUP to ISUP call connected through two MGW in the same MGC domain
test parameters: parameters whose values determine the behaviour of a benchmark test
test procedure: specification of the steps to be performed by a benchmark test
test scenario: specific path through a use-case, whose implementation by a test system creates a system load
test system: collection of hardware and software which presents a system load to a system under test and collects data
on the system under test's performance, from which metrics can be computed
ETSI
7 ETSI TS 186 025-4 V2.1.1 (2011-07)
traffic load: load that results from handling traffic events that are directly related to calls; this load varies with the
traffic intensity
traffic-time profile: evolution of the average scenario over a time interval
traffic set: mixture of traffic scenarios
usage load: load that is reserved for the administrations operation and maintenance activities during busy hour
workload: expressed as reference calls per second (RC/s) is calculated by multiplying calls per second by its
corresponding WLF
workload factor: traffic load for different types of calls in relation to the traffic load of the reference call (ISUP call)
3.2 Abbreviations
For the purposes of the present document, the following abbreviations apply:
AGCF Access Gateway Control Function
DLE Destination Local Exchange
IBCF Interconnection Border Control Function
IMS IP Multimedia Subsystem
ISDN Media GateWay Controler
ISUP ISDN User Part
MGC Media GateWay Controler
MGW Media Gateway
NGN Next Generation Networks
OLE Originating Local Exchange
PES PSTN/ISDN Emulation Sub-system
PSTN Public Switched Telecommunications Network
RC Reference Call
RTP Real Time Protocol
SUT System Under Test
TIE Time Interval Error
VGW Voice Gateway
WLF workload factor
4 Metrics and design objectives
4.1 Delay probability - non-ISDN or mixed (ISDN - non-ISDN)
environment
This clause defines delay parameters related to non-ISDN environment and mixed (ISDN - non-ISDN) environment.
The values are based on the values in the Q.543 [2] and TS 101 563 [1].
ETSI
8 ETSI TS 186 025-4 V2.1.1 (2011-07)
Table 1
Meaning of timers Parameter Q.543 [2] IMS, PES equivalent Reference Load A Reference Load B
Detailed description Mean Value 95 % Mean Value 95 %
probability probability
of not of not
exceeding exceeding
Local exchange call request delay - originating outgoing and internal traffic connections
ANALOGUE § 2.3.2.1 [2] PES [5] ≤ 400 ms 600 ms ≤ 800 ms ≤ 1 000 ms
SUBSCRIBER LINES For ANALOGUE SUBSCRIBER LINES, For ANALOGUE SUBSCRIBER LINES
local exchange call call request delay is defined as the connected to the AGCF or VGW
request delay - interval from the instant when the off- Call request delay is defined as the interval
originating outgoing hook condition is recognizable at the from the instant when the off-hook
and internal traffic subscriber line interface of the exchange condition is recognizable at the subscriber
connections. until the exchange begins to apply dial line interface of the AGCF/VGW until the
tone to the line. The call request delay AGCF/VGW begins to apply dial tone to
interval is assumed to correspond to the the line.
period at the beginning of a call attempt
during which the exchange is unable to
receive any call address information from
the subscriber.
Figure 1: Local exchange analogue subscriber call request delay: overlap sending
ETSI
9 ETSI TS 186 025-4 V2.1.1 (2011-07
...