SIST ETS 300 356-36:1999
(Main)Integrated Services Digital Network (ISDN); Signalling System No.7; ISDN User Part (ISUP) version 2 for the International interface; Part 36: Abstract Test Suite (ATS) and partial Protocol Implementation eXtra Information for Testing (PIXIT) proforma specification for supplementary services
Integrated Services Digital Network (ISDN); Signalling System No.7; ISDN User Part (ISUP) version 2 for the International interface; Part 36: Abstract Test Suite (ATS) and partial Protocol Implementation eXtra Information for Testing (PIXIT) proforma specification for supplementary services
Definition of ISUP version 2 tests in order to support compatibility & validation for nodes having implemented DE/SPS-6001-series. Scope of ATS and PIXIT limited to supplementary services.
Digitalno omrežje z integriranimi storitvami (ISDN) - Signalizacija št. 7 - Druga različica ISDN-uporabniškega dela (ISUP) - 36. del: Abstraktni preskušalni niz (ATS) in delna dodatna informacija za preskušanje izvedbe protokola (PIXIT) - Proforma specifikacije za dopolnilne storitve
General Information
Standards Content (Sample)
SLOVENSKI STANDARD
SIST ETS 300 356-36:1999
01-julij-1999
'LJLWDOQRRPUHåMH]LQWHJULUDQLPLVWRULWYDPL,6'16LJQDOL]DFLMDãW'UXJD
UD]OLþLFD,6'1XSRUDEQLãNHJDGHOD,683GHO$EVWUDNWQLSUHVNXãDOQLQL]
$76LQGHOQDGRGDWQDLQIRUPDFLMD]DSUHVNXãDQMHL]YHGEHSURWRNROD3,;,7
3URIRUPDVSHFLILNDFLMH]DGRSROQLOQHVWRULWYH
Integrated Services Digital Network (ISDN); Signalling System No.7; ISDN User Part
(ISUP) version 2 for the International interface; Part 36: Abstract Test Suite (ATS) and
partial Protocol Implementation eXtra Information for Testing (PIXIT) proforma
specification for supplementary services
Ta slovenski standard je istoveten z: ETS 300 356-36 Edition 1
ICS:
33.080 Digitalno omrežje z Integrated Services Digital
integriranimi storitvami Network (ISDN)
(ISDN)
SIST ETS 300 356-36:1999 en
2003-01.Slovenski inštitut za standardizacijo. Razmnoževanje celote ali delov tega standarda ni dovoljeno.
---------------------- Page: 1 ----------------------
SIST ETS 300 356-36:1999
---------------------- Page: 2 ----------------------
SIST ETS 300 356-36:1999
EUROPEAN ETS 300 356-36
TELECOMMUNICATION March 1998
STANDARD
Source: SPS Reference: DE/SPS-01028-3
ICS: 33.020
Key words: ISDN, SS7, ISUP, supplementary service, testing, ATS, PIXIT
Integrated Services Digital Network (ISDN);
Signalling System No.7;
ISDN User Part (ISUP) version 2 for the International interface;
Part 36: Abstract Test Suite (ATS) and partial Protocol
Implementation eXtra Information for Testing (PIXIT) proforma
specification for supplementary services
ETSI
European Telecommunications Standards Institute
ETSI Secretariat
Postal address: F-06921 Sophia Antipolis CEDEX - FRANCE
Office address: 650 Route des Lucioles - Sophia Antipolis - Valbonne - FRANCE
Internet: secretariat@etsi.fr - http://www.etsi.fr - http://www.etsi.org
Tel.: +33 4 92 94 42 00 - Fax: +33 4 93 65 47 16
Copyright Notification: No part may be reproduced except as authorized by written permission. The copyright and the
foregoing restriction extend to reproduction in all media.
© European Telecommunications Standards Institute 1998. All rights reserved.
---------------------- Page: 3 ----------------------
SIST ETS 300 356-36:1999
Page 2
ETS 300 356-36: March 1998
Whilst every care has been taken in the preparation and publication of this document, errors in content,
typographical or otherwise, may occur. If you have comments concerning its accuracy, please write to
"ETSI Editing and Committee Support Dept." at the address shown on the title page.
---------------------- Page: 4 ----------------------
SIST ETS 300 356-36:1999
Page 3
ETS 300 356-36: March 1998
Contents
Foreword .5
1 Scope .7
2 Normative references.7
3 Definitions and abbreviations .9
3.1 Definitions .9
3.2 Abbreviations .10
4 Implementation under test and test methods.11
4.1 Identification of the system and implementation under test.11
4.2 ATM and testing configuration for ISUP version 2.12
4.2.1 Intermediate exchanges.13
4.2.2 Local exchanges .14
4.2.3 Master-slave aspects in the test configuration .17
5 Conventions used within the ATS .17
5.1 Test suite parameters, constants and variables .17
5.2 Test case variables.17
5.3 ASP constraints .17
5.4 Timers.18
5.5 Test suite operations .18
5.6 Aliases .18
5.7 Test case and step identifiers.18
5.8 Constraints.18
5.9 Dynamic behaviour .19
5.10 Pre-test conditions .19
Annex A (normative): ATS for ISUP version 2 supplementary services .20
A.1 The TTCN Graphical form (TTCN.GR) .20
A.2 The TTCN Machine Processable form (TTCN.MP) .20
Annex B (normative): Partial PIXIT proforma for ISUP version 2 supplementary services.21
B.1 Identification summary .21
B.2 Abstract test suite summary.21
B.3 Test laboratory .21
B.4 Client identification .21
B.5 System Under Test (SUT).22
B.6 Ancillary protocols .22
B.7 Protocol information for ISUP.22
B.7.1 Protocol identification.22
B.7.2 IUT information - PIXIT proforma tables.22
B.7.2.1 General configuration.23
B.7.2.2 Parameter values .24
B.7.2.3 Timer values.26
B.7.2.4 Other information.27
---------------------- Page: 5 ----------------------
SIST ETS 300 356-36:1999
Page 4
ETS 300 356-36: March 1998
Annex C (normative): Protocol Conformance Test Report (PCTR) proforma for ISUP version 2
supplementary services . 28
C.1 Identification summary. 28
C.1.1 Protocol conformance test report. 28
C.1.2 IUT identification. 28
C.1.3 Testing environment. 28
C.1.4 Limits and reservation . 29
C.1.5 Comments. 29
C.2 IUT conformance status . 29
C.3 Static conformance summary. 29
C.4 Dynamic conformance summary. 29
C.5 Static conformance review report . 30
C.6 Test campaign report. 30
C.7 Observations. 42
History. 43
---------------------- Page: 6 ----------------------
SIST ETS 300 356-36:1999
Page 5
ETS 300 356-36: March 1998
Foreword
This European Telecommunication Standard (ETS) has been produced by the Signalling Protocols and
Switching (SPS) Technical Committee of the European Telecommunications Standards Institute (ETSI).
This ETS is part 36 of a multi-part standard covering the ISDN User Part (ISUP) version 2 for the
international interface, as described below:
Part 1: "Basic services";
Part 2: "ISDN supplementary services";
Part 3: "Calling Line Identification Presentation (CLIP) supplementary service";
Part 4: "Calling Line Identification Restriction (CLIR) supplementary service";
Part 5: "Connected Line Identification Presentation (COLP) supplementary service";
Part 6: "Connected Line Identification Restriction (COLR) supplementary service";
Part 7: "Terminal Portability (TP) supplementary service";
Part 8: "User-to-User Signalling (UUS) supplementary service";
Part 9: "Closed User Group (CUG) supplementary service";
Part 10: "Subaddressing (SUB) supplementary service";
Part 11: "Malicious Call Identification (MCID) supplementary service";
Part 12: "Conference call, add-on (CONF) supplementary service";
Part 14: "Explicit Call Transfer (ECT) supplementary service";
Part 15: "Diversion supplementary services";
Part 16: "Call Hold (HOLD) supplementary service";
Part 17: "Call Waiting (CW) supplementary service";
Part 18: "Completion of Calls to Busy Subscriber (CCBS) supplementary service";
Part 19: "Three-Party (3PTY) supplementary service";
Part 31: "Protocol Implementation Conformance Statement (PICS) proforma specification for basic
services";
Part 32: "Test Suite Structure and Test Purposes (TSS&TP) specification for basic services";
Part 33: "Abstract Test Suite (ATS) and partial Protocol Implementation eXtra Information for Testing
(PIXIT) proforma specification for basic services";
Part 34: "Protocol Implementation Conformance Statement (PICS) proforma specification for
supplementary services";
Part 35: "Test Suite Structure and Test Purposes (TSS&TP) specification for supplementary
services";
Part 36: "Abstract Test Suite (ATS) and partial Protocol Implementation eXtra Information for
Testing (PIXIT) proforma specification for supplementary services".
NOTE: Part 13 has been withdrawn.
Transposition dates
Date of adoption of this ETS: 6 March 1998
Date of latest announcement of this ETS (doa): 30 June 1998
Date of latest publication of new National Standard
or endorsement of this ETS (dop/e): 31 December 1998
Date of withdrawal of any conflicting National Standard (dow): 31 December 1998
---------------------- Page: 7 ----------------------
SIST ETS 300 356-36:1999
Page 6
ETS 300 356-36: March 1998
Blank page
---------------------- Page: 8 ----------------------
SIST ETS 300 356-36:1999
Page 7
ETS 300 356-36: March 1998
1 Scope
This thirty-sixth part of ETS 300 356 provides the conformance test specification for the ISDN User Part
(ISUP) version 2 supplementary services defined in ETS 300 356-2 [2] to ETS 300 356-19 [18] in
compliance with the relevant requirements and in accordance with the relevant guidance given in
ISO/IEC 9646-1 [23].
This ETS contains the Abstract Test Suite (ATS) for ISUP version 2 supplementary services, written in
Tree and Tabular Combined Notation (TTCN) as specified in ISO/IEC 9646-3 [25]. It is based on
ETS 300 356-35 [20] which specifies the Test Suite Structure and Test Purposes (TSS&TP).
This ETS applies only to exchanges having implemented the ISUP version 2 protocol specifications [2-18].
It is applicable for conformance testing of all types of exchanges as specified in the ISUP version 2
protocol specifications [2-18]. This ETS does not deal with compatibility testing.
The main text part of this ETS presents the requirements regarding the chosen test method and the
conventions used within the ATS.
The annexes contain the ATS for ISUP version 2 supplementary services (available on electronic media),
the partial Protocol Implementation eXtra Information for Testing (PIXIT) proforma and the Protocol
Conformance Test Report (PCTR) proforma.
2 Normative references
This ETS incorporates by dated and undated reference, provisions from other publications. These
normative references are cited at the appropriate places in the text and the publications are listed
hereafter. For dated references, subsequent amendments to or revisions of any of these publications
apply to this ETS only when incorporated in it by amendment or revision. For undated references the latest
edition of the publication referred to applies.
An ETS is referenced where it (partly) overrides the corresponding ITU-T Recommendation or where a
corresponding ITU-T Recommendation does not exist (yet). For convenience, the respective section of an
ITU-T Recommendation is referenced when it is not overridden by a corresponding ETS.
[1] ETS 300 356-1 (1995): "Integrated Services Digital Network (ISDN); Signalling
System No.7; ISDN User Part (ISUP) version 2 for the international interface;
Part 1: Basic services [ITU-T Recommendations Q.761 to Q.764 (1993),
modified]".
[2] ETS 300 356-2 (1995): "Integrated Services Digital Network (ISDN); Signalling
System No.7; ISDN User Part (ISUP) version 2 for the international interface;
Part 2: ISDN supplementary services [ITU-T Recommendation Q.730 (1993),
modified]".
[3] ETS 300 356-3 (1995): "Integrated Services Digital Network (ISDN); Signalling
System No.7; ISDN User Part (ISUP) version 2 for the international interface;
Part 3: Calling Line Identification Presentation (CLIP) supplementary service
[ITU-T Recommendation Q.731, clause 3 (1993), modified]".
[4] ETS 300 356-4 (1995): "Integrated Services Digital Network (ISDN); Signalling
System No.7; ISDN User Part (ISUP) version 2 for the international interface;
Part 4: Calling Line Identification Restriction (CLIR) supplementary service
[ITU-T Recommendation Q.731, clause 4 (1993), modified]".
[5] ETS 300 356-5 (1995): "Integrated Services Digital Network (ISDN); Signalling
System No.7; ISDN User Part (ISUP) version 2 for the international interface;
Part 5: Connected Line Identification Presentation (COLP) supplementary
service [ITU-T Recommendation Q.731, clause 5 (1993), modified]".
---------------------- Page: 9 ----------------------
SIST ETS 300 356-36:1999
Page 8
ETS 300 356-36: March 1998
[6] ETS 300 356-6 (1995): "Integrated Services Digital Network (ISDN); Signalling
System No.7; ISDN User Part (ISUP) version 2 for the international interface;
Part 6: Connected Line Identification Restriction (COLR) supplementary service
[ITU-T Recommendation Q.731, clause 6 (1993), modified]".
[7] ETS 300 356-7 (1995): "Integrated Services Digital Network (ISDN); Signalling
System No.7; ISDN User Part (ISUP) version 2 for the international interface;
Part 7: Terminal Portability (TP) supplementary service [ITU-T Recommendation
Q.733, clause 4 (1993), modified]".
[8] ETS 300 356-8 (1995): "Integrated Services Digital Network (ISDN); Signalling
System No.7; ISDN User Part (ISUP) version 2 for the international interface;
Part 8: User-to-User Signalling (UUS) supplementary service [ITU-T
Recommendation Q.737, clause 1 (1993), modified]".
[9] ETS 300 356-9 (1995): "Integrated Services Digital Network (ISDN); Signalling
System No.7; ISDN User Part (ISUP) version 2 for the international interface;
Part 9: Closed User Group (CUG) supplementary service [ITU-T
Recommendation Q.735, clause 1 (1993), modified]".
[10] ETS 300 356-10 (1995): "Integrated Services Digital Network (ISDN); Signalling
System No.7; ISDN User Part (ISUP) version 2 for the international interface;
Part 10: Subaddressing (SUB) supplementary service [CCITT Recommendation
Q.731, section 8 (1992), modified]".
[11] ETS 300 356-11 (1995): "Integrated Services Digital Network (ISDN); Signalling
System No.7; ISDN User Part (ISUP) version 2 for the international interface;
Part 11: Malicious Call Identification (MCID) supplementary service".
[12] ETS 300 356-12 (1995): "Integrated Services Digital Network (ISDN); Signalling
System No.7; ISDN User Part (ISUP) version 2 for the international interface;
Part 12: Conference call, add-on (CONF) supplementary service [ITU-T
Recommendation Q.734, clause 1 (1993), modified]".
[13] ETS 300 356-14 (1995): "Integrated Services Digital Network (ISDN); Signalling
System No.7; ISDN User Part (ISUP) version 2 for the international interface;
Part 14: Explicit Call Transfer (ECT) supplementary service".
[14] ETS 300 356-15 (1995): "Integrated Services Digital Network (ISDN); Signalling
System No.7; ISDN User Part (ISUP) version 2 for the international interface;
Part 15: Diversion supplementary services [ITU-T Recommendation Q.732,
clauses 2 to 5 (1993), modified]".
[15] ETS 300 356-16 (1995): "Integrated Services Digital Network (ISDN); Signalling
System No.7; ISDN User Part (ISUP) version 2 for the international interface;
Part 16: Call Hold (HOLD) supplementary service [ITU-T Recommendation
Q.733, clause 2 (1993), modified]".
[16] ETS 300 356-17 (1995): "Integrated Services Digital Network (ISDN); Signalling
System No.7; ISDN User Part (ISUP) version 2 for the international interface;
Part 17: Call Waiting (CW) supplementary service [CCITT Recommendation
Q.733, section 1 (1992), modified]".
[17] ETS 300 356-18 (1995): "Integrated Services Digital Network (ISDN); Signalling
System No.7; ISDN User Part (ISUP) version 2 for the international interface;
Part 18: Completion of Calls to Busy Subscriber (CCBS) supplementary
service".
[18] ETS 300 356-19 (1995): "Integrated Services Digital Network (ISDN); Signalling
System No.7; ISDN User Part (ISUP) version 2 for the international interface;
Part 19: Three party (3PTY) supplementary service [ITU-T Recommendation
Q.734, clause 2 (1993), modified]".
---------------------- Page: 10 ----------------------
SIST ETS 300 356-36:1999
Page 9
ETS 300 356-36: March 1998
[19] ETS 300 356-34: "Integrated Services Digital Network (ISDN); Signalling System
No.7; ISDN User Part (ISUP) version 2 for the international interface; Part 34:
Protocol Implementation Conformance Statement (PICS) proforma specification
for supplementary services".
[20] ETS 300 356-35: "Integrated Services Digital Network (ISDN); Signalling System
No.7; ISDN User Part (ISUP) version 2 for the international interface; Part 35:
Test Suite Structure and Test Purposes (TSS&TP) specification for
supplementary services".
[21] ETS 300 406: "Methods for Testing and Specification (MTS); Protocol and
profile conformance testing specifications; Standardization methodology".
[22] ETR 141: "Methods for Testing and Specification (MTS); Protocol and profile
conformance testing specifications; The Tree and Tabular Combined Notation
(TTCN) style guide".
[23] ISO/IEC 9646-1: "Information technology - Open Systems Interconnection -
Conformance testing methodology and framework - Part 1: General concepts".
[24] ISO/IEC 9646-2: "Information technology - Open Systems Interconnection -
Conformance testing methodology and framework - Part 2: Abstract Test Suite
specification".
[25] ISO/IEC 9646-3: "Information technology - Open Systems Interconnection -
Conformance testing methodology and framework - Part 3: The Tree and
Tabular Combined Notation (TTCN)".
[26] ISO/IEC 9646-5: "Information technology - Open Systems Interconnection -
Conformance testing methodology and framework - Part 5: Requirements on
test laboratories and clients for the conformance assessment process".
3 Definitions and abbreviations
3.1 Definitions
For the purposes of this ETS, the following definitions apply:
- terms defined in the ISUP version 2 reference specifications [1-18];
- terms defined in ISO/IEC 9646-1 [23] and in ISO/IEC 9646-3 [25].
In particular, the following terms apply:
Abstract Test Case (ATC): A complete and independent specification of the actions required to achieve a
specific test purpose, defined at the level of abstraction of a particular Abstract Test Method, starting in a
stable testing state and ending in a stable testing state (see ISO/IEC 9646-1 [23], subclause 3.3.3).
Abstract Test Method (ATM): The description of how an IUT is to be tested, given at an appropriate level
of abstraction to make the description independent of any particular realization of a Means of Testing, but
with enough detail to enable abstract test cases to be specified for this method (see ISO/IEC 9646-1 [23],
subclause 3.3.5).
Abstract Test Suite (ATS): A test suite composed of abstract test cases (see ISO/IEC 9646-1 [23],
subclause 3.3.6).
Implementation Under Test (IUT): An implementation of one or more OSI protocols in an adjacent
user/provider relationship, being part of a real open system which is to be studied by testing (see
ISO/IEC 9646-1 [23], subclause 3.3.43).
Means Of Testing (MOT): The combination of equipment and procedures that can perform the
derivation, selection, parametrization and execution of test cases, in conformance with a reference
standardized ATS, and can produce a conformance log (see ISO/IEC 9646-1 [23], subclause 3.3.54).
---------------------- Page: 11 ----------------------
SIST ETS 300 356-36:1999
Page 10
ETS 300 356-36: March 1998
Point of Control and Observation (PCO): A point within a testing environment where the occurrence of
test events is to be controlled and observed, as defined in an abstract test method (see
ISO/IEC 9646-1 [23], subclause 3.3.64).
pre-test condition: A setting or state in the IUT which cannot be achieved by providing stimulus from the
test environment.
Protocol Implementation Conformance Statement (PICS): A statement made by the supplier of a
protocol claimed to conform to a given specification, stating which capabilities have been implemented
(see ISO/IEC 9646-1 [23], subclauses 3.3.39 and 3.3.80).
PICS proforma: A document, in the form of a questionnaire, which when completed for an
implementation or system becomes the PICS.
Protocol Implementation eXtra Information for Testing (PIXIT): A statement made by a supplier or
implementor of an IUT (protocol) which contains or references all of the information related to the IUT and
its testing environment, which will enable the test laboratory to run an appropriate test suite against the
IUT (see ISO/IEC 9646-1 [23], subclauses 3.3.41 and 3.3.81).
PIXIT proforma: A document, in the form of a questionnaire, which when completed for the IUT becomes
the PIXIT.
System Under Test (SUT): The real open system in which the IUT resides (see ISO/IEC 9646-1 [23],
subclause 3.3.103).
user: The access protocol entity at the User side of the user-network interface where a T reference point
or coincident S and T reference point applies.
3.2 Abbreviations
For the purposes of this ETS, the following abbreviations apply:
3PTY Three-Party
ASE Application Service Entity
ASP Abstract Service Primitive
ATC Abstract Test Case
ATM Abstract Test Method
ATS Abstract Test Suite
CCBS Completion of Calls to Busy Subscriber
CDIV Call Diversion
CFB Call Forwarding Busy
CFNR Call Forwarding No Reply
CFU Call Forwarding Unconditional
CIC Circuit Identification Code
CLIP Calling Line Identification Presentation
CLIR Calling Line Identification Restriction
CntrlE Controlling Exchange
COLP Connected Line Identification Presentation
COLR Connected Line Identification Restriction
CONF Conference call, add-on
CUG Closed User Group
CW Call Waiting
DLE Destination Local Exchange
DSS1 Digital Subscriber Signalling System No. one
ECT Explicit Call Transfer
HOLD Call Hold
IncIE Incoming International Exchange
IntermE Intermediate Exchange
ISC International Switching Centre
ISDN Integrated Services Digital Network
ISUP ISDN User Part
ITE International Transit Exchange
IUT Implementation Under Test
---------------------- Page: 12 ----------------------
SIST ETS 300 356-36:1999
Page 11
ETS 300 356-36: March 1998
IWorkE Interworking Exchange
LAPD Link Access Protocol for the D-channel
LT Lower Tester
MCID Malicious Call Identification
MOT Means Of Testing
MTC Main Test Component
MTP Message Transfer Part
NNI Network-Network Interface
NTE National Transit Exchange
OLE Originating Local Exchange
OutIE Outgoing International Exchange
PCO Point of Control and Observation
PCTR Protocol Conformance Test Report
PDU Protocol Data Unit
PICS Protocol Implementation Conformance Statement
PIXIT Protocol Implementation eXtra Information for Testing
PTC Parallel Test Component
SCS System Conformance Statement
SP Signalling Point
SPC Signalling Point Code
SS7 Signalling System No.7
SUB Subaddressing
SUT System Under Test
TCP Test Co-ordination Procedures
TSS&TP Test Suite Structure and Test Purposes
TTCN Tree and Tabular Combined Notation
UNI User-Network Interface
UUS User-to-User Signalling
UUSn UUS service n (n = 1.3)
4 Implementation under test and test methods
4.1 Identification of the system and implementation under test
The System Under Test (SUT) is an exchange. The Implementation Under Test (IUT) is the ISUP
version 2 implementation in this exchange, mainly the part responsible for the supplementary services
functionality, as shown in figure 1.
Access
Exchange
supplementary
services
ISUP ISUP
ISUP - ISDN User Part
ISUP v2
IUT - Implementation Under Test
IUT
SUT - System Under Test
SUT
Figure 1: Exchange as SUT
The ISUP signalling protocol can be observed on the SS7 link on the Network-Network Interface (NNI).
The effects of signalling procedures of ISUP can be observed on the circuits controlled by the ISUP on the
NNI.
The ISUP implementation will in some exchanges have to interwork with the Access signalling system on
the User-Network Interface (UNI) and involve call handling in order to establish end-to-end connections.
---------------------- Page: 13 ----------------------
SIST ETS 300 356-36:1999
Page 12
ETS 300 356-36: March 1998
From ETS 300 356-1 [1], several types of exchanges (or roles) can be identified (see figure 2).
local intermediate
local
Transit Gateway Transit Gateway
OLE DLE
Access NTE OutIE ITE IncIE Access
national international
national
network network
network
OLE - Originating Local Exchange ITE - International Transit Exchange
NTE - National Transit Exchange IncIE - Incoming International Exchange
OutIE - Outgoing International Exchange DLE - Destination Local Exchange
Figure 2: Roles of exchanges
The exchanges can be divided in two main groups according to their functionality: local exchanges, where
calls originate and terminate, and intermediate exchanges, with transit functionality. Local exchanges are
national, i.e. belong to a national network. Intermediate exchanges are national or international. The
international intermediate exchanges which permit access to the international network are the gateway
exchanges (incoming and outgoing), also called International Switching Centres (ISCs). A particularity for
some supplementary services, e.g. call diversion services, is that a local exchange is not only
originator/terminator of the call but also mediator between two far-end local exchanges.
The roles of the exchanges are summarized in table 1.
Table 1: Roles of exchanges
Local Intermediate exchange
exchange National International
Originating Local Exchange OLE
Transit Exchange NTE ITE
Incoming/Gateway Exchange IncIE
Outgoing/Gateway Exchange OutIE
Destination Local Exchange DLE
4.2 ATM and testing configuration for ISUP version 2
The Abstract Test Method (ATM) chosen for the ISUP version 2 supplementary services testing
specification is the distributed multi-party test method. The ATM is defined at an appropriate level of
abstraction so that the test cases may be specified appropriately, without adding restrictions to the IUT.
The testing architectures are described in the foll
...
2003-01.Slovenski inštitut za standardizacijo. Razmnoževanje celote ali delov tega standarda ni dovoljeno.Integrated Services Digital Network (ISDN); Signalling System No.7; ISDN User Part (ISUP) version 2 for the International interface; Part 36: Abstract Test Suite (ATS) and partial Protocol Implementation eXtra Information for Testing (PIXIT) proforma specification for supplementary services33.080Digitalno omrežje z integriranimi storitvami (ISDN)Integrated Services Digital Network (ISDN)33.020Telekomunikacije na splošnoTelecommunications in generalICS:Ta slovenski standard je istoveten z:ETS 300 356-36 E13SIST ETS 300 356-36:199en01-GHFHPEHU-1993SIST ETS 300 356-36:199SLOVENSKI
STANDARD
SIST ETS 300 356-36:1999
EUROPEANETS 300 356-36TELECOMMUNICATIONMarch 1998STANDARDSource: SPSReference: DE/SPS-01028-3ICS:33.020Key words:ISDN, SS7, ISUP, supplementary service, testing, ATS, PIXITIntegrated Services Digital Network (ISDN);Signalling System No.7;ISDN User Part (ISUP) version 2 for the International interface;Part 36: Abstract Test Suite (ATS) and partial ProtocolImplementation eXtra Information for Testing (PIXIT) proformaspecification for supplementary servicesETSIEuropean Telecommunications Standards InstituteETSI SecretariatPostal address: F-06921 Sophia Antipolis CEDEX - FRANCEOffice address: 650 Route des Lucioles - Sophia Antipolis - Valbonne - FRANCEInternet: secretariat@etsi.fr - http://www.etsi.fr - http://www.etsi.orgTel.: +33 4 92 94 42 00 - Fax: +33 4 93 65 47 16Copyright Notification: No part may be reproduced except as authorized by written permission. The copyright and theforegoing restriction extend to reproduction in all media.© European Telecommunications Standards Institute 1998. All rights reserved.SIST ETS 300 356-36:1999
Page 2ETS 300 356-36: March 1998Whilst every care has been taken in the preparation and publication of this document, errors in content,typographical or otherwise, may occur. If you have comments concerning its accuracy, please write to"ETSI Editing and Committee Support Dept." at the address shown on the title page.SIST ETS 300 356-36:1999
Page 3ETS 300 356-36: March 1998ContentsForeword.51Scope.72Normative references.73Definitions and abbreviations.93.1Definitions.93.2Abbreviations.104Implementation under test and test methods.114.1Identification of the system and implementation under test.114.2ATM and testing configuration for ISUP version 2.124.2.1Intermediate exchanges.134.2.2Local exchanges.144.2.3Master-slave aspects in the test configuration.175Conventions used within the ATS.175.1Test suite parameters, constants and variables.175.2Test case variables.175.3ASP constraints.175.4Timers.185.5Test suite operations.185.6Aliases.185.7Test case and step identifiers.185.8Constraints.185.9Dynamic behaviour.195.10Pre-test conditions.19Annex A (normative):ATS for ISUP version 2 supplementary services.20A.1The TTCN Graphical form (TTCN.GR).20A.2The TTCN Machine Processable form (TTCN.MP).20Annex B (normative):Partial PIXIT proforma for ISUP version 2 supplementary services.21B.1Identification summary.21B.2Abstract test suite summary.21B.3Test laboratory.21B.4Client identification.21B.5System Under Test (SUT).22B.6Ancillary protocols.22B.7Protocol information for ISUP.22B.7.1Protocol identification.22B.7.2IUT information - PIXIT proforma tables.22B.7.2.1General configuration.23B.7.2.2Parameter values.24B.7.2.3Timer values.26B.7.2.4Other information.27SIST ETS 300 356-36:1999
Page 4ETS 300 356-36: March 1998Annex C (normative):Protocol Conformance Test Report (PCTR) proforma for ISUP version 2supplementary services.28C.1Identification summary.28C.1.1Protocol conformance test report.28C.1.2IUT identification.28C.1.3Testing environment.28C.1.4Limits and reservation.29C.1.5Comments.29C.2IUT conformance status.29C.3Static conformance summary.29C.4Dynamic conformance summary.29C.5Static conformance review report.30C.6Test campaign report.30C.7Observations.42History.43SIST ETS 300 356-36:1999
Page 5ETS 300 356-36: March 1998ForewordThis European Telecommunication Standard (ETS) has been produced by the Signalling Protocols andSwitching (SPS) Technical Committee of the European Telecommunications Standards Institute (ETSI).This ETS is part 36 of a multi-part standard covering the ISDN User Part (ISUP) version 2 for theinternational interface, as described below:Part 1:"Basic services";Part 2:"ISDN supplementary services";Part 3:"Calling Line Identification Presentation (CLIP) supplementary service";Part 4:"Calling Line Identification Restriction (CLIR) supplementary service";Part 5:"Connected Line Identification Presentation (COLP) supplementary service";Part 6:"Connected Line Identification Restriction (COLR) supplementary service";Part 7:"Terminal Portability (TP) supplementary service";Part 8:"User-to-User Signalling (UUS) supplementary service";Part 9:"Closed User Group (CUG) supplementary service";Part 10:"Subaddressing (SUB) supplementary service";Part 11:"Malicious Call Identification (MCID) supplementary service";Part 12:"Conference call, add-on (CONF) supplementary service";Part 14:"Explicit Call Transfer (ECT) supplementary service";Part 15:"Diversion supplementary services";Part 16:"Call Hold (HOLD) supplementary service";Part 17:"Call Waiting (CW) supplementary service";Part 18:"Completion of Calls to Busy Subscriber (CCBS) supplementary service";Part 19:"Three-Party (3PTY) supplementary service";Part 31:"Protocol Implementation Conformance Statement (PICS) proforma specification for basicservices";Part 32:"Test Suite Structure and Test Purposes (TSS&TP) specification for basic services";Part 33:"Abstract Test Suite (ATS) and partial Protocol Implementation eXtra Information for Testing(PIXIT) proforma specification for basic services";Part 34:"Protocol Implementation Conformance Statement (PICS) proforma specification forsupplementary services";Part 35:"Test Suite Structure and Test Purposes (TSS&TP) specification for supplementaryservices";Part 36:"Abstract Test Suite (ATS) and partial Protocol Implementation eXtra Information forTesting (PIXIT) proforma specification for supplementary services".NOTE:Part 13 has been withdrawn.Transposition datesDate of adoption of this ETS:6 March 1998Date of latest announcement of this ETS (doa):30 June 1998Date of latest publication of new National Standardor endorsement of this ETS (dop/e):31 December 1998Date of withdrawal of any conflicting National Standard (dow):31 December 1998SIST ETS 300 356-36:1999
Page 6ETS 300 356-36: March 1998Blank pageSIST ETS 300 356-36:1999
Page 7ETS 300 356-36: March 19981ScopeThis thirty-sixth part of ETS 300 356 provides the conformance test specification for the ISDN User Part(ISUP) version 2 supplementary services defined in ETS 300 356-2 [2] to ETS 300 356-19 [18] incompliance with the relevant requirements and in accordance with the relevant guidance given inISO/IEC 9646-1 [23].This ETS contains the Abstract Test Suite (ATS) for ISUP version 2 supplementary services, written inTree and Tabular Combined Notation (TTCN) as specified in ISO/IEC 9646-3 [25]. It is based onETS 300 356-35 [20] which specifies the Test Suite Structure and Test Purposes (TSS&TP).This ETS applies only to exchanges having implemented the ISUP version 2 protocol specifications [2-18].It is applicable for conformance testing of all types of exchanges as specified in the ISUP version 2protocol specifications [2-18]. This ETS does not deal with compatibility testing.The main text part of this ETS presents the requirements regarding the chosen test method and theconventions used within the ATS.The annexes contain the ATS for ISUP version 2 supplementary services (available on electronic media),the partial Protocol Implementation eXtra Information for Testing (PIXIT) proforma and the ProtocolConformance Test Report (PCTR) proforma.2Normative referencesThis ETS incorporates by dated and undated reference, provisions from other publications. Thesenormative references are cited at the appropriate places in the text and the publications are listedhereafter. For dated references, subsequent amendments to or revisions of any of these publicationsapply to this ETS only when incorporated in it by amendment or revision. For undated references the latestedition of the publication referred to applies.An ETS is referenced where it (partly) overrides the corresponding ITU-T Recommendation or where acorresponding ITU-T Recommendation does not exist (yet). For convenience, the respective section of anITU-T Recommendation is referenced when it is not overridden by a corresponding ETS.[1]ETS 300 356-1 (1995): "Integrated Services Digital Network (ISDN); SignallingSystem No.7; ISDN User Part (ISUP) version 2 for the international interface;Part 1: Basic services [ITU-T Recommendations Q.761 to Q.764 (1993),modified]".[2]ETS 300 356-2 (1995): "Integrated Services Digital Network (ISDN); SignallingSystem No.7; ISDN User Part (ISUP) version 2 for the international interface;Part 2: ISDN supplementary services [ITU-T Recommendation Q.730 (1993),modified]".[3]ETS 300 356-3 (1995): "Integrated Services Digital Network (ISDN); SignallingSystem No.7; ISDN User Part (ISUP) version 2 for the international interface;Part 3: Calling Line Identification Presentation (CLIP) supplementary service[ITU-T Recommendation Q.731, clause 3 (1993), modified]".[4]ETS 300 356-4 (1995): "Integrated Services Digital Network (ISDN); SignallingSystem No.7; ISDN User Part (ISUP) version 2 for the international interface;Part 4: Calling Line Identification Restriction (CLIR) supplementary service[ITU-T Recommendation Q.731, clause 4 (1993), modified]".[5]ETS 300 356-5 (1995): "Integrated Services Digital Network (ISDN); SignallingSystem No.7; ISDN User Part (ISUP) version 2 for the international interface;Part 5: Connected Line Identification Presentation (COLP) supplementaryservice [ITU-T Recommendation Q.731, clause 5 (1993), modified]".SIST ETS 300 356-36:1999
Page 8ETS 300 356-36: March 1998[6]ETS 300 356-6 (1995): "Integrated Services Digital Network (ISDN); SignallingSystem No.7; ISDN User Part (ISUP) version 2 for the international interface;Part 6: Connected Line Identification Restriction (COLR) supplementary service[ITU-T Recommendation Q.731, clause 6 (1993), modified]".[7]ETS 300 356-7 (1995): "Integrated Services Digital Network (ISDN); SignallingSystem No.7; ISDN User Part (ISUP) version 2 for the international interface;Part 7: Terminal Portability (TP) supplementary service [ITU-T RecommendationQ.733, clause 4 (1993), modified]".[8]ETS 300 356-8 (1995): "Integrated Services Digital Network (ISDN); SignallingSystem No.7; ISDN User Part (ISUP) version 2 for the international interface;Part 8: User-to-User Signalling (UUS) supplementary service [ITU-TRecommendation Q.737, clause 1 (1993), modified]".[9]ETS 300 356-9 (1995): "Integrated Services Digital Network (ISDN); SignallingSystem No.7; ISDN User Part (ISUP) version 2 for the international interface;Part 9: Closed User Group (CUG) supplementary service [ITU-TRecommendation Q.735, clause 1 (1993), modified]".[10]ETS 300 356-10 (1995): "Integrated Services Digital Network (ISDN); SignallingSystem No.7; ISDN User Part (ISUP) version 2 for the international interface;Part 10: Subaddressing (SUB) supplementary service [CCITT RecommendationQ.731, section 8 (1992), modified]".[11]ETS 300 356-11 (1995): "Integrated Services Digital Network (ISDN); SignallingSystem No.7; ISDN User Part (ISUP) version 2 for the international interface;Part 11: Malicious Call Identification (MCID) supplementary service".[12]ETS 300 356-12 (1995): "Integrated Services Digital Network (ISDN); SignallingSystem No.7; ISDN User Part (ISUP) version 2 for the international interface;Part 12: Conference call, add-on (CONF) supplementary service [ITU-TRecommendation Q.734, clause 1 (1993), modified]".[13]ETS 300 356-14 (1995): "Integrated Services Digital Network (ISDN); SignallingSystem No.7; ISDN User Part (ISUP) version 2 for the international interface;Part 14: Explicit Call Transfer (ECT) supplementary service".[14]ETS 300 356-15 (1995): "Integrated Services Digital Network (ISDN); SignallingSystem No.7; ISDN User Part (ISUP) version 2 for the international interface;Part 15: Diversion supplementary services [ITU-T Recommendation Q.732,clauses 2 to 5 (1993), modified]".[15]ETS 300 356-16 (1995): "Integrated Services Digital Network (ISDN); SignallingSystem No.7; ISDN User Part (ISUP) version 2 for the international interface;Part 16: Call Hold (HOLD) supplementary service [ITU-T RecommendationQ.733, clause 2 (1993), modified]".[16]ETS 300 356-17 (1995): "Integrated Services Digital Network (ISDN); SignallingSystem No.7; ISDN User Part (ISUP) version 2 for the international interface;Part 17: Call Waiting (CW) supplementary service [CCITT RecommendationQ.733, section 1 (1992), modified]".[17]ETS 300 356-18 (1995): "Integrated Services Digital Network (ISDN); SignallingSystem No.7; ISDN User Part (ISUP) version 2 for the international interface;Part 18: Completion of Calls to Busy Subscriber (CCBS) supplementaryservice".[18]ETS 300 356-19 (1995): "Integrated Services Digital Network (ISDN); SignallingSystem No.7; ISDN User Part (ISUP) version 2 for the international interface;Part 19: Three party (3PTY) supplementary service [ITU-T RecommendationQ.734, clause 2 (1993), modified]".SIST ETS 300 356-36:1999
Page 9ETS 300 356-36: March 1998[19]ETS 300 356-34: "Integrated Services Digital Network (ISDN); Signalling SystemNo.7; ISDN User Part (ISUP) version 2 for the international interface; Part 34:Protocol Implementation Conformance Statement (PICS) proforma specificationfor supplementary services".[20]ETS 300 356-35: "Integrated Services Digital Network (ISDN); Signalling SystemNo.7; ISDN User Part (ISUP) version 2 for the international interface; Part 35:Test Suite Structure and Test Purposes (TSS&TP) specification forsupplementary services".[21]ETS 300 406: "Methods for Testing and Specification (MTS); Protocol andprofile conformance testing specifications; Standardization methodology".[22]ETR 141: "Methods for Testing and Specification (MTS); Protocol and profileconformance testing specifications; The Tree and Tabular Combined Notation(TTCN) style guide".[23]ISO/IEC 9646-1: "Information technology - Open Systems Interconnection -Conformance testing methodology and framework - Part 1: General concepts".[24]ISO/IEC 9646-2: "Information technology - Open Systems Interconnection -Conformance testing methodology and framework - Part 2: Abstract Test Suitespecification".[25]ISO/IEC 9646-3: "Information technology - Open Systems Interconnection -Conformance testing methodology and framework - Part 3: The Tree andTabular Combined Notation (TTCN)".[26]ISO/IEC 9646-5: "Information technology - Open Systems Interconnection -Conformance testing methodology and framework - Part 5: Requirements ontest laboratories and clients for the conformance assessment process".3Definitions and abbreviations3.1DefinitionsFor the purposes of this ETS, the following definitions apply:-terms defined in the ISUP version 2 reference specifications [1-18];-terms defined in ISO/IEC 9646-1 [23] and in ISO/IEC 9646-3 [25].In particular, the following terms apply:Abstract Test Case (ATC): A complete and independent specification of the actions required to achieve aspecific test purpose, defined at the level of abstraction of a particular Abstract Test Method, starting in astable testing state and ending in a stable testing state (see ISO/IEC 9646-1 [23], subclause 3.3.3).Abstract Test Method (ATM): The description of how an IUT is to be tested, given at an appropriate levelof abstraction to make the description independent of any particular realization of a Means of Testing, butwith enough detail to enable abstract test cases to be specified for this method (see ISO/IEC 9646-1 [23],subclause 3.3.5).Abstract Test Suite (ATS): A test suite composed of abstract test cases (see ISO/IEC 9646-1 [23],subclause 3.3.6).Implementation Under Test (IUT): An implementation of one or more OSI protocols in an adjacentuser/provider relationship, being part of a real open system which is to be studied by testing (seeISO/IEC 9646-1 [23], subclause 3.3.43).Means Of Testing (MOT): The combination of equipment and procedures that can perform thederivation, selection, parametrization and execution of test cases, in conformance with a referencestandardized ATS, and can produce a conformance log (see ISO/IEC 9646-1 [23], subclause 3.3.54).SIST ETS 300 356-36:1999
Page 10ETS 300 356-36: March 1998Point of Control and Observation (PCO): A point within a testing environment where the occurrence oftest events is to be controlled and observed, as defined in an abstract test method (seeISO/IEC 9646-1 [23], subclause 3.3.64).pre-test condition: A setting or state in the IUT which cannot be achieved by providing stimulus from thetest environment.Protocol Implementation Conformance Statement (PICS): A statement made by the supplier of aprotocol claimed to conform to a given specification, stating which capabilities have been implemented(see ISO/IEC 9646-1 [23], subclauses 3.3.39 and 3.3.80).PICS proforma: A document, in the form of a questionnaire, which when completed for animplementation or system becomes the PICS.Protocol Implementation eXtra Information for Testing (PIXIT): A statement made by a supplier orimplementor of an IUT (protocol) which contains or references all of the information related to the IUT andits testing environment, which will enable the test laboratory to run an appropriate test suite against theIUT (see ISO/IEC 9646-1 [23], subclauses 3.3.41 and 3.3.81).PIXIT proforma: A document, in the form of a questionnaire, which when completed for the IUT becomesthe PIXIT.System Under Test (SUT): The real open system in which the IUT resides (see ISO/IEC 9646-1 [23],subclause 3.3.103).user: The access protocol entity at the User side of the user-network interface where a T reference pointor coincident S and T reference point applies.3.2AbbreviationsFor the purposes of this ETS, the following abbreviations apply:3PTYThree-PartyASEApplication Service EntityASPAbstract Service PrimitiveATCAbstract Test CaseATMAbstract Test MethodATSAbstract Test SuiteCCBSCompletion of Calls to Busy SubscriberCDIVCall DiversionCFBCall Forwarding BusyCFNRCall Forwarding No ReplyCFUCall Forwarding UnconditionalCICCircuit Identification CodeCLIPCalling Line Identification PresentationCLIRCalling Line Identification RestrictionCntrlEControlling ExchangeCOLPConnected Line Identification PresentationCOLRConnected Line Identification RestrictionCONFConference call, add-onCUGClosed User GroupCWCall WaitingDLEDestination Local ExchangeDSS1Digital Subscriber Signalling System No. oneECTExplicit Call TransferHOLDCall HoldIncIEIncoming International ExchangeIntermEIntermediate ExchangeISCInternational Switching CentreISDNIntegrated Services Digital NetworkISUPISDN User PartITEInternational Transit ExchangeIUTImplementation Under TestSIST ETS 300 356-36:1999
Page 11ETS 300 356-36: March 1998IWorkEInterworking ExchangeLAPDLink Access Protocol for the D-channelLTLower TesterMCIDMalicious Call IdentificationMOTMeans Of TestingMTCMain Test ComponentMTPMessage Transfer PartNNINetwork-Network InterfaceNTENational Transit ExchangeOLEOriginating Local ExchangeOutIEOutgoing International ExchangePCOPoint of Control and ObservationPCTRProtocol Conformance Test ReportPDUProtocol Data UnitPICSProtocol Implementation Conformance StatementPIXITProtocol Implementation eXtra Information for TestingPTCParallel Test ComponentSCSSystem Conformance StatementSPSignalling PointSPCSignalling Point CodeSS7Signalling System No.7SUBSubaddressingSUTSystem Under TestTCPTest Co-ordination ProceduresTSS&TPTest Suite Structure and Test PurposesTTCNTree and Tabular Combined NotationUNIUser-Network InterfaceUUSUser-to-User SignallingUUSnUUS service n (n = 1.3)4Implementation under test and test methods4.1Identification of the system and implementation under testThe System Under Test (SUT) is an exchange. The Implementation Under Test (IUT) is the ISUPversion 2 implementation in this exchange, mainly the part responsible for the supplementary servicesfunctionality, as shown in figure 1.ISUP v2SUTIUTExchangeAccesssupplementaryservicesISUPISUPSUT - System Under TestISUP - ISDN User PartIUT - Implementation Under TestFigure 1: Exchange as SUTThe ISUP signalling protocol can be observed on the SS7 link on the Network-Network Interface (NNI).The effects of signalling procedures of ISUP can be observed on the circuits controlled by the ISUP on theNNI.The ISUP implementation will in some exchanges have to interwork with the Access signalling system onthe User-Network Interface (UNI) and involve call handling in order to establish end-to-end connections.SIST ETS 300 356-36:1999
Page 12ETS 300 356-36: March 1998From ETS 300 356-1 [1], several types of exchanges (or roles) can be identified (see figure 2).OLEDLETransitNTEGatewayOutIETransitITEGatewayIncIEAccessAccessnationalnetworknationalnetworkinternationalnetworkintermediatelocallocalOLE - Originating Local ExchangeNTE - National
Transit ExchangeOutIE - Outgoing International ExchangeITE - International
Transit ExchangeIncIE - Incoming International ExchangeDLE - Destination Local ExchangeFigure 2: Roles of exchangesThe exchanges can be divided in two main groups according to their functionality: local exchanges, wherecalls originate and terminate, and intermediate exchanges, with transit functionality. Local exchanges arenational, i.e. belong to a national network. Intermediate exchanges are national or international. Theinternational intermediate exchanges which permit access to the international network are the gatewayexchanges (incoming and outgoing), also called International Switching Centres (ISCs). A particularity forsome supplementary services, e.g. call diversion services, is that a local exchange is not onlyoriginator/terminator of the call but also mediator between two far-end local exchanges.The roles of the exchanges are summarized in table 1.Table 1: Roles of exchangesLocalIntermediate exchangeexchangeNationalInternationalOriginating Local ExchangeOLETransit ExchangeNTEITEIncoming/Gateway ExchangeIncIEOutgoing/Gateway ExchangeOutIEDestination Local ExchangeDLE4.2ATM and testing configuration for ISUP version 2The Abstract Test Method (ATM) chosen for the ISUP version 2 supplementary services testingspecification is the distributed multi-party test method. The ATM is defined at an appropriate level ofabstraction so that the test cases may be specified appropriately, without adding restrictions to the IUT.The testing architectures are described in the following subclauses.The ATS is written in concurrent TTCN.SIST ETS 300 356-36:1999
Page 13ETS 300 356-36: March 19984.2.1Intermediate exchangesThe configuration proposed for testing intermediate exchanges is shown in figure 3. In order to test theprotocol and functionality of transit and gateway exchanges one needs to consider the incoming andoutgoing side of the SUT.SP ASP BIUTLTNetwork service providerTCPCABLABLTISUP linkCircuitsLTLTPhysical aspectsCircuitsISUP linkNetwork service providerSP CCACLACIUT - Implementation Under TestLT - Lower TesterTCP - Test Coordination ProceduresSP - Signalling PointLAB - PCO for signalling link ABPCO - Point of Control and ObservationCAB - PCO for AB circuitsLAC - PCO for signalling link ACCAC - PCO for AC circuitsFigure 3: ISUP test method for intermediate exchangesThe IUT is observed and controlled from two ISUP links with associated circuits. The Points of Controland Observation (PCO) are labelled LAB and CAB on one side, and LAC and CAC on the other.The LAB and LAC PCOs are used by the Lower Testers (LT) for controlling the ISUP signalling link,whereas the CAB and CAC PCOs are used by the lower testers for observing circuit related events, suchas connectivity, echo control check, alerting tone, etc.The ISUP PDUs to be sent and observed on the LAB PCO side allow for PDU constraints to be specifiedand coded down to the bit-level.NOTE:The underlying network service provider is the Message Transfer Part (MTP) protocolas specified in ITU-T Recommendations Q.701-Q.707/ETS 300 008.SIST ETS 300 356-36:1999
Page 14ETS 300 356-36: March 1998Figure 4 shows the actual used configuration for intermediate exchanges, with a Main T
...
Questions, Comments and Discussion
Ask us and Technical Secretary will try to provide an answer. You can facilitate discussion about the standard in here.