ETSI ETR 346 ed.1 (1996-12)

Terrestrial Trunked Radio (TETRA); Air Interface (AI) layer 2 and 3 protocol validation; Part 1: Validation of test suites for Voice plus Data (V+D)

DTR/TETRA-00013-1

Radijska oprema in sistemi (RES) - Vseevropski sistem snopovnega radia (TETRA) - Oveljavitev (validacija) protokola radijskega vmesnika 2. in 3. plasti - 1. del: Oveljavitev (validacija) preskušalnih zaporedij za govor in podatke (V+D)

General Information

• Status: Published
• Publication Date: 23-Dec-1996
• Technical Committee: TCCE - TETRA and Critical Communications Evolution
• Current Stage: 13 - TB decision to make document historical
• Due Date: 23-Feb-2004
• Completion Date: 23-Feb-2004
• Mandate: BC-T-344
• Mandate: T-172
• Ref Project: PSIST ETR 346:1999 - Terrestrial Trunked Radio (TETRA); Air Interface (AI) layer 2 and 3 protocol validation; Part 1: Validation of test suites for Voice plus Data (V+D)

Standards Content (Sample)

SLOVENSKI STANDARD
PSIST ETR 346:1999
01-december-1999
Radijska oprema in sistemi (RES) - Vseevropski sistem snopovnega radia (TETRA)
- Oveljavitev (validacija) protokola radijskega vmesnika 2. in 3. plasti - 1. del:
Oveljavitev (validacija) preskušalnih zaporedij za govor in podatke (V+D)
Terrestrial Trunked Radio (TETRA); Air Interface (AI) layer 2 and 3 protocol validation;
Part 1: Validation of test suites for Voice plus Data (V+D)
Ta slovenski standard je istoveten z: ETR 346 Edition 1
ICS:
33.070.10 Prizemni snopovni radio Terrestrial Trunked Radio
(TETRA) (TETRA)
PSIST ETR 346:1999 en
2003-01.Slovenski inštitut za standardizacijo. Razmnoževanje celote ali delov tega standarda ni dovoljeno.

---------------------- Page: 1 ----------------------

PSIST ETR 346:1999

---------------------- Page: 2 ----------------------

PSIST ETR 346:1999
ETSI ETR 346
TECHNICAL December 1996
REPORT
Source: ETSI TC-RES Reference: DTR/RES-06013-1
ICS: 33.020
Key words: Testing, TTCN, abstract test suite, validation
Radio Equipment and Systems (RES);
Trans-European Trunked Radio (TETRA);
Air Interface (AI) layer 2 and layer 3 protocol validation;
Part 1: Validation of test suites for Voice plus Data (V+D)
ETSI
European Telecommunications Standards Institute
ETSI Secretariat
Postal address: F-06921 Sophia Antipolis CEDEX - FRANCE
Office address: 650 Route des Lucioles - Sophia Antipolis - Valbonne - FRANCE
X.400: c=fr, a=atlas, p=etsi, s=secretariat - Internet: [e-mail]
Tel.: [phone] - Fax: [phone]
Copyright Notification: No part may be reproduced except as authorized by written permission. The copyright and the
foregoing restriction extend to reproduction in all media.
© European Telecommunications Standards Institute 1996. All rights reserved.

---------------------- Page: 3 ----------------------

PSIST ETR 346:1999
Page 2
ETR 346: December 1996
Whilst every care has been taken in the preparation and publication of this document, errors in content,
typographical or otherwise, may occur. If you have comments concerning its accuracy, please write to
"ETSI Editing and Committee Support Dept." at the address shown on the title page.

---------------------- Page: 4 ----------------------

PSIST ETR 346:1999
Page 3
ETR 346: December 1996
Contents
Foreword .5
1 Scope .7
2 References.7
3 Definitions and abbreviations .7
3.1 Definitions .7
3.2 Abbreviations .8
4 Introduction.8
5 General.8
5.1 Test suite validation principles.8
5.2 Validation properties .10
5.3 Different validation approaches .11
5.3.1 Approach 1 .11
5.3.2 Approach 2 .12
5.3.3 Approach 3 .12
6 Validation performed .13
6.1 Validation process.13
6.2 Validation results.13
7 Summary.13
History.15

---------------------- Page: 5 ----------------------

PSIST ETR 346:1999
Page 4
ETR 346: December 1996
Blank page

---------------------- Page: 6 ----------------------

PSIST ETR 346:1999
Page 5
ETR 346: December 1996
Foreword
This ETSI Technical Report (ETR) has been produced by the Radio Equipment and Systems (RES)
Technical Committee of the European Telecommunications Standards Institute (ETSI).
ETRs are informative documents resulting from ETSI studies which are not appropriate for European
Telecommunication Standard (ETS) or Interim European Telecommunication Standard (I-ETS) status. An
ETR may be used to publish material which is either of an informative nature, relating to the use or the
application of ETSs or I-ETSs, or which is immature and not yet suitable for formal adoption as an ETS or
an I-ETS.

---------------------- Page: 7 ----------------------

PSIST ETR 346:1999
Page 6
ETR 346: December 1996
Blank page

---------------------- Page: 8 ----------------------

PSIST ETR 346:1999
Page 7
ETR 346: December 1996
1 Scope
This ETSI Technical Report (ETR) defines the methods, procedures, and validation purposes used for the
formal validation of the Tree and Tabular Combined Notation (TTCN) conformance test suites for TETRA
Voice and Data (V+D) Air Interface (AI) and documents the results of the validation.
2 References
For the purposes of this ETR, the following references apply:
[1] ETS 300 394-2-1: "Radio Equipment and Systems (RES); Trans-European
Trunked Radio (TETRA); Conformance testing specification, Part 2: Protocol
testing specification for Voice plus Data (V+D); Part 2-1: Test suites structure
and test purposes".
[2] ETS 300 394-2-2: "Radio Equipment and Systems (RES); Trans-European
Trunked Radio (TETRA); Conformance testing specification, Part 2: Protocol
testing specification for Voice plus Data (V+D); Part 2-2: Abstract Test Suite
(ATS) for Network (NWK) layer".
[3] ETS 300 394-2-3: "Radio Equipment and Systems (RES); Trans-European
Trunked Radio (TETRA); Conformance testing specification, Part 2: Protocol
testing specification for Voice plus Data (V+D); Part 2-3: Abstract Test Suite
(ATS) for Logical Link Control (LLC)".
[4] ETS 300 394-2-4: "Radio Equipment and Systems (RES); Trans-European
Trunked Radio (TETRA); Conformance testing specification, Part 2: Protocol
testing specification for Voice plus Data (V+D); Part 2-4: Abstract Test Suite
(ATS) for Medium Access Control (MAC)".
[5] ETS 300 392-2: "Radio Equipment and Systems (RES); Trans-European
Trunked Radio (TETRA); Voice plus Data (V+D); Part 2: Air Interface (AI)".
[6] ETR 293-1: "Radio Equipment and Systems (RES); Trans-European Trunked
Radio (TETRA); Air Interface (AI) layer 2 and 3 protocol validation;
Part 1: Validation of SDL models for Voice plus Data (V+D)".
[7] ISO/IEC 9646-3 (1991): "Information technology - Open Systems
Interconnection - Conformance testing methodology and framework - Part 3:
The tree and tabular combined notation". (See also
CCITT Recommendation X.292 (1992)).
[8] ITU-T Recommendation Z.105 (1995): "SDL combined with ASN.1".
3 Definitions and abbreviations
3.1 Definitions
For the purposes of this ETR, the following definitions apply:
external validation: Validation of TTCN test suite properties except for those related to the TTCN
language definition.
internal validation: Checking the correctness of a TTCN test suite according to the rules of TTCN as
defined in ISO 9646, part 3 [7].

---------------------- Page: 9 ----------------------

PSIST ETR 346:1999
Page 8
ETR 346: December 1996
3.2 Abbreviations
For the purposes of this ETR, the following abbreviations apply:
ASN.1 Abstract Syntax Notation number One
ATS Abstract Test Suite
CMCE Circuit Mode Control Entity
ExTS Executable Test Suite
LLC Logical Link Control
MAC Medium Access Control
MLE Mobile Link Entity
MM Mobility Management
NWK Network
PDU Protocol Data Unit
SCLNP Specific Connectionless Network Protocol
SDL Specification and Description Language
TTCN Tree and Tabular Combined Notation
4 Introduction
This ETR documents the validation of the TETRA V+D protocol conformance test suites for Network
(NWK) layer, ETS 300 394-2-2 [2], Logical Link Control (LLC), ETS 300 394-2-3 [3], and the Medium
Access Control (MAC), ETS 300 394-2-4 [4].
For the test purposes and test suites structure refer to ETS 300 394-2-1 [1] and for the protocol
specification to ETS 300 392-2 [5].
The purpose of the test suite validation is to ensure the quality of the Abstract Test Suites (ATS) which
forms the basis for test suite implementations.
This test suite validation has been focused on the use of formal validation methods that are supported by
the tools available at ETSI. The ETR also provides a brief description of other aspects of test suite
validation, which were considered as potential validation methods, but were not applied in the validation
documented in this ETR.
5 General
5.1 Test suite validation principles
The Abstract Test Suites (ATSs) for the protocols in TETRA are specifications in the process of defining
the conformance criterion for TETRA products. An ATS specification serves both as an operational
definition of the test purposes and as a basis for development of Executable Test Suites (ExTSs). The
checking of these different properties of an ATS is the purpose of test suite validation.
In figure 1 validation properties for an ATS are shown. The term "Protocol requirements" used in figure 1
refers to all requirements defined in either of the protocol description, protocol model or protocol test
purpose documents. Each of the highlighted validation properties are further explained in subclause 5.2.

---------------------- Page: 10 ----------------------

PSIST ETR 346:1999
Page 9
ETR 346: December 1996
Validation properties
Protocol requirements
validate Correctness
to derive
against Coverage
TTCN ATS
Implementability
validate
to derive
Executability
against
ExTS
Figure 1: Test suite validation properties
In addition to the validation properties shown in figure 1, a TTCN test suite should also be checked against
the rules of TTCN, defined in ISO 9646, part 3 [7]. This type of validation is denoted internal validation,
while the validation of all other properties is denoted external validation.
Methods for TTCN test suite validation can be distinguished on whether they are based on formal models
and formally defined relations between such models or on informal methods. Informal validation methods
often are based on inspection techniques, which can be automated and supported by tools only to a
limited extent.
Validation methods based on formal models are a prerequisite for tool supported and automatic check of
validation properties. Formal methods, in principle, allow exhaustive checking of the validation properties.
For the TETRA protocol test suites both informal and formal validation methods in principle could be
applied as indicated in figure 2.
Informal specifications Formal specifications
(Protocol
validation)
Textual protocol
SDL protocol
specifications
specifications
Formal
validation
Informal
Formal
validation
validation
TTCN
Test purposes
TTCN ATS
definition
Informal
validation
ExTS
Figure 2: Formal and informal validation possibilities for TETRA protocol ATSs

---------------------- Page: 11 ----------------------

PSIST ETR 346:1999
Page 10
ETR 346: December 1996
Protocol validation is indicated in figure 2 but is not part of test suite validation, rather it can be seen as a
prerequisite to ensure the value of the test suite validation. Using protocol validation it is possible to check
that a formal model consistently specifies the requirements of the textual protocol specifications. In the
case of TETRA, a validated model of the V+D protocols exists. The model is specified using formal
Specification and Description Language (SDL). For further information on the protocol validation refer to
ETR 293-1 [6].
In figure 2 it is also indicated that the validation of the ATS with respect to the ExTS can only be
performed using informal validation methods. In principle this can be done using formal validation as the
ETSI tools for TTCN test case specification includes a TTCN compiler. However, as the implementation of
an ATS is outside the scope of standardization, only informal validation methods are supposed to be
applied for validation properties like implementation and execution.
5.2 Validation properties
As the validation properties are open for different interpretations they shall be further refined to be
supported by systematic methods. The internal TTCN test suite validation property generally covers
validation of an ATS with respect to the rules of the TTCN definition in ISO 9646, part 3 [7].
The internal validation property comprises of:
- checking the syntactical correctness of a TTCN test suite according to the TTCN syntax rules;
- checking that the test suite comply with the
...