ETSI EG 202 798 V1.1.1 (2010-11)

Intelligent Transport Systems (ITS); Testing; Framework for conformance and interoperability testing

DEG/ITS-0020022

Inteligentni transportni sistemi (ITS) - Preskušanje - Okvir za skladnost in preskušanje medobratovalnosti

Določa globalni okvir za preskuse skladnosti in medobratovalnosti v ITS.

General Information

• Status: Published
• Publication Date: 12-Jan-2011
• Technical Committee: ITS WG2 - Architecture and Cross Layer
• Current Stage: 12 - Completion
• Due Date: 18-Jan-2011
• Completion Date: 13-Jan-2011
• Mandate: M/453
• Ref Project: SIST-V ETSI/EG 202 798 V1.1.1:2011 - Intelligent Transport Systems (ITS) - Testing - Framework for conformance and interoperability testing

Standards Content (Sample)

SLOVENSKI STANDARD
SIST-V ETSI/EG 202 798 V1.1.1:2011
01-junij-2011
Inteligentni transportni sistemi (ITS) - Preskušanje - Okvir za skladnost in
preskušanje medobratovalnosti
Intelligent Transport Systems (ITS) - Testing - Framework for conformance and
interoperability testing
Ta slovenski standard je istoveten z: EG 202 798 Version 1.1.1
ICS:
35.240.60 Uporabniške rešitve IT v IT applications in transport
transportu in trgovini and trade
SIST-V ETSI/EG 202 798 V1.1.1:2011 en
2003-01.Slovenski inštitut za standardizacijo. Razmnoževanje celote ali delov tega standarda ni dovoljeno.

---------------------- Page: 1 ----------------------

SIST EG 202 798 V1.1.1:2011

---------------------- Page: 2 ----------------------

SIST EG 202 798 V1.1.1:2011

ETSI EG 202 798 V1.1.1 (2011-01)
ETSI Guide


Intelligent Transport Systems (ITS);
Testing;
Framework for conformance and interoperability testing

---------------------- Page: 3 ----------------------

SIST EG 202 798 V1.1.1:2011
 2 ETSI EG 202 798 V1.1.1 (2011-01)



Reference
DEG/ITS-0020022
Keywords
ITS, testing, conformance, interoperability
ETSI
650 Route des Lucioles
F-06921 Sophia Antipolis Cedex - FRANCE

Tel.: [phone]  Fax: [phone]

Siret N° 348 623 562 00017 - NAF 742 C
Association à but non lucratif enregistrée à la
Sous-Préfecture de Grasse (06) N° 7803/88

Important notice
Individual copies of the present document can be downloaded from:
http://www.etsi.org
The present document may be made available in more than one electronic version or in print. In any case of existing or
perceived difference in contents between such versions, the reference version is the Portable Document Format (PDF).
In case of dispute, the reference shall be the printing on ETSI printers of the PDF version kept on a specific network drive
within ETSI Secretariat.
Users of the present document should be aware that the document may be subject to revision or change of status.
Information on the current status of this and other ETSI documents is available at
http://portal.etsi.org/tb/status/status.asp
If you find errors in the present document, please send your comment to one of the following services:
http://portal.etsi.org/chaircor/ETSI_support.asp
Copyright Notification
No part may be reproduced except as authorized by written permission.
The copyright and the foregoing restriction extend to reproduction in all media.

© European Telecommunications Standards Institute 2011.
All rights reserved.

TM TM TM TM
DECT , PLUGTESTS , UMTS , TIPHON , the TIPHON logo and the ETSI logo are Trade Marks of ETSI registered
for the benefit of its Members.
TM
3GPP is a Trade Mark of ETSI registered for the benefit of its Members and of the 3GPP Organizational Partners.
LTE™ is a Trade Mark of ETSI currently being registered
for the benefit of its Members and of the 3GPP Organizational Partners.
GSM® and the GSM logo are Trade Marks registered and owned by the GSM Association.
ETSI

---------------------- Page: 4 ----------------------

SIST EG 202 798 V1.1.1:2011
 3 ETSI EG 202 798 V1.1.1 (2011-01)
Contents
Intellectual Property Rights . 5
Foreword . 5
Introduction . 5
1 Scope . 6
2 References . 6
2.1 Normative references . 6
2.2 Informative references . 6
3 Definitions and abbreviations . 10
3.1 Definitions . 10
3.2 Abbreviations . 10
4 ITS foundations . 10
4.1 Motivation for and structure of the document . 10
4.2 ITS environment . 11
4.3 ITS base standards . 14
4.4 ITS test standards . 16
5 Introduction to the ITS testing framework EG . 16
5.1 Conformance testing. 17
5.2 Interoperability testing . 17
5.3 Steps for development of test specifications . 18
6 Conformance testing. 18
6.1 Candidate IUTs . 18
6.2 Reference points . 20
6.3 Identification of abstract test method . 22
6.3.1 Abstract protocol tester . 22
6.3.2 Functional TTCN-3 test architecture . 24
7 Interoperability testing . 25
7.1 Candidate EUTs . 25
7.2 Test scenarios . 25
7.3 Test bed architecture . 25
7.4 Test bed interfaces . 28
8 Development of test specifications and test suites . 29
8.1 Provision of ICS pro-forma . 29
8.2 Provision of TSS&TPs . 29
8.2.1 Test suite structure (TSS) . 29
8.2.2 TP pro-forma . 30
8.2.3 TP identifier . 31
8.2.4 Test objective . 32
8.2.5 Reference . 32
8.2.6 PICS selection . 33
8.2.7 TP behaviour . 33
8.3 Development of TTCN-3 test suite . 35
8.3.1 Global TTCN-3 test architecture . 35
8.3.2 Importing ASN.1 definition . 37
8.3.3 The TTCN-3 naming conventions . 38
8.3.4 TTCN-3 code documentation . 40
8.3.5 Test cases structure . 40
8.4 Provision of IFS pro-forma . 41
8.5 Provision of Test Descriptions . 41
Annex A: Introduction to Interoperability testing . 44
ETSI

---------------------- Page: 5 ----------------------

SIST EG 202 798 V1.1.1:2011
 4 ETSI EG 202 798 V1.1.1 (2011-01)
A.1 Principles . 44
A.2 Interoperability testing process . 44
A.3 Interoperability testing with conformance checks . 45
A.4 Automated interoperability testing . 45
History . 48

ETSI

---------------------- Page: 6 ----------------------

SIST EG 202 798 V1.1.1:2011
 5 ETSI EG 202 798 V1.1.1 (2011-01)
Intellectual Property Rights
IPRs essential or potentially essential to the present document may have been declared to ETSI. The information
pertaining to these essential IPRs, if any, is publicly available for ETSI members and non-members, and can be found
in ETSI SR 000 314: "Intellectual Property Rights (IPRs); Essential, or potentially Essential, IPRs notified to ETSI in
respect of ETSI standards", which is available from the ETSI Secretariat. Latest updates are available on the ETSI Web
server (http://webapp.etsi.org/IPR/home.asp).
Pursuant to the ETSI IPR Policy, no investigation, including IPR searches, has been carried out by ETSI. No guarantee
can be given as to the existence of other IPRs not referenced in ETSI SR 000 314 (or the updates on the ETSI Web
server) which are, or may be, or may become, essential to the present document.
Foreword
This ETSI Guide (EG) has been produced by ETSI Technical Committee Intelligent Transport System (ITS).
The present document assumes that the reader has basic knowledge in testing as presented e.g. in [i.4], [i.7].
Introduction
"Intelligent Transport Systems" (ITS) are systems to support transportation of goods and humans with information and
communication technologies in order to efficiently and safely use the transport infrastructure and transport means (cars,
trains, planes, ships). With a focus on road transportation, elements of ITS for global applications are standardized in
various standardisation organisations, both on an international level at e.g. ISO TC204, and on regional levels, e.g. in
Europe at ETSI TC ITS and at CEN TC278 [i.13], [i.22].
The importance of ITS for the regional and the international market is expressed by the large number of activities of
stake-holders, within regional research projects, industry initiatives and regional and international standardisation.
In Europe, the urgent need for ITS standards and the related test standards is expressed by the new mandate M/453 of
the Commission of the European Union [i.36].
Mandate M/453 [i.36] also is given in the context of international harmonisation, as expressed by the EU-US joint
declaration of intent on research cooperation in cooperative systems [i.35].
ETSI is prepared to take over a leading role in this process towards harmonized ITS. A major effort is on conformance
and interoperability testing, which is being prepared by the present document on "ITS testing framework". The protocol
conformance and interoperability testing framework is essential for a systematic and consistent approach towards
testing of globally applicable ITS communications equipment.
ETSI

---------------------- Page: 7 ----------------------

SIST EG 202 798 V1.1.1:2011
 6 ETSI EG 202 798 V1.1.1 (2011-01)
1 Scope
The scope of the present document is to support ITS projects on the development of test specifications for ITS base
standards from ETSI, ISO, CEN and other "Standard Developing Organisations" (SDOs) by providing:
• An ITS testing framework for conformance testing.
• An ITS testing framework for interoperability testing.
The testing framework proposed in the present document provides guidance for development of conformance and
interoperability test strategies, test systems and the resulting test specifications for ITS.
2 References
References are either specific (identified by date of publication and/or edition number or version number) or
non-specific. For specific references, only the cited version applies. For non-specific references, the latest version of the
reference document (including any amendments) applies.
Referenced documents which are not found to be publicly available in the expected location might be found at
http://docbox.etsi.org/Reference.
NOTE: While any hyperlinks included in this clause were valid at the time of publication ETSI cannot guarantee
their long term validity.
2.1 Normative references
The following referenced documents are necessary for the application of the present document.
Not applicable.
2.2 Informative references
The following referenced documents are not necessary for the application of the present document but they assist the
user with regard to a particular subject area.
[i.1] ETSI ETR 266: "Methods for Testing and Specification (MTS); Test Purpose style guide".
[i.2] ETSI ETS 300 406: "Methods for Testing and Specification (MTS); Protocol and profile
conformance testing specifications; Standardization methodology".
[i.3] ETSI EG 201 058: "Methods for Testing and Specification (MTS); Implementation Conformance
Statement (ICS) proforma style guide".
[i.4] ETSI ES 201 873 (all parts): "Methods for Testing and Specification (MTS); The Testing and Test
Control Notation version 3".
[i.5] ETSI EG 202 237: "Methods for Testing and Specification (MTS); Internet Protocol Testing
(IPT); Generic approach to interoperability testing".
[i.6] ETSI EG 202 810: "Methods for Testing and Specification (MTS); Automated Interoperability
Testing; Methodology and Framework".
[i.7] ISO/IEC 9646 (all parts): "Information technology - Open Systems Interconnection - Conformance
testing methodology and framework".
[i.8] ISO 10746 (all parts): "Information technology - Open Distributed Processing - Reference model".
[i.9] ISO 21210: "Intelligent transport systems - Communications Access for land Mobiles (CALM) -
Non-IP networking".
ETSI

---------------------- Page: 8 ----------------------

SIST EG 202 798 V1.1.1:2011
 7 ETSI EG 202 798 V1.1.1 (2011-01)
[i.10] ISO 21213: "Intelligent transport systems - Communications Access for Land Mobiles (CALM) -
3 G".
[i.11] ISO 21214: "Intelligent transport systems - Communications Access for Land Mobiles (CALM) -
IR".
[i.12] ISO 21215: "Intelligent transport systems - Communications Access for Land Mobiles (CALM) -
M5".
[i.13] ISO 21217: "Intelligent transport systems - Communications Access for Land Mobiles (CALM) -
Architecture".
[i.14] ISO 21218: "Intelligent transport systems - Communications Access for Land Mobiles (CALM) -
Medium Service Access Points".
[i.15] ISO 24102: "Intelligent Transport Systems - Communications Access for Land Mobiles (CALM) -
ITS station management".
[i.16] ISO 29281: "Intelligent transport systems - Communications Access for Land Mobiles (CALM) -
Non-IP networking".
[i.17] ETSI TS 102 636: "Intelligent Transportation System (ITS); Vehicular communications;
GeoNetworking".
[i.18] ETSI TS 102 637 (all parts): "Intelligent Transport Systems (ITS); Vehicular Communications;
Basic Set of Applications; multiple parts".
[i.19] ETSI TS 102 687: "Intelligent Transport Systems (ITS); Transmitter Power Control Mechanism
for Intelligent Transport Systems operating in the 5 GHz range".
[i.20] ETSI TS 102 724: "Intelligent Transport Systems (ITS); Harmonized Channel Specifications for
Intelligent Transport Systems operating in the 5 GHz frequency band".
[i.21] ETSI TS 102 860: "Intelligent Transport Systems (ITS); Classification and management of
applications".
[i.22] ETSI EN 302 665: "Intelligent Transport Systems (ITS); Communications Architecture".
[i.23] ETSI TS 102 760-2: "Intelligent Transport Systems (ITS); Test specifications for Intelligent
Transport Systems; Communications Access for Land Mobiles (CALM); Medium Service Access
Points (ISO 21218); Part 2: Test Suite Structure and Test Purposes (TSS&TP)".
[i.24] ETSI TS 102 797-2: "Intelligent Transport Systems (ITS); Road Transport and Traffic Telematics
(RTTT); Test specifications for Intelligent Transport Systems, Communications Access for Land
Mobiles (CALM), Interface Manager (ISO 24102); Part 2: Test Suite Structure and Test Purposes
(TSS & TP)".
[i.25] ETSI TS 102 859-2: "Intelligent Transport Systems (ITS); Testing; Conformance test
specifications for Transmission of IP packets over GeoNetworking; Part 2: Test Suite Structure
and Test Purposes (TSS&TP)".
[i.26] ETSI TS 102 868-2: "Intelligent Transport System (ITS); Testing; Conformance test specification
for Co-operative Awareness Messages (CAM); Part 2: Test Suite Structure and Test Purposes
(TSS&TP)".
[i.27] ETSI TS 102 869-2: "Intelligent Transport System (ITS); Testing; Conformance test specification
for Decentralized environmental Notification Messages (DNM); Part 2: Test Suite Structure and
Test Purposes (TSS&TP)".
[i.28] ETSI TS 102 870-2: "Intelligent Transport Systems (ITS); Testing; Conformance test
specifications for GeoNetworking Basic Transport Protocol (BTP); Part 2: Test Suite Structure and
Test Purposes (TSS&TP)".
[i.29] ETSI TS 102 871-2: "Intelligent Transport Systems (ITS); Testing; Conformance test
specifications for GeoNetworking ITS-G5; Part 2: Test Suite Structure and Test Purposes
(TSS&TP)".
ETSI

---------------------- Page: 9 ----------------------

SIST EG 202 798 V1.1.1:2011
 8 ETSI EG 202 798 V1.1.1 (2011-01)
[i.30] ETSI TS 102 981-2: "Intelligent Transport Systems; Test specifications for Intelligent Transport
Systems; Communications Access for Land Mobiles (CALM); IP networking (ISO 21210); Part 2:
Test Suite Structure and Test Purposes (TSS&TP)".
[i.31] ETSI TS 102 982-2: "Intelligent Transport Systems; Test specifications for Intelligent Transport
Systems; Communications Access for Land Mobiles (CALM); IR (ISO 21214); Part 2: Test Suite
Structure and Test Purposes (TSS&TP)".
[i.32] ETSI TS 102 983-2: "Intelligent Transport Systems; Test specifications for Intelligent Transport
Systems; Communications Access for Land Mobiles (CALM); M5 (ISO 21215); Part 2: Test Suite
Structure and Test Purposes (TSS&TP)".
[i.33] ETSI TS 102 984-2: "Intelligent Transport Systems; Test specifications for Intelligent Transport
Systems; Communications Access for Land Mobiles (CALM); Architecture (ISO 21217);
Part 2: Test Suite Structure and Test Purposes (TSS&TP)".
[i.34] ETSI TS 102 985-2: "Intelligent Transport Systems; Test specifications for Intelligent Transport
Systems; Communications Access for Land Mobiles (CALM); Non-IP networking (ISO 29281);
Part 2: Test Suite Structure and Test Purposes (TSS&TP)".
[i.35] EU-US Joint Declaration of Intent on Research Cooperation in Cooperative Systems, Washington,
D.C., EC/DGINFSO and USDOT/RITA, November 2009.
NOTE: Available at:
http://ec.europa.eu/information_society/activities/esafety/doc/library/us/joint_decl_on_coop_systems.pdf.
[i.36] Standardisation mandate addressed to CEN, CENELEC and ETSI in the field of information and
communication technologies to support the interoperability of co-operative systems for intelligent
transport in the european community, M/453, October 2009.
NOTE: Available at: http://ec.europa.eu/enterprise/sectors/ict/files/standardisation_mandate_en.pdf.
[i.37] ISO 16445: "Intelligent Transport Systems - Communications access for land mobiles (CALM) -
Handover mechanisms".
[i.38] IEEE 802.11: "Telecommunications and information exchange between systems - Local and
metropolitan area networks-Specific requirements - Part 11: Wireless LAN Medium Access
Control (MAC) and Physical Layer (PHY) Specifications".
[i.39] ISO 16444: "Intelligent Transport Systems - Communications access for land mobiles (CALM) -
Geo-routing".
[i.40] ISO 16440: "Intelligent Transport Systems - Communications access for land mobiles (CALM) -
WAVE".
[i.41] ISO 16460: "Wave Intergration".
[i.42] ISO IS 24978: "Intelligent transport systems - ITS Safety and emergency messages using any
available wireless media - Data registry procedures".
[i.43] ISO IS 15662: "Intelligent transport systems - Wide area communication - Protocol management
information".
[i.44] ISO IS 24101 (all parts): "Intelligent transport systems - Communications access for land mobiles
(CALM) - Application management".
[i.45] ISO IS 24103: "Intelligent transport systems - Communications access for land mobiles (CALM) -
Media adapted interface layer (MAIL)".
[i.46] ISO IS 25112: "Intelligent transport systems - Communications access for land mobiles (CALM) -
Mobile wireless broadband using IEEE 802.16".
[i.47] ISO IS 29282: "Intelligent transport systems - Communications access for land mobiles (CALM) -
Applications using satellite networks".
ETSI

---------------------- Page: 10 ----------------------

SIST EG 202 798 V1.1.1:2011
 9 ETSI EG 202 798 V1.1.1 (2011-01)
[i.48] ISO IS 21216: "Intelligent transport systems - Wireless communications - CALM using millimetre
communications".
[i.49] ISO IS 21212: "Intelligent transport systems - Communications access for land mobiles (CALM) -
2G Cellular systems".
[i.50] ISO IS 11776: "Light gauge metal containers - Non-round open-top cans - Cans defined by their
nominal capacities".
[i.51] ISO IS 25111: "Intelligent transport systems - Communications access for land mobiles (CALM) -
General requirements for using public networks".
[i.52] ISO IS 21213: "Intelligent transport systems - Communications access for land mobiles (CALM) -
3G Cellular systems".
[i.53] ISO IS 29283: "ITS CALM Mobile Wireless Broadband applications using Communications in
accordance with IEEE 802.20".
[i.54] ISO IS 25113: "Intelligent transport systems - Communications access for land mobiles (CALM) -
Mobile wireless broadband using HC-SDMA".
[i.55] ISO IS 18183: "Public broadcast reception".
[i.56] IEEE 1609.5: "Standard for Wireless Access in Vehicular Environments (WAVE) -
Communication Manager".
[i.57] IEEE 1609.1: "Standard for Dedicated Short Range Communications (DSRC) Resource Manager".
[i.58] IEEE 1609.0: "Trial-Use Standard for Wireless Access in Vehicular Environments (WAVE) -
Architecture".
[i.59] IEEE 1609.3: "IEEE Draft Standard for Wireless Access in Vehicular Environments (WAVE) -
Networking Services".
[i.60] IEEE 1609.4: "IEEE Draft Standard for Wireless Access in Vehicular Environments (WAVE) -
Multi-Channel Operation".
[i.61] IEEE 1609.2: "Standard for Wireless Access in Vehicular Environments - Security Services for
Applications and Management Messages".
[i.62] ETSI TS 102 731: "Intelligent Transport Systems (ITS); Security; Security Services and
Architecture".
[i.63] ETSI TS 102 894: "Intelligent Transport System (ITS); Users & Applications requirements;
Facility layer structure, functional requirements and specifications".
[i.64] ETSI EN 302 895: "Intelligent Transport Systems (ITS); Vehicular Communications; Basic Set of
Applications; Local Dynamic Map (LDM) Specification".
[i.65] ETSI TS 102 723: "Intelligent Transport Systems; OSI cross-layer topics; Part 11: Interface
between network and transport layers and facilities layer".
[i.66] ETSI TR 102 893: "Intelligent Transport Systems (ITS); Security; Threat, Vulnerability and Risk
Analysis (TVRA)".
[i.67] ETSI ES 202 910: "Intelligent Transport Systems (ITS); Security; Identity Management and
Identity Protection in ITS".
[i.68] ETSI ES 202 663: "Intelligent Transport Systems (ITS); European profile standard for the physical
and medium access control layer of Intelligent Transport Systems operating in the 5 GHz
frequency band".
[i.69] ISO IS 13181 (all parts): "CALM Security".
ETSI

---------------------- Page: 11 ----------------------

SIST EG 202 798 V1.1.1:2011
 10 ETSI EG 202 798 V1.1.1 (2011-01)
3 Definitions and abbreviations
3.1 Definitions
For the purposes of the present document, the terms and definitions given in [i.7], [i.8], [i.13], [i.22] and the following
apply:
conformance testing: process for testing that an implementation is compliant with a protocol standard, which is
realized by test systems simulating the protocol with test scripts executed against the implementation under test
Interoperability testing: process for testing that devices can inter-operate, which is realized by connecting devices
from different vendors and operating them, either manually or automatically, according to scenarios based on a protocol
standard
Testing framework: document providing guidance and examples necessary for the development and implementation of
a test specification
3.2 Abbreviations
For the purposes of the present document, the abbreviations given in [i.7], [i.8], [i.13], [i.22] and the following apply:
RP Reference Point
SDO Standard Developing Organisation
4 ITS foundations
4.1 Motivation for and structure of the document
In order to carry out thorough protocol conformance and interoperability testing, complex test beds would be needed. In
practice, it looks much more feasible to perform protocol conformance and interoperability tests in a simulated
environment. A protocol conformance and interoperability testing framework for ITS thus is essential for a systematic
and consistent approach towards testing of globally applicable ITS communications equipment.
The ITS testing framework presented in the present document is a set of guidelines for conformance testing and
interoperability testing. It is based on the common architecture for communications in ITS from ETSI and ISO.
Although it is referring explicitly to a consistent set of ITS base standards from ETSI and ISO, in no way it is restricted
to this set of ITS base standards. Further on, it is enabling in a sense, that a manufacturer can implement and test those
functionalities, considered to be important for market access.
The remaining part of clause 4 gives a short tutorial on communications in ITS. For more details existing base ITS
standards from ETSI and ISO are listed.
Clause 5 provides an introduction to the ITS testing framework.
Clause 6 describes the approach for conformance testing.
Clause 7 describes the approach for interoperability testing.
Clause 8 provides more detailed guidance for the development of formal ITS test specifications and test suites.
Annex A provides information on the generic approach for interoper
...