SIST EN ISO 19105:2022
(Main)Geographic information - Conformance and testing (ISO 19105:2022)
Geographic information - Conformance and testing (ISO 19105:2022)
This document specifies the framework, concepts and methodology for conformance testing and criteria
to be achieved to claim conformance to the family of applicable standardization documents regarding
geographic information and relevant application domains. This document provides a framework for
specifying abstract test suites composed of abstract test cases grouped in conformance classes and for
defining the procedures to be followed during conformance testing.
Conformance can be claimed for data or software products or services or by specifications including
any profile or functional standard. The structure of, and relationships between, conformance classes
as defined in this document underly a systematic approach to configuration management involving
managing dependencies within and between modules.
Geoinformation - Konformität und Prüfung (ISO 19105:2022)
Information géographique - Conformité et essais (ISO 19105:2022)
Le présent document spécifie le cadre, les concepts et la méthodologie applicables aux tests et critères de conformité à respecter pour revendiquer la conformité avec la famille de document de normalisation sur l'information géographique et les domaines d'application concernés. Le présent document propose un cadre pour la spécification des suites de tests abstraits composées de cas de test abstraits regroupés en classes de conformité, et pour la définition des procédures à suivre lors des tests de conformité.
Il est possible de revendiquer la conformité pour les données ou les produits et services logiciels, ou par les spécifications, y compris de n'importe quel profil ou norme opératoire. La structure des classes de conformité définies dans le présent document, et les relations entre celles-ci, sous-tendent une approche systématique de la gestion de configuration qui implique la gestion des dépendances au sein des modules et entre ceux-ci.
Geografske informacije - Ustreznost in preskušanje (ISO 19105:2022)
Ta dokument določa okvir, koncepte in metodologijo za preskušanje skladnosti ter merila, ki jih je treba doseči za trditev o skladnosti z družino veljavnih standardizacijskih dokumentov glede geografskih informacij in ustreznih domen uporabe. Ta dokument zagotavlja okvir za določanje abstraktnih preskusnih zbirk, sestavljenih iz abstraktnih preskusnih primerov, združenih v razrede skladnosti, in za definiranje postopkov, ki jih je treba upoštevati med preskušanjem skladnosti. Skladnost je mogoče zahtevati za podatke ali izdelke oziroma storitve programske opreme ali na podlagi specifikacij, vključno s profili ali funkcionalnimi standardi. Struktura in razmerja med razredi skladnosti, kot so opredeljeni v tem dokumentu, so osnova sistematičnega pristopa k upravljanju konfiguracije, ki vključuje upravljanje odvisnosti v modulih in med njimi.
General Information
Relations
Standards Content (Sample)
SLOVENSKI STANDARD
SIST EN ISO 19105:2022
01-november-2022
Nadomešča:
SIST EN ISO 19105:2005
Geografske informacije - Ustreznost in preskušanje (ISO 19105:2022)
Geographic information - Conformance and testing (ISO 19105:2022)
Geoinformation - Konformität und Prüfung (ISO 19105:2022)
Information géographique - Conformité et essais (ISO 19105:2022)
Ta slovenski standard je istoveten z: EN ISO 19105:2022
ICS:
07.040 Astronomija. Geodezija. Astronomy. Geodesy.
Geografija Geography
35.240.70 Uporabniške rešitve IT v IT applications in science
znanosti
SIST EN ISO 19105:2022 en,fr,de
2003-01.Slovenski inštitut za standardizacijo. Razmnoževanje celote ali delov tega standarda ni dovoljeno.
---------------------- Page: 1 ----------------------
SIST EN ISO 19105:2022
---------------------- Page: 2 ----------------------
SIST EN ISO 19105:2022
EN ISO 19105
EUROPEAN STANDARD
NORME EUROPÉENNE
July 2022
EUROPÄISCHE NORM
ICS 35.240.70 Supersedes EN ISO 19105:2005
English Version
Geographic information - Conformance and testing (ISO
19105:2022)
Information géographique - Conformité et essais (ISO Geoinformation - Konformität und Prüfung (ISO
19105:2022) 19105:2022)
This European Standard was approved by CEN on 18 June 2022.
CEN members are bound to comply with the CEN/CENELEC Internal Regulations which stipulate the conditions for giving this
European Standard the status of a national standard without any alteration. Up-to-date lists and bibliographical references
concerning such national standards may be obtained on application to the CEN-CENELEC Management Centre or to any CEN
member.
This European Standard exists in three official versions (English, French, German). A version in any other language made by
translation under the responsibility of a CEN member into its own language and notified to the CEN-CENELEC Management
Centre has the same status as the official versions.
CEN members are the national standards bodies of Austria, Belgium, Bulgaria, Croatia, Cyprus, Czech Republic, Denmark, Estonia,
Finland, France, Germany, Greece, Hungary, Iceland, Ireland, Italy, Latvia, Lithuania, Luxembourg, Malta, Netherlands, Norway,
Poland, Portugal, Republic of North Macedonia, Romania, Serbia, Slovakia, Slovenia, Spain, Sweden, Switzerland, Türkiye and
United Kingdom.
EUROPEAN COMMITTEE FOR STANDARDIZATION
COMITÉ EUROPÉEN DE NORMALISATION
EUROPÄISCHES KOMITEE FÜR NORMUNG
CEN-CENELEC Management Centre: Rue de la Science 23, B-1040 Brussels
© 2022 CEN All rights of exploitation in any form and by any means reserved Ref. No. EN ISO 19105:2022 E
worldwide for CEN national Members.
---------------------- Page: 3 ----------------------
SIST EN ISO 19105:2022
EN ISO 19105:2022 (E)
Contents Page
European foreword . 3
2
---------------------- Page: 4 ----------------------
SIST EN ISO 19105:2022
EN ISO 19105:2022 (E)
European foreword
This document (EN ISO 19105:2022) has been prepared by Technical Committee ISO/TC 211
"Geographic information/Geomatics" in collaboration with Technical Committee CEN/TC 287
“Geographic Information” the secretariat of which is held by BSI.
This European Standard shall be given the status of a national standard, either by publication of an
identical text or by endorsement, at the latest by January 2023, and conflicting national standards shall
be withdrawn at the latest by January 2023.
Attention is drawn to the possibility that some of the elements of this document may be the subject of
patent rights. CEN shall not be held responsible for identifying any or all such patent rights.
This document supersedes EN ISO 19105:2005.
Any feedback and questions on this document should be directed to the users’ national standards
body/national committee. A complete listing of these bodies can be found on the CEN website.
According to the CEN-CENELEC Internal Regulations, the national standards organizations of the
following countries are bound to implement this European Standard: Austria, Belgium, Bulgaria,
Croatia, Cyprus, Czech Republic, Denmark, Estonia, Finland, France, Germany, Greece, Hungary, Iceland,
Ireland, Italy, Latvia, Lithuania, Luxembourg, Malta, Netherlands, Norway, Poland, Portugal, Republic of
North Macedonia, Romania, Serbia, Slovakia, Slovenia, Spain, Sweden, Switzerland, Türkiye and the
United Kingdom.
Endorsement notice
The text of ISO 19105:2022 has been approved by CEN as EN ISO 19105:2022 without any modification.
3
---------------------- Page: 5 ----------------------
SIST EN ISO 19105:2022
---------------------- Page: 6 ----------------------
SIST EN ISO 19105:2022
INTERNATIONAL ISO
STANDARD 19105
Second edition
2022-07
Geographic information —
Conformance and testing
Information géographique — Conformité et essais
Reference number
ISO 19105:2022(E)
© ISO 2022
---------------------- Page: 7 ----------------------
SIST EN ISO 19105:2022
ISO 19105:2022(E)
COPYRIGHT PROTECTED DOCUMENT
© ISO 2022
All rights reserved. Unless otherwise specified, or required in the context of its implementation, no part of this publication may
be reproduced or utilized otherwise in any form or by any means, electronic or mechanical, including photocopying, or posting on
the internet or an intranet, without prior written permission. Permission can be requested from either ISO at the address below
or ISO’s member body in the country of the requester.
ISO copyright office
CP 401 • Ch. de Blandonnet 8
CH-1214 Vernier, Geneva
Phone: +41 22 749 01 11
Email: copyright@iso.org
Website: www.iso.org
Published in Switzerland
ii
© ISO 2022 – All rights reserved
---------------------- Page: 8 ----------------------
SIST EN ISO 19105:2022
ISO 19105:2022(E)
Contents Page
Foreword .iv
Introduction .v
1 Scope . 1
2 Normative references . 1
3 Terms and definitions . 1
4 Symbols and abbreviated terms.4
5 Conformance . 4
6 Notation . 5
6.1 UML notation . 5
6.2 Identifiers . 5
7 Framework . 5
8 Modular specification .5
8.1 General . 5
8.2 Conformance clause . 5
8.3 Conformance classes . 6
8.4 Abstract test suite . 6
9 Modular standard .7
10 Executable test suite . 8
11 Conformance test report . 9
Annex A (informative) Abstract test suite .11
Annex B (informative) Sample template of styling constructs .18
Annex C (informative) UML model .20
Annex D (informative) URI structure .21
Annex E (informative) Conformance test report examples.23
Annex F (informative) Overall result synthesis .27
Bibliography .29
iii
© ISO 2022 – All rights reserved
---------------------- Page: 9 ----------------------
SIST EN ISO 19105:2022
ISO 19105:2022(E)
Foreword
ISO (the International Organization for Standardization) is a worldwide federation of national standards
bodies (ISO member bodies). The work of preparing International Standards is normally carried out
through ISO technical committees. Each member body interested in a subject for which a technical
committee has been established has the right to be represented on that committee. International
organizations, governmental and non-governmental, in liaison with ISO, also take part in the work.
ISO collaborates closely with the International Electrotechnical Commission (IEC) on all matters of
electrotechnical standardization.
The procedures used to develop this document and those intended for its further maintenance are
described in the ISO/IEC Directives, Part 1. In particular, the different approval criteria needed for the
different types of ISO documents should be noted. This document was drafted in accordance with the
editorial rules of the ISO/IEC Directives, Part 2 (see www.iso.org/directives).
Attention is drawn to the possibility that some of the elements of this document may be the subject of
patent rights. ISO shall not be held responsible for identifying any or all such patent rights. Details of
any patent rights identified during the development of the document will be in the Introduction and/or
on the ISO list of patent declarations received (see www.iso.org/patents).
Any trade name used in this document is information given for the convenience of users and does not
constitute an endorsement.
For an explanation of the voluntary nature of standards, the meaning of ISO specific terms and
expressions related to conformity assessment, as well as information about ISO's adherence to
the World Trade Organization (WTO) principles in the Technical Barriers to Trade (TBT), see
www.iso.org/iso/foreword.html.
This document was prepared by Technical Committee ISO/TC 211, Geographic information/Geomatics,
in collaboration with the European Committee for Standardization (CEN) Technical Committee CEN/TC
287, Geographic Information, in accordance with the Agreement on technical cooperation between ISO
and CEN (Vienna Agreement).
This second edition cancels and replaces the first edition (ISO 19105:2000), which has been technically
revised.
The main changes are as follows:
— the document has been reformatted to have a modular structure;
— conformance testing requirements have been added for modular specification;
— dependency relationships have been introduced among conformance classes;
— three-valued logic is supported on the overall result evaluation;
— the statements on process are omitted, leaving freedom for implementers.
Any feedback or questions on this document should be directed to the user’s national standards body. A
complete listing of these bodies can be found at www.iso.org/members.html.
iv
© ISO 2022 – All rights reserved
---------------------- Page: 10 ----------------------
SIST EN ISO 19105:2022
ISO 19105:2022(E)
Introduction
The scope of ISO/TC 211 is standardization in the field of digital geographic information. This work
aims at establishing a structured set of International Standards for information concerning objects
or phenomena that are directly or indirectly associated with a location relative to the Earth. These
International Standards can specify, for geographic information, methods, tools and services for data
management (including definition and description). They can also specify the acquisition, processing,
analysing, accessing, presentation and transferring of such data in digital/electronic form between
different users, systems and locations. The work will be linked to appropriate International Standards
for information technology and data, where possible, and provide a framework for the development of
sector-specific applications using geographic data.
This document is based on concepts defined in ISO International Standards which describe conformance
[2]
and testing. Certain components of the Open Geospatial Consortium (OGC) modular specification,
including requirements, requirements classes, abstract test cases and conformance classes, are also
used in this document. While the framework of conformance testing described in these documents is
also used in this document, some concepts have been modified for use in this particular domain.
Conformance testing does not include robustness testing, acceptance testing and performance testing,
because the family of documents on geographic information does not establish requirements for these
areas.
Conformance testing tests a candidate product according to normative requirements which are
required to be satisfied by passing the tests of the abstract test suite. These abstract test cases are
organized into conformance classes in a modular structure, each of which represents a mechanism for
partial satisfaction of the International Standard in terms of the corresponding requirements class.
In the practical sense, it is very important to be able to ensure good quality in testing and conformance
with the relevant requirement(s). This can be achieved via traceability and perhaps even with a
traceability matrix where the requirement and the test result are correlated.
It is recommended that all applicable International Standards regarding geographic information and
the relevant application domains follow the formatting for requirements used in this document.
The name and contact information of the Maintenance Agency for this document can be found at
www.iso.org/maintenance_agencies.
v
© ISO 2022 – All rights reserved
---------------------- Page: 11 ----------------------
SIST EN ISO 19105:2022
---------------------- Page: 12 ----------------------
SIST EN ISO 19105:2022
INTERNATIONAL STANDARD ISO 19105:2022(E)
Geographic information — Conformance and testing
1 Scope
This document specifies the framework, concepts and methodology for conformance testing and criteria
to be achieved to claim conformance to the family of applicable standardization documents regarding
geographic information and relevant application domains. This document provides a framework for
specifying abstract test suites composed of abstract test cases grouped in conformance classes and for
defining the procedures to be followed during conformance testing.
Conformance can be claimed for data or software products or services or by specifications including
any profile or functional standard. The structure of, and relationships between, conformance classes
as defined in this document underly a systematic approach to configuration management involving
managing dependencies within and between modules.
2 Normative references
There are no normative references in this document.
3 Terms and definitions
For the purposes of this document, the following terms and definitions apply.
ISO and IEC maintain terminology databases for use in standardization at the following addresses:
— ISO Online browsing platform: available at https:// www .iso .org/ obp
— IEC Electropedia: available at https:// www .electropedia .org/
3.1
abstract
implementation-independent
3.2
abstract test case
conformance test case
test for a particular requirement or a set of related requirements
Note 1 to entry: An abstract or conformance test case is a formal basis for deriving executable test cases. It
should be complete in the sense that it is sufficient to enable a test verdict to be assigned unambiguously to each
potentially observable test outcome.
Note 2 to entry: The definition for "test case" can be found in ISO/IEC/IEEE 24765:2017, 3.4210.
3.3
abstract test suite
ATS
set of conformance classes that define tests for all requirements of a specification
Note 1 to entry: Evidence of conformance to all or part of a standard, awarded for passing one or more of the
conformance test classes specified in that standard
[2]
[SOURCE: OGC 08-131r3, 4.2]
1
© ISO 2022 – All rights reserved
---------------------- Page: 13 ----------------------
SIST EN ISO 19105:2022
ISO 19105:2022(E)
3.4
conformance
conformity
fulfilment of a requirement
Note 1 to entry: When there is no ambiguity, the modifier “conformance” may be omitted. For example, "test
report" is the same as "conformance test report".
3.5
conformance clause
conformity clause
clause containing all the requirements that need to be fulfilled for an International Standard or
specification
Note 1 to entry: In this document, specification represents technical specification.
3.6
conformance class
conformance test class
set of abstract test cases that when applied receive a single certificate of conformance
Note 1 to entry: OGC 08-131r3 defines certificate of conformance as “evidence of conformance to all or part of a
standard, awarded for passing one or more of the conformance test classes specified in that standard”.
3.7
conformance testing
testing of a product to determine the extent to which the product is a conforming implementation
3.8
conformance test report
test report
document that presents verdicts of each conformance class and abstract test case in an organized
format
3.9
conformance test result
test result
all information recorded during the execution of an executable test case against an implementation
under test
3.10
executable test case
specific test of an implementation to meet the specific requirements as stated in the specification
containing the requirements
Note 1 to entry: Instantiation of an abstract test case with executable expressions.
3.11
executable test module
set of related executable test cases to test a single certificate of conformance
3.12
executable test suite
set of executable test modules
3.13
identifier
linguistically independent sequence of characters capable of uniquely and permanently identifying that
with which it is associated
[SOURCE: ISO 19135-1:2015, 4.1.5]
2
© ISO 2022 – All rights reserved
---------------------- Page: 14 ----------------------
SIST EN ISO 19105:2022
ISO 19105:2022(E)
3.14
implementation
realization of a specification
Note 1 to entry: In the context of the applicable geographic information standards documents, this includes
relevant specifications of geographic information services and datasets.
3.15
implementation conformance statement
statement of conformance classes that have been implemented
3.16
implementation under test
implementation that is being evaluated for conformance
[SOURCE: ISO/IEC 18477-4:2017, 3.1.40]
3.17
inconclusive verdict
test verdict when neither a pass verdict nor a fail verdict applies
3.18
modular
consisting of separate parts that, when combined, form a complete whole
3.19
modular specification
specification which organizes its requirements and conformance classes in a modular structure
3.20
modular standard
standard which organizes its requirements and conformance classes in a modular structure
3.21
requirements class
aggregate of all requirements that have the same specification target to satisfy a conformance test class
Note 1 to entry: OGC 08-131r3 defines a similar concept under the name "requirement class" as follows:
"aggregate of all requirement modules that must all be satisfied to satisfy a conformance test class."
3.22
specification
document containing requirements and abstract test cases for those requirements
3.23
specification target
entity to which some requirements of a specification apply
Note 1 to entry: OGC 08-131r3 defines a similar concept under the name "standardization target" as follows: "an
entity that may receive a proof of conformance for a requirements class."
3.24
standard
document, established by consensus and approved by a recognized body, that provides, for common and
repeated use, rules, guidelines or characteristics for activities or their results, aimed at the achievement
of the optimum degree of order in a given context
Note 1 to entry: Standards should be based on the consolidated results of science, technology and experience,
and aimed at the promotion of optimum community benefits.
[SOURCE: ISO/IEC Guide 2:2004, 3.2]
3
© ISO 2022 – All rights reserved
---------------------- Page: 15 ----------------------
SIST EN ISO 19105:2022
ISO 19105:2022(E)
3.25
test tool
application that executes an executable test suite
4 Symbols and abbreviated terms
ATC abstract test case
ATS abstract test suite
CWA closed world assumption
ETC executable test case
ETM executable test module
ETS executable test suite
ICS implementation conformance statement
IUT implementation under test
OWA open world assumption
SA stub assumption
TEAM test, evaluation, and measurement
UML unified modeling language
URI uniform resource identifier
5 Conformance
This document defines four conformance classes:
— “Modular specification” (specification target: specifications);
— “Modular standard” (specification target: standards);
— “Executable test suites” (specification target: executable test suites);
— “Conformance test report” (specification target: test tools).
A specification, standard, test suite or test tool claiming conformance to this document shall implement
the conformance class relevant to that specification target.
Conformance with this standard shall be assessed using all the relevant conformance test cases
specified in Annex A of this standard. Table 1 provides the uniform resource identifiers (URIs) of
conformance classes.
Table 1 — Conformance class URIs
Conformance class URI
Modular specification https://standards.isotc211.org/19105/-/2/conf/ModularSpecification
Modular standard https://standards.isotc211.org/19105/-/2/conf/ModularStandard
Executable test suites https://standards.isotc211.org/iso19105/-/2/conf/TestSuite
Conformance test report https://standards.isotc211.org/iso19105/-/2/conf/report
4
© ISO 2022 – All rights reserved
---------------------- Page: 16 ----------------------
SIST EN ISO 19105:2022
ISO 19105:2022(E)
6 Notation
6.1 UML notation
In this document, conceptual schemas are presented in the Unified Modeling Language (UML).
ISO 19103 presents the specific profile of UML used in this document.
6.2 Identifiers
The normative provisions in this document are identified by the URI
https:// standards .isotc211 .org/ iso19105/ -/ 2
All requirements and abstract test cases that appear in this document are denoted by partial URIs
which are relative to this base.
7 Framework
In an applicable conformance testing framework, a specification contains requirements classes which
are used to derive an abstract test suite (ATS). An implementation under test (IUT) is developed
according to the specification and an executable test suite (ETS) is implemented according to the ATS.
The ETS tests the IUT to determine if it meets the well-defined set of requirements classes as stated in
the normative clauses of the specification. See Figure 1.
Figure 1 — General approach of the conformance testing
8 Modular specification
8.1 General
In summary, the structure of the requirements and requirements classes of the model should be
reflected in the organization of the conformance tests and classes and also in the structure of the
normative clauses in the specification document.
NOTE This makes it more difficult to write a specification, but is expected to make the specification easier to
read and understand. This trade-off is usually worthwhile, since the readers of a specification are always orders
of magnitude more numerous than its contributing authors. Facilitating the implementation of a specification is
an important goal of this document.
8.2 Conformance clause
For a specification to be effective and useful, it is essential to be able to determine conformance to the
specification clearly. For this reason, all applicable documents regarding geographic information and
relevant application domains provide a conformance clause.
Requirement 1 /req/specification/ConformanceClause
5
© ISO 2022 – All rights reserved
---------------------- Page: 17 ----------------------
SIST EN ISO 19105:2022
ISO 19105:2022(E)
A specification shall contain a conformance clause.
A conformance clause is an entry point for testing conformance. To check if an implementation conforms
to a specification, the conformance clause is first examined to determine what has to be checked. Thus,
conformance clauses shall clearly state which requirements shall be fulfilled to claim conformance to a
specification.
Requirement 2 /req/specification/ConformanceClauseStatement
A conformance clause shall start with the statement of conformance classes to be satisfied in order for
an implementation to claim conformance to that specification.
Requirement 3 /req/specification/ConformanceTarget
The conformance clause shall specify the specification target of each conformance class in the
specification.
Conformance classes modularize abstract test cases (see Annex A). A sample conformance clause
template is provided in Clause B.1.
Requirement 4 /req/specification/ConformanceClauseReference
The conformance clause shall reference the ATS in an annex.
8.3 Conformance classes
Requirement 5 /req/specification/CorrespondenceRequirementsClasses
The requirements classes shall segment the requirements in the specification in a manner consistent
with the conformance classes.
Each requirements class will be in a 1 to 1 correspondence to a similarly named conformance class that
tests all of the requirements class’ requirements.
A sample requirement is provided in Clause B.2
Requirement 6 /req/specification/SpecificationTarget
All requirements in a requirements class shall have the same specification target.
Requirement 7 /req/specification/ConformanceTest
A requirement shall be tested in at least one abstract test case.
Requirement 8 /req/specification/ConformanceClassIdentification
A conformance class shall be identified by a URI.
Requirement 9 /req/specification/ConformanceClassDependency
A conformance class shall specify any other conformance class upon which it is dependent. That other
conformance class shall also be used to test the conformance.
8.4 Abstract test suite
Without considering dependency relationships among conformance classes, the ATS has a hierarchical
structure. Conformance classes may be used to aid planning, development or understanding of the ATS.
[9]
A conformance class is composed of one or many abstract test cases (see Annex C).
An abstract test case is used as the basis for generating an executable test case and
...
SLOVENSKI STANDARD
oSIST prEN ISO 19105:2020
01-september-2020
Geografske informacije - Ustreznost in preskušanje (ISO/DIS 19105:2020)
Geographic information - Conformance and testing (ISO/DIS 19105:2020)
Geoinformation - Konformität und Prüfung (ISO/DIS 19105:2020)
Information géographique - Conformité et essais (ISO/DIS 19105:2020)
Ta slovenski standard je istoveten z: prEN ISO 19105
ICS:
07.040 Astronomija. Geodezija. Astronomy. Geodesy.
Geografija Geography
35.240.70 Uporabniške rešitve IT v IT applications in science
znanosti
oSIST prEN ISO 19105:2020 en,fr,de
2003-01.Slovenski inštitut za standardizacijo. Razmnoževanje celote ali delov tega standarda ni dovoljeno.
---------------------- Page: 1 ----------------------
oSIST prEN ISO 19105:2020
---------------------- Page: 2 ----------------------
oSIST prEN ISO 19105:2020
DRAFT INTERNATIONAL STANDARD
ISO/DIS 19105
ISO/TC 211 Secretariat: SIS
Voting begins on: Voting terminates on:
2020-07-15 2020-10-07
Geographic information — Conformance and testing
Information géographique — Conformité et essais
ICS: 35.240.70
THIS DOCUMENT IS A DRAFT CIRCULATED
This document is circulated as received from the committee secretariat.
FOR COMMENT AND APPROVAL. IT IS
THEREFORE SUBJECT TO CHANGE AND MAY
NOT BE REFERRED TO AS AN INTERNATIONAL
STANDARD UNTIL PUBLISHED AS SUCH.
IN ADDITION TO THEIR EVALUATION AS
ISO/CEN PARALLEL PROCESSING
BEING ACCEPTABLE FOR INDUSTRIAL,
TECHNOLOGICAL, COMMERCIAL AND
USER PURPOSES, DRAFT INTERNATIONAL
STANDARDS MAY ON OCCASION HAVE TO
BE CONSIDERED IN THE LIGHT OF THEIR
POTENTIAL TO BECOME STANDARDS TO
WHICH REFERENCE MAY BE MADE IN
Reference number
NATIONAL REGULATIONS.
ISO/DIS 19105:2020(E)
RECIPIENTS OF THIS DRAFT ARE INVITED
TO SUBMIT, WITH THEIR COMMENTS,
NOTIFICATION OF ANY RELEVANT PATENT
RIGHTS OF WHICH THEY ARE AWARE AND TO
©
PROVIDE SUPPORTING DOCUMENTATION. ISO 2020
---------------------- Page: 3 ----------------------
oSIST prEN ISO 19105:2020
ISO/DIS 19105:2020(E)
COPYRIGHT PROTECTED DOCUMENT
© ISO 2020
All rights reserved. Unless otherwise specified, or required in the context of its implementation, no part of this publication may
be reproduced or utilized otherwise in any form or by any means, electronic or mechanical, including photocopying, or posting
on the internet or an intranet, without prior written permission. Permission can be requested from either ISO at the address
below or ISO’s member body in the country of the requester.
ISO copyright office
CP 401 • Ch. de Blandonnet 8
CH-1214 Vernier, Geneva
Phone: +41 22 749 01 11
Fax: +41 22 749 09 47
Email: copyright@iso.org
Website: www.iso.org
Published in Switzerland
ii © ISO 2020 – All rights reserved
---------------------- Page: 4 ----------------------
oSIST prEN ISO 19105:2020
ISO/DIS 19105:2020(E)
Contents Page
Foreword .v
Introduction .vi
1 Scope . 1
2 Normative references . 1
3 Terms and definitions . 1
4 Symbols and Abbreviations . 5
5 Conformance . 5
6 Notation . 5
6.1 UML notation . 5
6.2 Identifiers . 5
7 Framework . 6
8 Modular Specification . 6
8.1 General . 6
8.2 Conformance clause. 6
8.3 Requirement 1 /req/specification/ConformanceClause . 6
8.4 Requirement 2 /req/specification/ConformanceClauseStatement . 6
8.5 Requirement 3 /req/specification/ConformanceTarget . 7
8.6 Requirement 4 /req/specification/ConformanceClauseReference . 7
8.7 Conformance classes . 7
8.7.1 Requirement 5 /req/specification/CorrespondenceRequirementsClasses . 7
8.7.2 Requirement 6 /req/specification/SpecificationTarget . 7
8.7.3 Requirement 7 /req/specification/ConformanceTest . 7
8.7.4 Requirement 8 /req/specification/ConformanceClassIdentification . 7
8.7.5 Requirement 9 /req/specification/ConformanceClassDependency . 7
8.8 Abstract test suite . 7
8.8.1 General. 7
8.8.2 Requirement 10 /req/specification/ATSStructure . 8
8.8.3 Requirement 11 /req/specification/ATCTemplate . 8
8.8.4 Requirement 12 /req/specification/ATCIdentifier . 8
8.8.5 Requirement 13 /req/specification/ATCTestMethod . 8
8.8.6 Requirement 14 /req/specification/ATCTestReference . 8
8.8.7 Permission 1 /per/specification/ATSElements . 8
9 Modular Standard . 8
9.1 General . 8
9.2 Requirement 15 /req/standard/Dependency . 9
9.3 Requirement 16 /req/standard/Identification . 9
10 Executable test suite . 9
10.1 General . 9
10.2 Requirement 17 /req/test-suites/ExecutableTestSuite . 9
10.3 Requirement 18 /req/test-suites/ExecutableTestModule . 9
10.4 Requirement 19 /req/test-suites/ETC . 9
10.5 Requirement 20 /req/test-suites/ETCTemplate . 9
10.6 Requirement 21 /req/test-suites/ETCTestIdentifier . 9
10.7 Requirement 22 /req/test-suites/ETCTestDescription .10
10.8 Requirement 23 /req/test-suites/ETCTestExpression .10
10.9 Requirement 24 /req/test-suites/ETCTestReference.10
11 Conformance Test Report .10
11.1 General .10
11.2 Requirement 25 /req/report/TestReport .10
11.3 Requirement 26 /req/report/TestVerdict .10
© ISO 2020 – All rights reserved iii
---------------------- Page: 5 ----------------------
oSIST prEN ISO 19105:2020
ISO/DIS 19105:2020(E)
11.4 Requirement 27 /req/report/OverallResult.10
11.5 Requirement 28 /req/report/RecordAuditability .11
11.6 Requirement 29 /req/report/ResultRepeatability .11
11.7 Requirement 30 /req/report/ResultComparability.11
Annex A (informative) Abstract Test Suite.12
Annex B (informative) UML model .19
Annex C (informative) URI structure .20
Annex D (informative) Conformance test report examples .22
Annex E (informative) Overall result synthesis.24
Bibliography .26
iv © ISO 2020 – All rights reserved
---------------------- Page: 6 ----------------------
oSIST prEN ISO 19105:2020
ISO/DIS 19105:2020(E)
Foreword
ISO (the International Organization for Standardization) is a worldwide federation of national standards
bodies (ISO member bodies). The work of preparing International Standards is normally carried
out through ISO technical committees. A member body interested in a subject for which a technical
committee has been established has the right to be represented on that committee. International
organizations, governmental and non-governmental, in liaison with ISO, also take part in the work.
ISO collaborates closely with the International Electrotechnical Commission (IEC) on all matters of
electrotechnical standardization.
The procedures used to develop this document and those intended for its further maintenance are
described in the ISO/IEC Directives, Part 1. In particular, the different approval criteria needed for the
different types of ISO documents should be noted. This document was drafted in accordance with the
editorial rules of the ISO/IEC Directives, Part 2 (see www .iso .org/ directives).
Attention is drawn to the possibility that some of the elements of this document may be the subject of
patent rights. ISO shall not be held responsible for identifying any or all such patent rights. Details of
any patent rights identified during the development of the document will be in the Introduction and/or
on the ISO list of patent declarations received (see www .iso .org/ patents).
Any trade name used in this document is information given for the convenience of users and does not
constitute an endorsement.
For an explanation of the voluntary nature of standards, the meaning of ISO specific terms and
expressions related to conformity assessment, as well as information about ISO's adherence to the
World Trade Organization (WTO) principles in the Technical Barriers to Trade (TBT), see www .iso .org/
iso/ foreword .html.
This document was prepared by Technical Committee ISO/TC 211, Geographic information/Geomatics.
This second edition cancels and replaces the first edition (ISO 19105:2000), which has been technically
revised.
The main changes compared to the previous edition are as follows:
— reformat the document in a modular structure;
— add conformance testing requirements for modular specification;
— introduce dependency relationships among conformance classes;
— support three-valued logic on the overall result evaluation;
— omit the statements on process, leave the freedom to implementers.
A list of all parts in the ISO 19105 series can be found on the ISO website.
Any feedback or questions on this document should be directed to the user’s national standards body. A
complete listing of these bodies can be found at www .iso .org/ members .html.
© ISO 2020 – All rights reserved v
---------------------- Page: 7 ----------------------
oSIST prEN ISO 19105:2020
ISO/DIS 19105:2020(E)
Introduction
The scope of ISO/TC 211 is standardization in the field of digital geographic information. This work
aims at establishing a structured set of International Standards for information concerning objects
or phenomena that are directly or indirectly associated with a location relative to the Earth. These
International Standards may specify, for geographic information, methods, tools and services for
data management (including definition and description), acquiring, processing, analysing, accessing,
presenting and transferring such data in digital/electronic form between different users, systems and
locations. The work will be linked to appropriate International Standards for information technology
and data, where possible, and provide a framework for the development of sector-specific applications
using geographic data.
This International Standard is based on concepts defined in ISO standards which describe conformance
and testing. Furthermore, some components of the OGC modular specification[1], including
requirements, requirements classes, abstract test cases, and conformance classes are used in this
International Standard. While the framework of conformance testing described in these International
Standards is used in this International Standard, some concepts have been modified for use in this
particular domain.
Conformance testing does not include robustness testing, acceptance testing and performance testing,
because the geographic information family of standards does not establish requirements for these areas.
Conformance testing tests a candidate product according to normative requirements which must
be satisfied by passing the tests of the abstract test suite. These abstract test cases are organized
into conformance classes in a modular structure, each of which represents a mechanism for partial
satisfaction of the standard by regarding to the corresponding requirements class.
In the practical sense it is very important to be able to ensure a good quality of the test and compliance
with the requirement, this can achieved via traceability and perhaps even an traceability matrix where
the requirement and the test result are correlated.
All applicable standards documents regarding geographic information and relevant application domains
are recommended to follow the formatting for requirements used in this International Standard.
vi © ISO 2020 – All rights reserved
---------------------- Page: 8 ----------------------
oSIST prEN ISO 19105:2020
DRAFT INTERNATIONAL STANDARD ISO/DIS 19105:2020(E)
Geographic information — Conformance and testing
1 Scope
This document specifies the framework, concepts and methodology for conformance testing and
criteria to be achieved to claim conformance to the family of applicable standards documents regarding
geographic information and relevant application domains. This document provides a framework for
specifying abstract test suites (ATS) composed of abstract test cases grouped in conformance classes
and for defining the procedures to be followed during conformance testing.
Conformance may be claimed for data or software products or services or by specifications including
any profile or functional standard. The structure of, and relationships between, conformance classes
as defined in this document underlies a systematic approach to configuration management involving
managing dependencies within and between modules.
2 Normative references
There are no normative references in this document.
3 Terms and definitions
For the purposes of this document, the following terms and definitions apply.
ISO and IEC maintain terminological databases for use in standardization at the following addresses:
— ISO Online browsing platform: available at https:// www .iso .org/ obp
— IEC Electropedia: available at http:// www .electropedia .org/
3.1
abstract
implementation-independent
3.2
abstract test case
conformance test case
ATC
test for a particular requirement or a set of related requirements
Note 1 to entry: An abstract or conformance test case is a formal basis for deriving executable test cases. It
should be complete in the sense that it is sufficient to enable a test verdict to be assigned unambiguously to each
potentially observable test outcome.
Note 2 to entry: ISO Directives Part 2, 3.3.3 defines requirement as an expression, in the content of a document,
that conveys objectively verifiable criteria to be fulfilled and from which no deviation is permitted if conformance
with the document is to be claimed.
Note 3 to entry: ISO/IEC/IEEE 24765:2017, 3.4210 concludes the definitions for test case or test.
3.3
abstract test suite
ATS
set of conformance classes that define tests for all requirements of a specification
© ISO 2020 – All rights reserved 1
---------------------- Page: 9 ----------------------
oSIST prEN ISO 19105:2020
ISO/DIS 19105:2020(E)
3.4
conformance
conformity
fulfilment of a requirement
Note 1 to entry: When no ambiguity, the modifier “conformance” may be omitted. i.e. test report is the same as
conformance test report.
[SOURCE: ISO/IEC Directives, Part 1, Consolidated ISO Supplement, modified — conformance is the
preferred term and conformity the admitted term]
3.5
conformance assessment
assessment of the conformance of an implementation to a specification
3.6
conformance clause
conformity clause
clause containing all the requirements that must be fulfilled
3.7
conformance class
conformance test class
set of abstract test cases that when applied receive a single certificate of conformance
3.8
conformance testing
testing of a product to determine the extent to which the product is a conforming implementation
3.9
conformance test report
test report
document that presents verdicts of each conformance class and abstract test case in an organized format
3.10
conformance test result
test result
all information recorded during executing an executable test case (ETS) against an implementation
under test (IUT)
3.11
conformance test verdict
result of an executable test case execution
Note 1 to entry: ISO/IEC 9646-1:1993, 3.3.124 defines a similar concept under the name (test) verdict which is a
statement of “pass,” “fail,” or “inconclusive”, as specified in an abstract test case, concerning conformance of an
IUT with respect to that test case when it is executed.
3.12
conforming implementation
implementation which satisfies the requirements
3.13
executable test case
ETC
specific test of an implementation to meet the specific requirements as stated in the specification
containing the requirements
Note 1 to entry: Instantiation of an abstract test case with executable expressions.
2 © ISO 2020 – All rights reserved
---------------------- Page: 10 ----------------------
oSIST prEN ISO 19105:2020
ISO/DIS 19105:2020(E)
3.14
executable test module
set of related executable test cases to test a single certificate of conformance.
3.15
executable test suite
ETS
set of executable test modules
3.16
fail verdict
test verdict of non-conformance
Note 1 to entry: Non-conformance may be with respect to either the test purpose or at least one of the
conformance requirements of the relevant specification(s).
3.17
identifier
linguistically independent sequence of characters capable of uniquely and permanently identifying that
with which it is associated
[SOURCE: ISO 19135-1:2015, 4.1.5]
3.18
implementation
realization of a specification
Note 1 to entry: In the context of the applicable standards documents, this includes relevant specifications of
geographic information services and datasets.
3.19
implementation conformance statement
ICS
statement of conformance classes that have been implemented
3.20
implementation under test
IUT
implementation that is being evaluated for conformance
[SOURCE: ISO/IEC 18477-4:2017, 3.1.40]
3.21
inconclusive verdict
test verdict when neither a pass verdict nor a fail verdict apply
3.22
modular
consisting of separate parts that, when combined, form a complete whole
[SOURCE: Cambridge Dictionary]
3.23
modular specification
specification which organizes its requirements and conformance classes in a modular structure
3.24
modular standard
standard which organizes its requirements and conformance classes in a modular structure
© ISO 2020 – All rights reserved 3
---------------------- Page: 11 ----------------------
oSIST prEN ISO 19105:2020
ISO/DIS 19105:2020(E)
3.25
non-conformance
failure to fulfil one or more specified requirements
3.26
pass verdict
test verdict of conformance
3.27
performance testing
measurement of the performance characteristics of an implementation under test (IUT)
EXAMPLE throughput and responsiveness are examples of performance characteristic measurements.
Note 1 to entry: This is not a part of conformance testing.
3.28
requirements class
aggregate of all requirements that have the same specification target to satisfy a conformance test class
Note 1 to entry: OGC 08-131r3 defines a similar concept under the name requirement class which is aggregate of
all requirement modules that must all be satisfied to satisfy a conformance test class.
3.29
requirements suite
set of requirements classes of a specification
3.30
specification
document containing requirements and abstract test cases for those requirements
Note 1 to entry: A specification may also contain recommendations and permissions.
Note 2 to entry: ISO Directives Part 2, 3.3 provides definitions of recommendation and permission.
3.31
specification target
entity to which some requirements of a specification apply
Note 1 to entry: OGC 08-131r3 defines a similar concept under the name standardization target which is an entity
that may receive a proof of conformance for a requirements class.
3.32
specification target type
type of entity or set of entities to which the requirements of a specification apply
Note 1 to entry: OGC 08-131r3 defines a similar concept under the name standardization target type.
3.33
standard
document, established by consensus and approved by a recognized body, that provides, for common and
repeated use, rules, guidelines or characteristics for activities or their results, aimed at the achievement
of the optimum degree of order in a given context
Note 1 to entry: Standards should be based on the consolidated results of science, technology and experience,
and aimed at the promotion of optimum community benefits.
[SOURCE: ISO/IEC Guide 2:2004, 3.2]
3.34
test tool
application that executes an Executable Test Suite
4 © ISO 2020 – All rights reserved
---------------------- Page: 12 ----------------------
oSIST prEN ISO 19105:2020
ISO/DIS 19105:2020(E)
4 Symbols and Abbreviations
For the purposes of this International Standard, the following abbreviations apply.
ATC Abstract Test Case
ATS Abstract Test Suite
ETM Executable Test Module
ETS Executable Test Suite
ICS Implementation Conformance Statement
IUT Implementation Under Test
OSI Open Systems Interconnection
URI Uniform Resource Identifier
5 Conformance
This document defines four conformance classes:
— “Modular specification” (specification target: specifications);
— “Modular standard” (specification target: standards);
— “Executable test suites” (specification target: executable test suites);
— “Conformance test report” (specification target: test tools).
A specification, standard, test suite, or test tool claiming conformance to this document shall implement
the conformance class relevant to that specification target.
Conformance with this standard shall be assessed using all the relevant conformance test cases
specified in Annex A (normative) of this standard.
6 Notation
6.1 UML notation
In this document, conceptual schemas are presented in the Unified Modeling Language (UML). ISO 19103
Conceptual schema language presents the specific profile of UML used in this document.
6.2 Identifiers
The complete standard is identified by ISO TC 211 URI
https:// standards .isotc211 .org/ iso19105/ -1/ 2
The normative provisions in this standard are denoted by the URI
https:// standards .isotc211 .org/ iso19105/ -1/ 2
All requirements and abstract test cases that appear in this document are denoted by partial URIs
which are relative to this base.
© ISO 2020 – All rights reserved 5
---------------------- Page: 13 ----------------------
oSIST prEN ISO 19105:2020
ISO/DIS 19105:2020(E)
7 Framework
In an applicable conformance testing framework, a specification contains requirements classes
which are used to derive an ATS. An implementation under test (IUT) is developed according to the
specification and an executable test suite (ETS) is implemented according to the ATS. The ETS will test
the IUT to determine if it meets the well-defined set of requirements classes as stated in the normative
clauses of the specification, see Figure 1.
Figure 1 — General approach of the conformance testing
8 Modular Specification
8.1 General
In summary, the structure of the requirements and requirements classes of the model should be
reflected in the organization of the conformance tests and classes, and also in the structure of the
normative clauses in the specification document.
NOTE This makes it more difficult to write a specification, but is expected to make the specification easier
to read and understand. This trade-off is usually worth it, since the readers of a specification should be orders
of magnitude more numerous than its contributing authors. Making it easier to implement a specification is an
important goal of this standard.
8.2 Conformanc
...
Questions, Comments and Discussion
Ask us and Technical Secretary will try to provide an answer. You can facilitate discussion about the standard in here.