SIST EN ISO 19105:2005
(Main)Geographic information - Conformance and testing (ISO 19105:2000)
Geographic information - Conformance and testing (ISO 19105:2000)
This International Standard specifies the framework, concepts and methodology for testing and criteria to be
achieved to claim conformance to the family of ISO geographic information standards. It provides a framework for
specifying abstract test suites (ATS) and for defining the procedures to be followed during conformance testing.
Conformance may be claimed for data or software products or services or by specifications including any profile or
functional standard.
Standardization of test methods and criteria for conformance to geographic information standards will allow
verification of conformance to those standards. Verifiable conformance is important to geographic information
users, in order to achieve data transfer and sharing.
This International Standard is applicable to all the phases of conformance and testing. These phases are
characterized by the following major activities:
a) the definition of ATS for conformance to the ISO geographic information standards;
b) the definition of test methods for conformance to the ISO geographic information standards;
c) the conformance assessment process carried out by a testing laboratory for a client, culminating in the
production of a conformance test report.
This International Standard specifies the requirements for, and gives guidance on, the procedures to be followed in
conformance testing for the ISO geographic information standards. It includes only such information as is
necessary to meet the following objectives:
1) to achieve confidence in the tests as a measure of conformance;
2) to achieve comparability between the results of corresponding tests applied in different places at different
times;
3) to facilitate communication between the parties responsible for the activities described in 1) and 2).
This International Standard provides a framework for certification (an administrative procedure which may follow
conformance testing) in informative annex B.
The following topics are outside the scope of this International Standard.
a) The description of requirements for procurement and contracts.
b) Testing by means of test methods which are specific to particular applications or systems.
c) Acceptance testing, performance testing and robustness testing.
The framework established by this International Standard includes the concept of executable test suites (ETS).
These, by their very nature, cannot be standardized; consequently, standardization of ETS is outside the scope of
this International Standard.
Geoinformation - Konformität und Prüfung (ISO 19105:2000)
Information géographique - Conformité et essais (ISO 19105:2000)
Geografske informacije - Ustreznost in preskušanje (ISO 19105:2000)
General Information
Relations
Standards Content (Sample)
SLOVENSKI STANDARD
SIST EN ISO 19105:2005
01-april-2005
Geografske informacije - Ustreznost in preskušanje (ISO 19105:2000)
Geographic information - Conformance and testing (ISO 19105:2000)
Geoinformation - Konformität und Prüfung (ISO 19105:2000)
Information géographique - Conformité et essais (ISO 19105:2000)
Ta slovenski standard je istoveten z: EN ISO 19105:2005
ICS:
07.040 Astronomija. Geodezija. Astronomy. Geodesy.
Geografija Geography
35.240.70 Uporabniške rešitve IT v IT applications in science
znanosti
SIST EN ISO 19105:2005 en
2003-01.Slovenski inštitut za standardizacijo. Razmnoževanje celote ali delov tega standarda ni dovoljeno.
---------------------- Page: 1 ----------------------
SIST EN ISO 19105:2005
---------------------- Page: 2 ----------------------
SIST EN ISO 19105:2005
EUROPEAN STANDARD
EN ISO 19105
NORME EUROPÉENNE
EUROPÄISCHE NORM
January 2005
ICS 35.240.70
English version
Geographic information - Conformance and testing (ISO
19105:2000)
Information géographique - Conformité et essais (ISO Geoinformation - Konformität und Prüfung (ISO
19105:2000) 19105:2000)
This European Standard was approved by CEN on 24 December 2004.
CEN members are bound to comply with the CEN/CENELEC Internal Regulations which stipulate the conditions for giving this European
Standard the status of a national standard without any alteration. Up-to-date lists and bibliographical references concerning such national
standards may be obtained on application to the Central Secretariat or to any CEN member.
This European Standard exists in three official versions (English, French, German). A version in any other language made by translation
under the responsibility of a CEN member into its own language and notified to the Central Secretariat has the same status as the official
versions.
CEN members are the national standards bodies of Austria, Belgium, Cyprus, Czech Republic, Denmark, Estonia, Finland, France,
Germany, Greece, Hungary, Iceland, Ireland, Italy, Latvia, Lithuania, Luxembourg, Malta, Netherlands, Norway, Poland, Portugal, Slovakia,
Slovenia, Spain, Sweden, Switzerland and United Kingdom.
EUROPEAN COMMITTEE FOR STANDARDIZATION
COMITÉ EUROPÉEN DE NORMALISATION
EUROPÄISCHES KOMITEE FÜR NORMUNG
Management Centre: rue de Stassart, 36 B-1050 Brussels
© 2005 CEN All rights of exploitation in any form and by any means reserved Ref. No. EN ISO 19105:2005: E
worldwide for CEN national Members.
---------------------- Page: 3 ----------------------
SIST EN ISO 19105:2005
EN ISO 19105:2005 (E)
Foreword
The text of ISO 19105:2000 has been prepared by Technical Committee ISO/TC 211
"Geographic information/Geomatics” of the International Organization for Standardization (ISO)
and has been taken over as EN ISO 19105:2005 by Technical Committee CEN/TC 287
"Geographic Information", the secretariat of which is held by NEN.
This European Standard shall be given the status of a national standard, either by publication of
an identical text or by endorsement, at the latest by July 2005, and conflicting national standards
shall be withdrawn at the latest by July 2005.
According to the CEN/CENELEC Internal Regulations, the national standards organizations of
the following countries are bound to implement this European Standard: Austria, Belgium,
Cyprus, Czech Republic, Denmark, Estonia, Finland, France, Germany, Greece, Hungary,
Iceland, Ireland, Italy, Latvia, Lithuania, Luxembourg, Malta, Netherlands, Norway, Poland,
Portugal, Slovakia, Slovenia, Spain, Sweden, Switzerland and United Kingdom.
Endorsement notice
The text of ISO 19105:2000 has been approved by CEN as EN ISO 19105:2005 without any
modifications.
2
---------------------- Page: 4 ----------------------
SIST EN ISO 19105:2005
INTERNATIONAL ISO
STANDARD 19105
First edition
2000-12-15
Geographic information — Conformance
and testing
Information géographique — Conformité et essais
Reference number
ISO 19105:2000(E)
©
ISO 2000
---------------------- Page: 5 ----------------------
SIST EN ISO 19105:2005
ISO 19105:2000(E)
PDF disclaimer
This PDF file may contain embedded typefaces. In accordance with Adobe's licensing policy, this file may be printed or viewed but shall not
be edited unless the typefaces which are embedded are licensed to and installed on the computer performing the editing. In downloading this
file, parties accept therein the responsibility of not infringing Adobe's licensing policy. The ISO Central Secretariat accepts no liability in this
area.
Adobe is a trademark of Adobe Systems Incorporated.
Details of the software products used to create this PDF file can be found in the General Info relative to the file; the PDF-creation parameters
were optimized for printing. Every care has been taken to ensure that the file is suitable for use by ISO member bodies. In the unlikely event
that a problem relating to it is found, please inform the Central Secretariat at the address given below.
© ISO 2000
All rights reserved. Unless otherwise specified, no part of this publication may be reproduced or utilized in any form or by any means, electronic
or mechanical, including photocopying and microfilm, without permission in writing from either ISO at the address below or ISO's member body
in the country of the requester.
ISO copyright office
Case postale 56 � CH-1211 Geneva 20
Tel. + 41 22 749 01 11
Fax + 41 22 749 09 47
E-mail copyright@iso.ch
Web www.iso.ch
Printed in Switzerland
ii © ISO 2000 – All rights reserved
---------------------- Page: 6 ----------------------
SIST EN ISO 19105:2005
ISO 19105:2000(E)
Contents Page
Foreword.iv
Introduction.v
1 Scope .1
2 Conformance.2
2.1 Conformance requirements.2
2.2 Abstract test suite.2
3 Terms and definitions .2
4 Abbreviated terms .5
5 General framework of conformance .5
5.1 Introduction.5
5.2 Conformance clause .5
5.3 Conformance requirements.5
5.4 Implementation conformance statement .6
5.5 A conforming implementation.6
6 Conformance testing methodology .6
6.1 Introduction.6
6.2 Types of conformance tests.6
6.3 Implementation Extra Information for Testing.8
6.4 Conformance assessment.8
6.5 Intrinsic properties of the conformance assessment process .10
7 Test methods.11
7.1 Introduction.11
7.2 Approaches to conformance testing .11
7.3 Areas of geographic information for conformance testing.12
8 Abstract test suites and executable test suites .12
8.1 Introduction.12
8.2 Test purposes .13
8.3 Abstract test cases.13
8.4 Executable test cases .13
8.5 Relationship between abstract and executable test cases .13
Annex A (normative) Conformance clauses .14
Annex B (informative) Supporting organizations .19
Bibliography.21
© ISO 2000 – All rights reserved iii
---------------------- Page: 7 ----------------------
SIST EN ISO 19105:2005
ISO 19105:2000(E)
Foreword
ISO (the International Organization for Standardization) is a worldwide federation of national standards bodies (ISO
member bodies). The work of preparing International Standards is normally carried out through ISO technical
committees. Each member body interested in a subject for which a technical committee has been established has
the right to be represented on that committee. International organizations, governmental and non-governmental, in
liaison with ISO, also take part in the work. ISO collaborates closely with the International Electrotechnical
Commission (IEC) on all matters of electrotechnical standardization.
International Standards are drafted in accordance with the rules given in the ISO/IEC Directives, Part 3.
Draft International Standards adopted by the technical committees are circulated to the member bodies for voting.
Publication as an International Standard requires approval by at least 75 % of the member bodies casting a vote.
Attention is drawn to the possibility that some of the elements of this International Standard may be the subject of
patent rights. ISO and IEC shall not be held responsible for identifying any or all such patent rights.
International Standard ISO 19105 was prepared by Technical Committee ISO/TC 211, Geographic
information/Geomatics.
Annex A forms a normative part of this International Standard. Annex B is for information only.
iv © ISO 2000 – All rights reserved
---------------------- Page: 8 ----------------------
SIST EN ISO 19105:2005
ISO 19105:2000(E)
Introduction
The scope of ISO/TC 211 is standardization in the field of digital geographic information. This work aims at
establishing a structured set of International Standards for information concerning objects or phenomena that are
directly or indirectly associated with a location relative to the Earth. These International Standards may specify, for
geographic information, methods, tools and services for data management (including definition and description),
acquiring, processing, analysing, accessing, presenting and transferring such data in digital/electronic form
between different users, systems and locations. The work will be linked to appropriate International Standards for
information technology and data, where possible, and provide a framework for the development of sector-specific
applications using geographic data.
This International Standard provides the framework, concepts, and methodology for testing and the criteria to be
achieved to claim conformance to this family of International Standards. This International Standard is based in part
on ISO 9646-1 which describes conformance and testing in Open Systems Interconnection (OSI), ISO 10303-31
which describes conformance and testing in industrial automation systems and integration, and ISO 10641 which
describes conformance and testing for computer graphics and image processing. While the framework of
conformance testing described in these three International Standards is used in this International Standard, some
concepts have been modified for use in this particular domain.
The objective of standardization in the field of digital geographic information cannot be completely achieved unless
data and systems can be tested to determine whether they conform to the relevant geographic information
standards. Conformance testing is the testing of a candidate product for the existence of specific characteristics
required by an International Standard in order to determine the extent to which that product is a conforming
implementation. It involves testing the capabilities of an implementation against both the conformance requirements
in the relevant International Standard(s) and the statement of the implementation's capabilities.
A framework of an abstract test suite (ATS) is standardized for relevant standards in ISO/TC 211. The
standardization of ATS requires international definition and acceptance of a common test methodology, together
with appropriate test methods and procedures. The purpose of this International Standard is to define this
methodology, to provide a framework for specifying ATS, and to define the procedures to be followed during
conformance testing.
Test methods are also addressed in this International Standard; however, any organization contemplating the use
of test methods defined in this International Standard should carefully consider the constraints on their applicability.
Conformance testing does not include robustness testing, acceptance testing and performance testing, because
the geographic information family of standards does not establish requirements for these areas.
The main body of this International Standard is structured as follows. The general framework of conformance
including the definition of a conforming implementation appears in clause 5. Conformance testing methodology is
described in clause 6. The possible test methods for testing conformance to the ISO geographic information
standards are discussed in clause 7. The relationship between ATS and ETS is presented in clause 8. The
bibliography on conformance testing is given at the end. Guidelines for writing conformance clauses and
associated templates are provided in annex A.
© ISO 2000 – All rights reserved v
---------------------- Page: 9 ----------------------
SIST EN ISO 19105:2005
---------------------- Page: 10 ----------------------
SIST EN ISO 19105:2005
INTERNATIONAL STANDARD ISO 19105:2000(E)
Geographic information — Conformance and testing
1 Scope
This International Standard specifies the framework, concepts and methodology for testing and criteria to be
achieved to claim conformance to the family of ISO geographic information standards. It provides a framework for
specifying abstract test suites (ATS) and for defining the procedures to be followed during conformance testing.
Conformance may be claimed for data or software products or services or by specifications including any profile or
functional standard.
Standardization of test methods and criteria for conformance to geographic information standards will allow
verification of conformance to those standards. Verifiable conformance is important to geographic information
users, in order to achieve data transfer and sharing.
This International Standard is applicable to all the phases of conformance and testing. These phases are
characterized by the following major activities:
a) the definition of ATS for conformance to the ISO geographic information standards;
b) the definition of test methods for conformance to the ISO geographic information standards;
c) the conformance assessment process carried out by a testing laboratory for a client, culminating in the
production of a conformance test report.
This International Standard specifies the requirements for, and gives guidance on, the procedures to be followed in
conformance testing for the ISO geographic information standards. It includes only such information as is
necessary to meet the following objectives:
1) to achieve confidence in the tests as a measure of conformance;
2) to achieve comparability between the results of corresponding tests applied in different places at different
times;
3) to facilitate communication between the parties responsible for the activities described in 1) and 2).
This International Standard provides a framework for certification (an administrative procedure which may follow
conformance testing) in informative annex B.
The following topics are outside the scope of this International Standard.
a) The description of requirements for procurement and contracts.
b) Testing by means of test methods which are specific to particular applications or systems.
c) Acceptance testing, performance testing and robustness testing.
The framework established by this International Standard includes the concept of executable test suites (ETS).
These, by their very nature, cannot be standardized; consequently, standardization of ETS is outside the scope of
this International Standard.
© ISO 2000 – All rights reserved 1
---------------------- Page: 11 ----------------------
SIST EN ISO 19105:2005
ISO 19105:2000(E)
2 Conformance
2.1 Conformance requirements
This International Standard defines two classes of conformance: class A and class B. Class A concerns
conformance of specifications, including any profile or functional standard, with the series of ISO geographic
information standards as a whole. Class B concerns conformance of conformance clauses as defined by this
International Standard. Further requirements for conformance of profiles in addition to class A are given in
ISO 19106.
NOTE Conformance is defined in annex A.
2.2 Abstract test suite
2.2.1 Test case for conformance class A
a) Test purpose: verify conformance with the ISO geographic information standards.
b) Test method: manually check that all specifications, including profiles and functional standards, claiming
conformance to the ISO geographic information standards have a conformance clause. This conformance
clause shall not exclude conformance with any of the ISO geographic information standards. Conformance
testing shall be performed in accordance with clause 6. The test method used shall be in accordance with
clause 7.
c) Reference: ISO 19105
d) test type: capability test
2.2.2 Test case for conformance class B
a) Test purpose: verify that the conformance clause is written in a correct format.
b) Test method: manually check if the conformance clause is written according to normative annex A.
c) Reference: ISO 19105:2000, annex A.
d) Test type: capability test.
3 Terms and definitions
For the purposes of this International Standard, the following terms and definitions apply.
3.1
abstract test case
generalized test for a particular requirement
NOTE An abstract test case is a formal basis for deriving executable test cases. One or more test purposes are
encapsulated in the abstract test case. An abstract test case is independent of both the implementation and the values. It should
be complete in the sense that it is sufficient to enable a test verdict to be assigned unambiguously to each potentially
observable test outcome (i.e. sequence of test events).
3.2
abstract test method
method for testing implementation independent of any particular test procedure
2 © ISO 2000 – All rights reserved
---------------------- Page: 12 ----------------------
SIST EN ISO 19105:2005
ISO 19105:2000(E)
3.3
abstract test module
set of related abstract test cases
NOTE Abstract test modules may be nested in a hierarchical way.
3.4
ATS
abstract test suite
abstract test module specifying all the requirements to be satisfied for conformance
NOTE Abstract test suites are described in a conformance clause.
3.5
acceptance testing
�user� process of determining whether an implementation satisfies acceptance criteria and enables the user to
determine whether to accept the implementation
NOTE 1 This includes the planning and execution of several kinds of tests (e.g. functional, volume, performance tests) that
demonstrate that the implementation satisfies the user requirements.
NOTE 2 This is not a part of conformance testing.
3.6
basic test
initial capability test intended to identify clear cases of non-conformance
3.7
capability test
test designed to determine whether an IUT conforms to a particular characteristic of an International Standard as
described in the test purpose
3.8
conformance
fulfilment of specified requirements
3.9
conformance assessment process
process for assessing the conformance of an implementation to an International Standard
3.10
conformance clause
clause defining what is necessary in order to meet the requirements of the International Standard
3.11
conformance testing
testing of a product to determine the extent to which the product is a conforming implementation
3.12
conformance test report
summary of the conformance to the International Standard as well as all the details of the testing that supports the
given overall summary
3.13
conforming implementation
implementation which satisfies the requirements
3.14
executable test case
specific test of an implementation to meet particular requirements
NOTE Instantiation of an abstract test case with values.
© ISO 2000 – All rights reserved 3
---------------------- Page: 13 ----------------------
SIST EN ISO 19105:2005
ISO 19105:2000(E)
3.15
ETS
executable test suite
set of executable test cases
3.16
fail verdict
test verdict of non-conformance
NOTE Non-conformance may be with respect to either the test purpose or at least one of the conformance requirements of
the relevant standard(s).
3.17
falsification test
test to find errors in the implementation
NOTE If errors are found, one can correctly deduce that the implementation does not conform to the International
Standard; however, the absence of errors does not necessarily imply the converse. The falsification test can only demonstrate
non-conformance. Compare with the verification test. Due to technical and economic problems, in most cases, the falsification
test is adopted as a test method for conformance testing.
3.18
implementation
realization of a specification
NOTE In the context of the ISO geographic information standards, this includes specifications of geographic information
services and datasets.
3.19
ICS
Implementation Conformance Statement
statement of specification options that have been implemented
3.20
IXIT
Implementation eXtra Information for Testing
statement containing all of the information related to the IUT and its corresponding SUT which will enable the
testing laboratory to run an appropriate test suite against that IUT
NOTE IXIT typically provides the details on the organization and storage of concepts in the SUT as well as on the means
of access to and modification of the SUT.
3.21
inconclusive verdict
test verdict when neither a pass verdict nor a fail verdict apply
3.22
non-conformance
failure to fulfil one or more specified requirements
3.23
pass verdict
test verdict of conformance
3.24
performance testing
measurement of the performance characteristics of an Implementation Under Test (IUT), such as its throughput,
responsiveness, etc., under various conditions
NOTE This is not a part of conformance testing.
4 © ISO 2000 – All rights reserved
---------------------- Page: 14 ----------------------
SIST EN ISO 19105:2005
ISO 19105:2000(E)
3.25
robustness testing
process of determining how well an IUT processes data which contains errors
NOTE This is not a part of conformance testing.
3.26
SUT
System Under Test
computer hardware, software and communication network required to support IUT
3.27
testing laboratory
organization that carries out the conformance assessment process
3.28
verification test
test developed to prove rigorously whether an IUT is correct
4 Abbreviated terms
For the purposes of this International Standard, the following abbreviations apply.
ATS: Abstract Test Suite
ETS: Executable Test Suite
ICS: Implementation Conformance Statement
IUT: Implementation Under Test
IXIT: Implementation eXtra Information for Testing
SUT: System Under Test
5 General framework of conformance
5.1 Introduction
In the context of the ISO geographic information standards, an implementation exhibits conformance if it complies
with the conformance requirements of the applicable ISO geographic information standards. The conformance
requirements are stated in the conformance clause of each International Standard.
5.2 Conformance clause
All testable ISO geographic information standards contain a conformance clause. This clause specifies all the
requirements that shall be satisfied to claim conformance to that International Standard. The conformance clause
serves as an entry point for conformance testing.
The requirements for conformance clauses are given in annex A.
5.3 Conformance requirements
Conformance requirements may be classified as
a) mandatory requirements: these shall be observed in all cases;
© ISO 2000 – All rights reserved 5
---------------------- Page: 15 ----------------------
SIST EN ISO 19105:2005
ISO 19105:2000(E)
b) conditional requirements: these shall be observed if the conditions set out in the specification apply;
c) optional requirements: these may be selected to suit the implementation, provided that any requirements
applicable to the option are observed.
Furthermore, conformance requirements may be stated
a) positively: they state what is required to be done;
b) negatively: they state what is required not to be done.
To manage a set of options specific to a subset of International Standards, such as profiles, conformance classes
may be provided (see normative annex A).
5.4 Implementation conformance statement
To evaluate the conformance of a particular implementation, there shall be a statement of the options which have
been implemented. This will allow the implementation to be tested for conformance against the relevant
requirements, and against those requirements only. Such a statement is called an Implementation Conformance
Statement (ICS). This statement shall contain only options within the framework of requirements specified in the
relevant ISO geographic information standards. The statement shall not include options outside this framework.
This statement provides the testing laboratory with a better understanding of the System Under Test (SUT) for use
in the conformance assessment process and helps identify the boundaries of the domain of testing.
This statement may be generated by using an ICS proforma. An ICS proforma may be provided by the testing
laboratory. It is a questionnaire used as a framework to document those SUT capabilities necessary to undertake
conformance testing.
[2,3,4] [5]
For further information on ICS, see ISO 9646 and ISO 10303-31 .
5.5 A conforming implementation
A conforming implementation shall satisfy the conformance requirements of the applicable ISO geographic
information standards and shall be consistent with the ICS. Such an implementation shall have passed all tests
constituting the domain of testing, including any optional requirements stated as supported in it. A conforming
implementation may support additional capabilities not described in the appropriate International Standard,
providing those capabilities are not explicitly prohibited in the standard.
6 Conformance testing methodology
6.1 Introduction
This clause describes the conformance testing methodology, the different types of conformance tests that are used,
and additional information that must be provided by the client to the testing laboratory.
6.2 Types of conformance tests
6.2.1 Overview
The objective of conformance testing is to determine whether the implementation being tested conforms to the
requirements stated in the relevant ISO geographic information standard. Two types of tests are identified,
according to the extent to which they provide an indication of conformance.
6 © ISO 2000 – All rights reserved
---------------------- Page: 16 ----------------------
SIST EN ISO 19105:2005
ISO 19105:2000(E)
a)
...
Questions, Comments and Discussion
Ask us and Technical Secretary will try to provide an answer. You can facilitate discussion about the standard in here.