ISO 10303-31:1994

Industrial automation systems and integration — Product data representation and exchange — Part 31: Conformance testing methodology and framework: General concepts

This series of parts applies to the phases of the conformance testing process, these phases being characterised by the following major activities: the definition of abstract test suites for ISO 10303 application protocols, the definition of abstract test methods for ISO 10303 implementation methods, the conformance assessment process carried out by a testing laboratory for a client, culminating in the production of a conformance test report. This part is applicable to all of the above activities, providing introductory material, normative requirements on each part of the series, and definitions of common terms and concepts.

Systèmes d'automatisation industrielle et intégration — Représentation et échange de données de produits — Partie 31: Méthodologie et cadre général pour les essais de conformité: Concepts généraux

General Information

• Status: Published
• Publication Date: 21-Dec-1994
• ICS: 25.040.40 - Industrial process measurement and control
• Technical Committee: ISO/TC 184/SC 4 - Industrial data
• Drafting Committee: ISO/TC 184/SC 4/WG 12 - STEP product modelling and resources
• Current Stage: 9093 - International Standard confirmed
• Start Date: 31-Dec-2020
• Completion Date: 19-Apr-2025

Relations

• Consolidated By: ISO/TS 18234-4:2006 - Traffic and Travel Information (TTI) — TTI via Transport Protocol Expert Group (TPEG) data-streams — Part 4: Road Traffic Message (RTM) application
• Effective Date: 06-Jun-2022

Standards Content (Sample)

INTERNATIONAL
ISO
STANDARD
10303-31
First edition
1994-12-15
Industrial automation Systems and
integration - Product data representation
and exchange -
Part 31:
Conformance testing methodology and
framework: General concepts
Systemes d ’automatisation
industrielle et intkgration - Repr&en ta tion
et khange de donnkes de
produits -
Partie 3 1: Mk thodologie et cadre g&Gral pour /es essais de conformitk
Concepts g&Graux
Reference nun-her
ISO 10383-31:1994(E)
Contents
Page
1 Scope . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Applicability of this series of Parts . . . . . . . . . . . . . . . . . . . . . . . . .
1.1
12 . Applicability of this part of ISO 10303 . . . . . . . . . . . . . . . . . . . . . . .
13 . Coverage of this series of Parts . . . . . . . . . . . . . . . . . . . . . . . . . . .
14 . Coverage of this part of ISO 10303 . . . . . . . . . . . . . . . . . . . . . . . . .
2 Normative references . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
3 Definitions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
31 . Terms defined in ISO 10303-1 . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. Other definitions . . . . . . . . . . . . . . . . . . . . . * . . . . . . . . . . . . .
32 4
3.2.1 abstract test case (ATC)
........................... 4
3.2.2 abstract test group
...............................
3.2.3 abstract test method
.............................. 4
(laboratory) accreditation
3.2.4
........................... 5
3.2.5 accreditation body
...............................
assessor
3.2.6 ,
..................................... 5
3.2.7 attestation of conformity
........................... 5
3.2.8 basic tests.
................................... 5
3.2.9 capabilities of an IUT
............................. 5
3.2.10 capability tests
.................................
3.2.11 certificate of conformance
........................... 5
3.2.12 certificate of conformity; certificate of conformance
............. 5
3.2.13 certification body
............................... 5
3.2.14 certification mark
............................... 5
3.2.15 certification of conformity
........................... G
3.2.16 certification System
.............................. 6
3.2.17
client (of a testing laboratory)
........................ 6
3.2.18 comparability (of results)
........................... 6
3.2.19
conformance
.................................. G
3.2.20 conformance assessment process
....................... 6
3.2.21
conformance log
................................ 6
>
3.2.22 conformance testing
.............................. 6
3.2.23
(conformance) test report
........................... 6
0 ISO 1994
All rights reserved. Unless otherwise specified, no part of this publication may be reproduced or
utilized in any ferm or by any means, electronie or mechanical, including photocopying and
microfilm, without permission in writing from the publisher.
International Organization for S tandardization
Case Postale 56 l CH- 1211 Geneve 20 l Switzerland
Printed in Switzerland
ii
ISO lom-31:1994(E)
c ISO
........................... 6
3.2.24 conforming implementation
............................ 6
3.2.25 conformity; conformance
control board .
3.2.26
.......................... 6
3.2.27 declaration of conformance
. 7
declaration of conformity; (manufacturer ’s) declaration of conformance
3.2.28
executable test case .
3.2.29
.............................. 7
3.2.30 executable test Suite
3.2.31 fail (verdict) .
............................... 7
3.2.32 falsification testing
3.2.33 Implementation Under Test (IUT) .
3.2.34 inconclusive (verdict ) .
in-hause testing .
3.2.35
................. 7
3.2.36 manufacturer ’s decla,ration of conformance
................................
3.2.37 non-conformance
non-conformity; non-conformance .
3.2.38
.................................. 7
3.2.39 pass (verdict)
PIXIT proforma . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
3.2.40
3.2.41 postprocessor .
3.2.42 preprocessor . 8
3.2.43 proficiency testing .
Protocol Implementation extra Information for Testing (PIXIT) . 8
3.2.44
3.2.45 repeatability (of results) .
3.2.46 resolution tests .
3.2.47 selected abstract test Suite . 8
3.2.48 selected executable test Suite .
System Under Test (SUT) . 8
3.2.49
3.2.50 test campaign. .
..................................... 8
3.2.51 testcase
3.2.52 test case error .
test purpose . 9
3.2.53
3.2.54 test realiser .
test report . 9
3.2.55
test verdict . 9
3.2.56
3.2.57 testing laborstory .
(test) verdict . 9
3.2.58
3.2.59 verdict criteria, .
............................... 9
3.2.60 verification testing
4 Abbreviations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9
5 Conformance . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
51 . The meaning of conformance in ISO 10303 . . . . . . . . . . . . . . . . . . . . 10
Conformance requirements . r ,, 0 . . o l . D l . o o n . n . . n e . . . . . 0 . . 10
52 .
. Protocol Implementation Conformance Statement . . m . . l . . . . . . . . . . 10
54 . A conforming System . . e . . . . . . . . . . . . . . . . . . . . . . . . . . . l . .
6 Conformance testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11
. . .
c ISO
. Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11
62 . Types of conformance tests . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11
Basic tests . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12
6.2.1
6.2.2 Capability tests . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12
. Protocol Implementation extra InformaJtion for Testing . . . . . . . . . . . . .
. Conformance assessment process overview . . . . . . . . . . . . . . . . . . . . .
65 . Preparation for testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. Test campaign . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16
67 . Analysis of results . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16
. Conformance test report production . . . . . . . . . . . . . . . . . . . . . . . . 16
. Intrinsic properties of the conformance assessment process . . . . . . . . . . . .
Repeatabilitv of results . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17
6.9.1
6.9.2 Comparability of results . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Auditability of results . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17
6.9.3
c
7 Abstract test methods . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18
8 Abstract and executable test suites . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18
81 . Structure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18
82 . Test purposes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. Abstract test cases . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18
84 . Executable test cases . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20
. Relaltionship between abstract and executable test cases . . . . . . . . . . . . . 20
Annexes
A Information Object registration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21
Optional conformance requirement s . . . . . . . . . . . . . . . . . . . . . . . . . . . 22
B
Resolution tests . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23
C
Supporting organisations
D
................................. 24
D.l Introduction
.....................................
D.l.l Purpose 24
.....................................
D.1.2 Scope .
D.1.3 Intended readership
..............................
Background.
D.l.4 25
..................................
D.1.5 General philosophy of conformance testing
................. 25
Responsible authorities
D.2 25
...............................
D.2.1 Control board
.................................
D.2.2 Accreditation body 28
...............................
D.2.3 Testing laboratory
...............................
D.2.4 Certification body ,, . ,, 29
.............. ............
D.3 Administration and certification 30
..........................
D.3.1 Guidelines for role of the certification body
................. 30
D.3.2 Sponsoring a laboratory accreditation programme
............. 30
__ _
ISO 10303=31:1994(E)
c ISO
Conditions for testing laboratorv accreditation .
D.3.3
................. 31
D.3.4 Criteria for accrediting testing laboratories
Testing laboratory assessment .
D.3.5
D.4 The process of certification . 34
Initial contact . 34
D.4.1
Certificate of conformity content and presentation .
D.4.2
National responsibilities . 35
D.4.3
D.4.4 International (ISO TC184/SC4) responsibilities . . . . . . . . . . . . . . . 35
. . . . . . . . . . . . . . . . . . . 38
E Bibliography . . . . . . . .
Index . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 39
Figures
1 Relationship between conformance testing Standards and other series of Parts . . . . 2
2 Overview of the conformance assessment process . . . . . . . . . . . . . . . . . . . . 15
Example structure of an abstract test Suite . . . . . . . . . . . . . . . . . . . . . . . 19
D-1 Infrastructure for conformance testing . . . . . . . . . . . . . . . . . . . . . . . . . . 26
D.2 Sample certificate of conformity . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 36
D.3 Sample form for additional claims made by the client . . . . . . . . . . . . . . . . . .
V
c ISO
ISO loso3-31:1994(E) 0
Foreword
The International Organization for Standa,rdization (ISO) is a worldwide federation of national
Standards bodies (ISO member bodies). The work of prepa,ring International Standards is nor-
mally carried out t hrough IS 0 t echnical commit t ees. Esch member body interested in a subject
for which a technical committee has been established has the right to ‘be represented on that
International organizations, governmental and non-governmental, in liaison with
committee.
ISO, also take part in the work. ISO collaborates closely with the International Electrotechnical
on all matters of electrotechnical standardization.
Commission (IEC)
Draft International Standards adopted by technical committees are circulated to the member
Publication as an International Sta)ndard requires approval by at least 75%
bodies for voting.
of the member bodies casting a vote.
International Standard ISO 10303-31 was prepared by Technical Committee ISO/TC 184, 11~-
Subcommittee SC2, Industrial data and global
dustrial automation Systems and integration,
manufacturing programnzing languages.
ISO 10303 consists of the following Parts under the general title Industrial automation Systems
and integration - Product data representation and ezchange:
- Part 1, Overview and fundamental principles;
- Part 11, Description methods: The KWRWS 1a)nguage reference manual;
- Part 21, Implementation methods: Clear text encoding of the exchange structure;
- Part 22, Implementation methods: Standard data a#ccess interface specification;
- Part 31, Conformance testing methodology and framework: General concepts;
- Part 32, Conformance testing methodology and framework: Reyuirements on testing
laboratories and client s;
- Part 41, Integrated generic resources: Fundamentals of product description and support;
- Part 42, Integrated generic resources: Geometrie and topological represent ation;
- Part 43, Integrated generic resources: Representation structures;
- Part 44, Integrated generic resources: Product structure configuration;
- Part 45, Integrated generic resources: Materials;
-
Part 46, Integrated generic resourceso Visual presentation;
- Part 47, Integrated generic. resources: Shape Variation tolerantes;
- Part 49, Integrated generic resources: Process structure and properties;
vi
ISO 1030%31:1994(E)
c ISO
-
Part 101, Integrated application resources: Draughting;
-
Part 104, Integrated application resources: Finite element analysis;
- Part 105, Integrated application resources: Kinematics;
- Part 201, Application protocol: Explicit draughting;
- Part 202, Application protocol: Associative draughting;
-- Part 203, Application protocol: Configuration controlled design;
- Part 207, Application protocol: Sheet metal die planning and design;
- Part 210, Application protocol: Printed circuit assembly product design data;
- Part 213, Application protocol: Numerital control process Plans for machined Parts.
The structure of this International Standard is described in ISO 10303-1. The numbering of the
Parts of this International Standard reflects its structure:
- Part 11 speci-fies the description methods;
- Parts 21 and 22 specify the implementation methods;
- Parts 31 and 32 specify the conformance testing methodology and framework;
- Parts 41 to 49 specify the integrated generic resources;
- Parts 101 to 105 specifv the integrated application resources;
”
- Parts 201 to 213 specify the application protocols.
Should further Parts be published, they will follow the Same numbering Patte
...