Information technology — Programming languages — Ada: Conformity assessment of a language processor

1.1 This International Standard establishes requirements for certifying an assessment that an Ada language processor conforms to the requirements of the Ada language standard, ISO/IEC 8652. It places requirements on the organization that performs the assessment, the assessment procedures, and the test suite used in the assessment. Finally, it places requirements on the form for the certificate of conformity. 1.2 This International Standard concerns only the assessment of conformity to the language requirements of ISO/IEC 8652. It does not concern the assessment of any other characteristics of a language processor or of the construction process used by the manufacturer of the language processor. NOTE In the sense of [ISO/IEC Guide 23], the Ada language standard, ISO/IEC 8652, is to be regarded as a standard for a specific property rather than a comprehensive product standard. 1.3 This International Standard is intended to be primarily suitable for use by a third party authority although portions of it may also be applied by a supplier (first party) or by a user or purchaser (second party). 1.4 An Ada language processor may be claimed to conform to the requirements of ISO/IEC 8652 regardless of the application of this International Standard. This International Standard prescribes the method for obtaining a certification that an Ada language processor conforms to ISO/IEC 8652. Customers desiring to acquire a language processor certified as conforming should explicitly require that certification by citing this International Standard. 1.5 Certification should not be construed as guaranteeing that the certified product is free of non-conformities or defects; it only certifies that no evidence of non-conformity was found during the certification process.

Technologies de l'information — Langages de programmation — Ada: Évaluation de conformité d'un processeur de langage

General Information

Status
Published
Publication Date
15-Dec-1999
Current Stage
9093 - International Standard confirmed
Start Date
06-Jan-2005
Completion Date
16-Dec-2020
Ref Project

Buy Standard

Standard
ISO/IEC 18009:1999 - Information technology -- Programming languages -- Ada: Conformity assessment of a language processor
English language
25 pages
sale 15% off
Preview
sale 15% off
Preview

Standards Content (sample)

INTERNATIONAL ISO/IEC
STANDARD 18009
First edition
1999-12-01
Information technology — Programming
languages — Ada: Conformity assessment
of a language processor
Technologies de l'information — Langages de programmation — Ada:
Évaluation de conformité d'un processeur de langage
Reference number
ISO/IEC 18009:1999(E)
ISO/IEC 1999
---------------------- Page: 1 ----------------------
ISO/IEC 18009:1999(E)
PDF disclaimer

This PDF file may contain embedded typefaces. In accordance with Adobe's licensing policy, this file may be printed or viewed but shall not

be edited unless the typefaces which are embedded are licensed to and installed on the computer performing the editing. In downloading

this file, parties accept therein the responsibility of not infringing Adobe's licensing policy. The ISO Central Secretariat accepts no liability in

this area.
Adobe is a trademark of Adobe Systems Incorporated.

Details of the software products used to create this PDF file can be found in the General Info relative to the file; the PDF-creation

parameters were optimized for printing. Every care has been taken to ensure that the file is suitable for use by ISO member bodies. In the

unlikely event that a problem relating to it is found, please inform the Central Secretariat at the address given below.

© ISO/IEC 1999

All rights reserved. Unless otherwise specified, no part of this publication may be reproduced or utilized in any form or by any means, electronic

or mechanical, including photocopying and microfilm, without permission in writing from either ISO at the address below or ISO's member body

in the country of the requester.
ISO copyright office
Case postale 56 � CH-1211 Geneva 20
Tel. + 41 22 749 01 11
Fax + 41 22 734 10 79
E-mail copyright@iso.ch
Web www.iso.ch
Printed in Switzerland
ii © ISO/IEC 1999 – All rights reserved
---------------------- Page: 2 ----------------------
ISO/IEC 18009:1999(E)
Contents Page

1 Scope......................................................................................................................................................1

2 Conformity .............................................................................................................................................1

3 Normative reference..............................................................................................................................2

4 Terms and definitions...........................................................................................................................2

4.1 Standardization .....................................................................................................................................2

4.2 Aims of standardization .......................................................................................................................2

4.3 Normative documents ..........................................................................................................................2

4.4 Bodies responsible for standards and regulations ...........................................................................3

4.5 Type of standards .................................................................................................................................3

4.6 Content of normative documents........................................................................................................4

4.7 Conformity assessment in general .....................................................................................................5

4.8 Determination of characteristics .........................................................................................................6

4.9 Conformity evaluation ..........................................................................................................................7

4.10 Assurance of conformity......................................................................................................................7

4.11 Approval and recognition arrangements............................................................................................8

4.12 Accreditation of conformity assessment bodies and persons ........................................................8

4.13 Programming language processor test methods ..............................................................................9

4.14 Miscellaneous......................................................................................................................................10

4.15 Terms and definitions of this International Standard......................................................................10

5 General.................................................................................................................................................11

6 Ada Conformity Assessment Laboratory (ACAL)............................................................................11

6.1 General requirements .........................................................................................................................11

6.1.1 Organization and management..........................................................................................................12

6.1.2 Quality system and review .................................................................................................................12

6.1.3 Personnel.............................................................................................................................................13

6.1.4 Handling of test items.........................................................................................................................13

6.1.5 Records................................................................................................................................................13

© ISO/IEC 1999 – All rights reserved iii
---------------------- Page: 3 ----------------------
ISO/IEC 18009:1999(E)

6.1.6 Certificates and reports ......................................................................................................................13

6.1.7 Sub-contracting of testing..................................................................................................................15

6.1.8 Outside support services and supplies ............................................................................................15

6.1.9 Complaints...........................................................................................................................................15

6.2 Specific requirements for Ada Conformity Assessment Laboratories (ACAL) ............................16

7 Ada Conformity Assessment Authority (ACAA) ..............................................................................16

7.1 General requirements .........................................................................................................................16

8 Ada Conformity Assessment Process ..............................................................................................17

8.1 General requirements .........................................................................................................................17

8.2 Conduct of the testing ........................................................................................................................18

8.2.1 General requirements .........................................................................................................................18

8.2.2 Obtaining a customized test suite and self-testing .........................................................................18

8.2.3 Evaluation of self-test results ............................................................................................................18

8.2.4 Witness testing....................................................................................................................................19

8.2.5 Documentation of test results............................................................................................................19

8.2.6 Issuing the certificate of conformity .................................................................................................19

8.2.7 Certification of closely related processors.......................................................................................20

8.3 Test issue management......................................................................................................................21

8.4 Marks of conformity ............................................................................................................................21

9 Ada Conformity Assessment Procedure (ACAP).............................................................................21

9.1 General requirements .........................................................................................................................21

10 Ada Conformity Assessment Test Suite (ACATS) ...........................................................................22

10.1 General requirements .........................................................................................................................22

10.2 Design of test suite .............................................................................................................................22

10.3 Maintenance and revision of the test suite.......................................................................................23

10.4 Availability of the test suite................................................................................................................23

Bibliography ..............................................................................................................................................................25

iv © ISO/IEC 1999 – All rights reserved
---------------------- Page: 4 ----------------------
ISO/IEC 18009:1999(E)
Foreword

ISO (the International Organization for Standardization) and IEC (the International Electrotechnical Commission)

form the specialized system for worldwide standardization. National bodies that are members of ISO or IEC

participate in the development of International Standards through technical committees established by the

respective organization to deal with particular fields of technical activity. ISO and IEC technical committees

collaborate in fields of mutual interest. Other international organizations, governmental and non-governmental, in

liaison with ISO and IEC, also take part in the work.

International Standards are drafted in accordance with the rules given in the ISO/IEC Directives, Part 3.

In the field of information technology, ISO and IEC have established a joint technical committee, ISO/IEC JTC 1.

Draft International Standards adopted by the joint technical committee are circulated to national bodies for voting.

Publication as an International Standard requires approval by at least 75 % of the national bodies casting a vote.

Attention is drawn to the possibility that some of the elements of this International Standard may be the subject of

patent rights. ISO and IEC shall not be held responsible for identifying any or all such patent rights.

International Standard ISO/IEC 18009 was prepared by Joint Technical Committee ISO/IEC JTC 1, Information

technology, Subcommittee SC 22, Programming languages, their environments and system software interfaces.

© ISO/IEC 1999 – All rights reserved v
---------------------- Page: 5 ----------------------
ISO/IEC 18009:1999(E)
Introduction

The Ada language community has a strong tradition of “compiler validation,” meaning conformity assessment.

Originally, the validation program was administered under the auspices of the United States Department of Defense,

as the use of “validated” compilers was a condition of usage in defense programs. Three key elements of this

validation program were the conduct of testing by independent testing laboratories, resolution of any test issues

by a single authority (the “Ada Validation Organization”), and world-wide acceptance of the “validation certificates”

resulting from successful conformity testing. In 1998, the U.S. DoD elected to turn the responsibility for

conformity assessment over to the private sector. This International Standard provides the basis for private

sector conformity assessment. It is the intent of this International Standard to ratify existing practices for Ada

conformity assessment.

In general terms, this International Standard states that independent Ada Conformity Assessment Laboratories

(ACAL) would perform the conformity assessment. The various ACALs would collaborate on the formation or

designation of a single Ada Conformity Assessment Authority (ACAA). The ACAA would manage and

administer an Ada Conformity Assessment Test Suite (ACATS). Each ACAL would perform conformity

assessments by applying the ACATS in accordance with an Ada Conformity Assessment Procedure (ACAP).

Each ACAL would issue certificates of conformity.The ACAA would resolve any test issues that may arise

during conformity assessments performed by ACALs and would approve test reports and certificates of

conformity before they are issued to the clients of the ACAL.

The ACAA would act in the role of the current de facto “Ada Validation Organization” and its “Fast Reaction Team”

and would also participate in the work of ISO/IEC JTC1/SC22/WG9 in order to apprise that group of possible defects

discovered in the language standard as a result of conformity assessment.

This International Standard does not reuse an existing test method designed for any other language [as

suggested by ISO/IEC Guide 2, 6.7.1] but instead describes a method that, although new to standardization, has a

long de facto tradition within the Ada community. This method is based upon a well established method that has

already been in uniformly applied usage for 15 years. Continuity with this tradition is considered essential to the

success of the Ada language standard.
This International Standard has the following goals:

�This International Standard should permit a smooth transition from the current de facto method of “Ada

compiler validation” to the standardized method.

�Users of Ada processor certifications should gain the same degree of assurance as is gained with the current

de facto certification mechanism.

This International Standard was prepared by Working Group 9 (Ada) of Subcommittee 22 (Programming

languages, their environments and system software interfaces) of Joint Technical Committee 1 (Information

technology). It establishes requirements for assessing the conformity of Ada language processors to the

requirements of the Ada language standard.

Portions of this International Standard are based upon U.S. Department of Defense procedures for Ada compiler

“validation.” The co-operation of the U.S. DoD in contributing the appropriate documents is gratefully acknowledged.

ISO, IEC, JTC1 and SC22 have already prepared a number of documents related to conformity assessment.

Rather than make normative references to these documents,this International Standard incorporates appropriate

excerpts of their text, in some cases paraphrasing the text, changing the normative strength, or adapting the

provision to the specific circumstances. In each case, the original source of the provision is noted in brackets.

Therefore, these documents are listed in the bibliography of this International Standard, rather than in Clause 3,

Normative reference.
vi © ISO/IEC 1999 – All rights reserved
---------------------- Page: 6 ----------------------
ISO/IEC 18009:1999(E)

In order to relate better to the large body of existing work, particular attention has been paid to terminology. Terms

defined in this International Standard have been presented in bold typeface.
© ISO/IEC 1999 – All rights reserved vii
---------------------- Page: 7 ----------------------
INTERNATIONAL STANDARD ISO/IEC 18009:1999(E)
Information technology — Programming languages — Ada:
Conformity assessment of a language processor
1 Scope

1.1 This International Standard establishes requirements for certifying an assessment that an Ada language

processor conforms to the requirements of the Ada language standard, ISO/IEC 8652. It places requirements

on the organization that performs the assessment, the assessment procedures, and the test suite used in the

assessment. Finally, it places requirements on the form for the certificate of conformity.

1.2 This International Standard concerns only the assessment of conformity to the language requirements of

ISO/IEC 8652. It does not concern the assessment of any other characteristics of a language processor or of the

construction process used by the manufacturer of the language processor.

NOTE In the sense of [ISO/IEC Guide 23], the Ada language standard, ISO/IEC 8652, is to be regarded as a standard for

a specific property rather than a comprehensive product standard.

1.3 This International Standard is intended to be primarily suitable for use by a third party authority although

portions of it may also be applied by a supplier (first party) or by a user or purchaser (second party).

1.4 An Ada language processor may be claimed to conform to the requirements of ISO/IEC 8652 regardless of

the application of this International Standard.This International Standard prescribes the method for obtaining a

certification that an Ada language processor conforms to ISO/IEC 8652. Customers desiring to acquire a

language processor certified as conforming should explicitly require that certification by citing this International

Standard.

1.5 Certification should not be construed as guaranteeing that the certified product is free of non-conformities or

defects; it only certifies that no evidence of non-conformity was found during the certification process.

2 Conformity

2.1 An Ada language processor is said to be “certified as conforming” if so assessed by an Ada Conformity

Assessment Laboratory (ACAL) and the Ada Conformity Assessment Authority (ACAA). In performing this

certification,the ACAL and the ACAA shall consider the results of testing performed by the ACAL.The ACAL

testing shall be performed in accordance with the Ada Conformity Assessment Procedure (ACAP)using the

Ada Conformity Assessment Test Suite (ACATS).

2.2 This International Standard places requirements upon the ACAL, ACAA, ACAP and ACATS.

NOTES

1 Conformity of an “implementation” of the Ada language standard is defined by subclause 1.1.3 of ISO/IEC 8652.

The term “language processor” or “compiler” in this International Standard is to be regarded as synonymous with the term

“implementation” as used in ISO/IEC 8652. This International Standard prescribes requirements for the assessment that a

language processor conforms to the requirements of ISO/IEC 8652.

2An International Standard on test methods, such as this one, does not imply any obligation to carry out any kind

of test. It merely states the method by which the assessment, if required and referred to (for example, in the same or another

standard,orina regulation, or in contract documents), should be carried out. [ISO/IEC Directives, Part 2, subclause 6.5]

© ISO/IEC 1999 – All rights reserved 1
---------------------- Page: 8 ----------------------
ISO/IEC 18009:1999(E)
3 Normative reference

The following normative documents contain provisions which, through reference in this text, constitute

provisions of this International Standard. For dated references, subsequent amendments to, or revisions of, any

of these publications do not apply. However, parties to agreements based on this International Standard are

encouraged to investigate the possibility of applying the most recent editions of the normative documents

indicated below. For undated references, the latest edition of the normative document referred to applies.

Members of ISO and IEC maintain registers of currently valid International Standards.

ISO/IEC 8652, Information technology — Programming languages — Ada.
4 Terms and definitions

For the purposes of this International Standard, the following terms and definitions apply.

4.1 Standardization
4.1.1
consensus

general agreement, characterized by the absence of sustained opposition to substantial issues by any important part

of the concerned interests and by a process that involves seeking to take into account the views of all parties

concerned and to reconcile any conflicting arguments
NOTE Consensus need not imply unanimity.
[ISO/IEC Guide 2, 1.7]
4.2 Aims of standardization
4.2.1
fitness for purpose

ability of a product, process or service to serve a defined purpose under specific conditions [ISO/IEC Guide 2, 2.1]

4.3 Normative documents
4.3.1
document
any medium with information recorded on or in it [ISO/IEC Guide 2, 3.1]
4.3.2
normative document

document that provides rules, guidelines or characteristics for activities or their results

NOTES

1Theterm“normative document” is a generic term that covers such documents as standards, technical

specifications, codes of practice and regulations.

2 The terms for different kinds of normative documents are defined considering the document and its content as a

single entity.
[ISO/IEC Guide 2, 3.1]
4.3.3
standard

document, established by consensus and approved by a recognized body, that provides, for common and

repeated use, rules, guidelines or characteristics for activities or their results, aimed at the achievement of the

optimum degree of order in a given context [ISO/IEC Guide 2, 3.2]
2 © ISO/IEC 1999 – All rights reserved
---------------------- Page: 9 ----------------------
ISO/IEC 18009:1999(E)
4.3.4
International Standard

standard that is adopted by an international standardizing/standards organization and made available to the

public [ISO/IEC Guide 2, 3.2.1.1]
4.3.5
technical specification

document that prescribes technical requirements to be fulfilled by a product, process or service

NOTES

1A technical specification would indicate, whenever appropriate, the procedure(s) by means of which it may be

determined whether the requirements given are fulfilled.

2A technical specification may be a standard,apartofa standard or independent of a standard.

[ISO/IEC Guide 2, 3.4]
4.3.6
regulation

document providing binding legislative rules, that is adopted by an authority [ISO/IEC Guide 2, 3.6]

4.4 Bodies responsible for standards and regulations
4.4.1
body
legal or administrative entity that has specific tasks and composition

NOTE Examples of bodies are organizations, authorities, companies and foundations.

[ISO/IEC Guide 2, 4.1]
4.4.2
organization

body that is based on the membership of other bodies or individuals and has an established constitution and its

own administration [ISO/IEC Guide 2, 4.2]
4.4.3
international standardizing organization

standardizing organization whose membership is open to the relevant national body from every country [ISO/IEC

Guide 2, 4.3.2]
4.4.4
authority
body that has legal powers and rights
NOTE An authority can be regional, national or local.
[ISO/IEC Guide 2, 4.5]
4.5 Type of standards
4.5.1
testing standard

standard that is concerned with test methods, sometimes supplemented with other provisions related to testing,

such as sampling, use of statistical methods, sequence of tests [ISO/IEC Guide 2, 5.3]

© ISO/IEC 1999 – All rights reserved 3
---------------------- Page: 10 ----------------------
ISO/IEC 18009:1999(E)
4.5.2
product standard

standard that specifies requirements to be fulfilled by a product or a group of products, to establish its fitness for

purpose [ISO/IEC Guide 2, 5.4]
4.6 Content of normative documents
4.6.1
provision

expression in the content of a normative document, that takes the form of a statement,an instruction,a

recommendation or a requirement

NOTE These types of provision are distinguished by the form of wording they employ; e.g. instructions are expressed in

the imperative mood, recommendations by the use of the auxiliary “should” and requirements by the use of the auxiliary

“shall.”
[ISO/IEC Guide 2, 7.1]
4.6.2
statement
provision that conveys information [ISO/IEC Guide 2, 7.2]
4.6.3
instruction
provision that conveys an action to be performed [ISO/IEC Guide 2, 7.3]
4.6.4
recommendation
provision that conveys advice or guidance [ISO/IEC Guide 2, 7.4]
4.6.5
requirement
provision that conveys criteria to be fulfilled [ISO/IEC Guide 2, 7.5]
4.6.6
exclusive requirement

requirement of a normative document that must necessarily be fulfilled in order to comply with that document

NOTE The term “mandatory requirement” should be used to mean only a requirement made compulsory by law or

regulation.
[ISO/IEC Guide 2, 7.5.1]
4.6.7
optional requirement

requirement of a normative document that must be fulfilled in order to comply with a particular option permitted by

that document
NOTE An optional requirement may be either
(a) one of two or more alternative requirements;or

(b) an additional requirement that must be fulfilled only if applicable and that may otherwise be disregarded.

[ISO/IEC Guide 2, 7.5.2]
4.6.8
deemed-to-satisfy provision

provision that indicates one or more means of compliance with a requirement of a normative document [ISO/IEC

Guide 2, 7.6]
4 © ISO/IEC 1999 – All rights reserved
---------------------- Page: 11 ----------------------
ISO/IEC 18009:1999(E)
4.6.9
descriptive provision

provision for fitness for purpose that concerns the characteristics of a product, process or service

NOTE A descriptive provision usually conveys design, constructional details, etc. with dimensions and material

composition.
[ISO/IEC Guide 2, 7.7]
4.7 Conformity assessment in general
4.7.1
conformity

fulfillment by a product, process or service of specified requirements [ISO/IEC Guide 2, 12.1]

4.7.2
conformity assessment

any activity concerned with determining directly or indirectly that relevant requirements are fulfilled

NOTE Typical examples of conformity assessment activities are sampling, testing and inspection; evaluation,

verification and assurance of conformity (supplier’s declaration, certification); registration, accreditation and approval

as well as their combinations.
[ISO/IEC Guide 2, 12.2; ISO/IEC Guide 7, 3.1]
4.7.3
conformity assessment body
body that conducts conformity assessment [ISO/IEC Guide 2, 12.3]
4.7.4
conformity assessment system

system that has its own rules of procedure and management for carrying out conformity assessment

NOTES

1 Conformity assessment systems may be operated at, for example, national, regional or international level.

2 Typical examples of conformity assessment systems are testing systems, inspection systems, and certification

systems.
[ISO/IEC Guide 2, 12.4]
4.7.5
conformity assessment scheme

conformity assessment system as related to specified products, processes or services to which the same

particular standards and rules, and the same procedure, apply

NOTE The term “program” is used in some countries to cover the same concept as “scheme.”

[ISO/IEC Guide 2, 12.5]
4.7.6
access to a conformity assessment system

opportunity for an applicant to obtain conformity assessment under the rules of the system [ISO/IEC Guide 2,

12.6]
4.7.7
participant in a conformity assessment system

conformity assessment body that operates under the rules of the system without having the opportunity to take

part in the management of the system [ISO/IEC Guide 2, 12.7]
© ISO/IEC 1999 – All rights reserved 5
---------------------- Page: 12 ----------------------
ISO/IEC 18009:1999(E)
4.7.8
member of a conformity assessment system

conformity assessment body that operates under the rules of the system and has the opportunity to take part in

the management of the system [ISO/IEC Guide 2, 12.8]
4.7.9
third party

person or body that is recognized as being independent of the parties involved, as concerns the issue in question

NOTE Parties involved are usually supplier (“first party”) and purchaser (“second party”) interests.

[ISO/IEC Guide 2, 12.9]
4.7.10
registration

procedure by which a body indicates relevant characteristics of a product, process or service, or particulars of a

body or person, in an appropriate, publicly available list [ISO/IEC Guide 2, 12.10]

4.7.11
accreditation

procedure by which an authoritative body gives formal recognition that a body or person is competent to carry out

specific tasks [ISO/IEC Guide 2, 12.11]
4.7.12
reciprocity

bilateral relationship where both parties have the same rights and obligations towards each other [ISO/IEC Guide 2,

12.12]
4.7.13
equal treatment

treatment accorded to products, processes or services originating in other countries that is no less favorable than

that accorded to like products, processes or services of national origin, in a comparable situation [ISO/IEC Guide 2,

12.13]
4.8 Determination of characteristics
4.8.1
test

technical operation that consists of the determination of one or more characteristics of a given product, process or

service according to a specified procedure [ISO/IEC Guide 2, 13.1]
4.8.2
testing
action of carrying out one or more tests [ISO/IEC Guide 2, 13.1.1]
4.8.3
test method
specified technical procedure for performing a test [ISO/IEC Guide 2, 13.2]
4.8.4
test report

document that presents test results and other information relevant to a test [ISO/IEC Guide 2, 13.3]

4.8.5
laboratory
body that calibrates and/or tests [ISO/IEC Guide 25, 3.1]
4.8.6
testing laboratory
laboratory that performs tests
6 © ISO/IEC 1999 – All rights reserved
---------------------- Page: 13 ----------------------
ISO/IEC 18009:1999(E)

NOTE The term “testing laboratory” can be used in the sense of a legal entity, a technical entity or both.

[ISO/IEC Guide 2, 13.4]
4.9 Conformity evaluation
4.9.1
conformity evaluation

systematic examination of the extent to which a product, process or service fulfills specified requirements [ISO/IEC

Guide 2, 14.1]
4.9.2
inspection
confor
...

Questions, Comments and Discussion

Ask us and Technical Secretary will try to provide an answer. You can facilitate discussion about the standard in here.