ISO/IEC 18009:1999
(Main)Information technology — Programming languages — Ada: Conformity assessment of a language processor
Information technology — Programming languages — Ada: Conformity assessment of a language processor
1.1 This International Standard establishes requirements for certifying an assessment that an Ada language processor conforms to the requirements of the Ada language standard, ISO/IEC 8652. It places requirements on the organization that performs the assessment, the assessment procedures, and the test suite used in the assessment. Finally, it places requirements on the form for the certificate of conformity. 1.2 This International Standard concerns only the assessment of conformity to the language requirements of ISO/IEC 8652. It does not concern the assessment of any other characteristics of a language processor or of the construction process used by the manufacturer of the language processor. NOTE In the sense of [ISO/IEC Guide 23], the Ada language standard, ISO/IEC 8652, is to be regarded as a standard for a specific property rather than a comprehensive product standard. 1.3 This International Standard is intended to be primarily suitable for use by a third party authority although portions of it may also be applied by a supplier (first party) or by a user or purchaser (second party). 1.4 An Ada language processor may be claimed to conform to the requirements of ISO/IEC 8652 regardless of the application of this International Standard. This International Standard prescribes the method for obtaining a certification that an Ada language processor conforms to ISO/IEC 8652. Customers desiring to acquire a language processor certified as conforming should explicitly require that certification by citing this International Standard. 1.5 Certification should not be construed as guaranteeing that the certified product is free of non-conformities or defects; it only certifies that no evidence of non-conformity was found during the certification process.
Technologies de l'information — Langages de programmation — Ada: Évaluation de conformité d'un processeur de langage
General Information
Standards Content (Sample)
INTERNATIONAL ISO/IEC
STANDARD 18009
First edition
1999-12-01
Information technology — Programming
languages — Ada: Conformity assessment
of a language processor
Technologies de l'information — Langages de programmation — Ada:
Évaluation de conformité d'un processeur de langage
Reference number
ISO/IEC 18009:1999(E)
©
ISO/IEC 1999
---------------------- Page: 1 ----------------------
ISO/IEC 18009:1999(E)
PDF disclaimer
This PDF file may contain embedded typefaces. In accordance with Adobe's licensing policy, this file may be printed or viewed but shall not
be edited unless the typefaces which are embedded are licensed to and installed on the computer performing the editing. In downloading
this file, parties accept therein the responsibility of not infringing Adobe's licensing policy. The ISO Central Secretariat accepts no liability in
this area.
Adobe is a trademark of Adobe Systems Incorporated.
Details of the software products used to create this PDF file can be found in the General Info relative to the file; the PDF-creation
parameters were optimized for printing. Every care has been taken to ensure that the file is suitable for use by ISO member bodies. In the
unlikely event that a problem relating to it is found, please inform the Central Secretariat at the address given below.
© ISO/IEC 1999
All rights reserved. Unless otherwise specified, no part of this publication may be reproduced or utilized in any form or by any means, electronic
or mechanical, including photocopying and microfilm, without permission in writing from either ISO at the address below or ISO's member body
in the country of the requester.
ISO copyright office
Case postale 56 � CH-1211 Geneva 20
Tel. + 41 22 749 01 11
Fax + 41 22 734 10 79
E-mail copyright@iso.ch
Web www.iso.ch
Printed in Switzerland
ii © ISO/IEC 1999 – All rights reserved
---------------------- Page: 2 ----------------------
ISO/IEC 18009:1999(E)
Contents Page
1 Scope.1
2 Conformity .1
3 Normative reference.2
4 Terms and definitions.2
4.1 Standardization .2
4.2 Aims of standardization .2
4.3 Normative documents .2
4.4 Bodies responsible for standards and regulations .3
4.5 Type of standards .3
4.6 Content of normative documents.4
4.7 Conformity assessment in general .5
4.8 Determination of characteristics .6
4.9 Conformity evaluation .7
4.10 Assurance of conformity.7
4.11 Approval and recognition arrangements.8
4.12 Accreditation of conformity assessment bodies and persons .8
4.13 Programming language processor test methods .9
4.14 Miscellaneous.10
4.15 Terms and definitions of this International Standard.10
5 General.11
6 Ada Conformity Assessment Laboratory (ACAL).11
6.1 General requirements .11
6.1.1 Organization and management.12
6.1.2 Quality system and review .12
6.1.3 Personnel.13
6.1.4 Handling of test items.13
6.1.5 Records.13
© ISO/IEC 1999 – All rights reserved iii
---------------------- Page: 3 ----------------------
ISO/IEC 18009:1999(E)
6.1.6 Certificates and reports .13
6.1.7 Sub-contracting of testing.15
6.1.8 Outside support services and supplies .15
6.1.9 Complaints.15
6.2 Specific requirements for Ada Conformity Assessment Laboratories (ACAL) .16
7 Ada Conformity Assessment Authority (ACAA) .16
7.1 General requirements .16
8 Ada Conformity Assessment Process .17
8.1 General requirements .17
8.2 Conduct of the testing .18
8.2.1 General requirements .18
8.2.2 Obtaining a customized test suite and self-testing .18
8.2.3 Evaluation of self-test results .18
8.2.4 Witness testing.19
8.2.5 Documentation of test results.19
8.2.6 Issuing the certificate of conformity .19
8.2.7 Certification of closely related processors.20
8.3 Test issue management.21
8.4 Marks of conformity .21
9 Ada Conformity Assessment Procedure (ACAP).21
9.1 General requirements .21
10 Ada Conformity Assessment Test Suite (ACATS) .22
10.1 General requirements .22
10.2 Design of test suite .22
10.3 Maintenance and revision of the test suite.23
10.4 Availability of the test suite.23
Bibliography .25
iv © ISO/IEC 1999 – All rights reserved
---------------------- Page: 4 ----------------------
ISO/IEC 18009:1999(E)
Foreword
ISO (the International Organization for Standardization) and IEC (the International Electrotechnical Commission)
form the specialized system for worldwide standardization. National bodies that are members of ISO or IEC
participate in the development of International Standards through technical committees established by the
respective organization to deal with particular fields of technical activity. ISO and IEC technical committees
collaborate in fields of mutual interest. Other international organizations, governmental and non-governmental, in
liaison with ISO and IEC, also take part in the work.
International Standards are drafted in accordance with the rules given in the ISO/IEC Directives, Part 3.
In the field of information technology, ISO and IEC have established a joint technical committee, ISO/IEC JTC 1.
Draft International Standards adopted by the joint technical committee are circulated to national bodies for voting.
Publication as an International Standard requires approval by at least 75 % of the national bodies casting a vote.
Attention is drawn to the possibility that some of the elements of this International Standard may be the subject of
patent rights. ISO and IEC shall not be held responsible for identifying any or all such patent rights.
International Standard ISO/IEC 18009 was prepared by Joint Technical Committee ISO/IEC JTC 1, Information
technology, Subcommittee SC 22, Programming languages, their environments and system software interfaces.
© ISO/IEC 1999 – All rights reserved v
---------------------- Page: 5 ----------------------
ISO/IEC 18009:1999(E)
Introduction
The Ada language community has a strong tradition of “compiler validation,” meaning conformity assessment.
Originally, the validation program was administered under the auspices of the United States Department of Defense,
as the use of “validated” compilers was a condition of usage in defense programs. Three key elements of this
validation program were the conduct of testing by independent testing laboratories, resolution of any test issues
by a single authority (the “Ada Validation Organization”), and world-wide acceptance of the “validation certificates”
resulting from successful conformity testing. In 1998, the U.S. DoD elected to turn the responsibility for
conformity assessment over to the private sector. This International Standard provides the basis for private
sector conformity assessment. It is the intent of this International Standard to ratify existing practices for Ada
conformity assessment.
In general terms, this International Standard states that independent Ada Conformity Assessment Laboratories
(ACAL) would perform the conformity assessment. The various ACALs would collaborate on the formation or
designation of a single Ada Conformity Assessment Authority (ACAA). The ACAA would manage and
administer an Ada Conformity Assessment Test Suite (ACATS). Each ACAL would perform conformity
assessments by applying the ACATS in accordance with an Ada Conformity Assessment Procedure (ACAP).
Each ACAL would issue certificates of conformity.The ACAA would resolve any test issues that may arise
during conformity assessments performed by ACALs and would approve test reports and certificates of
conformity before they are issued to the clients of the ACAL.
The ACAA would act in the role of the current de facto “Ada Validation Organization” and its “Fast Reaction Team”
and would also participate in the work of ISO/IEC JTC1/SC22/WG9 in order to apprise that group of possible defects
discovered in the language standard as a result of conformity assessment.
This International Standard does not reuse an existing test method designed for any other language [as
suggested by ISO/IEC Guide 2, 6.7.1] but instead describes a method that, although new to standardization, has a
long de facto tradition within the Ada community. This method is based upon a well established method that has
already been in uniformly applied usage for 15 years. Continuity with this tradition is considered essential to the
success of the Ada language standard.
This International Standard has the following goals:
�This International Standard should permit a smooth transition from the current de facto method of “Ada
compiler validation” to the standardized method.
�Users of Ada processor certifications should gain the same degree of assurance as is gained with the current
de facto certification mechanism.
This International Standard was prepared by Working Group 9 (Ada) of Subcommittee 22 (Programming
languages, their environments and system software interfaces) of Joint Technical Committee 1 (Information
technology). It establishes requirements for assessing the conformity of Ada language processors to the
requirements of the Ada language standard.
Portions of this International Standard are based upon U.S. Department of Defense procedures for Ada compiler
“validation.” The co-operation of the U.S. DoD in contributing the appropriate documents is gratefully acknowledged.
ISO, IEC, JTC1 and SC22 have already prepared a number of documents related to conformity assessment.
Rather than make normative references to these documents,this International Standard incorporates appropriate
excerpts of their text, in some cases paraphrasing the text, changing the normative strength, or adapting the
provision to the specific circumstances. In each case, the original source of the provision is noted in brackets.
Therefore, these documents are listed in the bibliography of this International Standard, rather than in Clause 3,
Normative reference.
vi © ISO/IEC 1999 – All rights reserved
---------------------- Page: 6 ----------------------
ISO/IEC 18009:1999(E)
In order to relate better to the large body of existing work, particular attention has been paid to terminology. Terms
defined in this International Standard have been presented in bold typeface.
© ISO/IEC 1999 – All rights reserved vii
---------------------- Page: 7 ----------------------
INTERNATIONAL STANDARD ISO/IEC 18009:1999(E)
Information technology — Programming languages — Ada:
Conformity assessment of a language processor
1 Scope
1.1 This International Standard establishes requirements for certifying an assessment that an Ada language
processor conforms to the requirements of the Ada language standard, ISO/IEC 8652. It places requirements
on the organization that performs the assessment, the assessment procedures, and the test suite used in the
assessment. Finally, it places requirements on the form for the certificate of conformity.
1.2 This International Standard concerns only the assessment of conformity to the language requirements of
ISO/IEC 8652. It does not concern the assessment of any other characteristics of a language processor or of the
construction process used by the manufacturer of the language processor.
NOTE In the sense of [ISO/IEC Guide 23], the Ada language standard, ISO/IEC 8652, is to be regarded as a standard for
a specific property rather than a comprehensive product standard.
1.3 This International Standard is intended to be primarily suitable for use by a third party authority although
portions of it may also be applied by a supplier (first party) or by a user or purchaser (second party).
1.4 An Ada language processor may be claimed to conform to the requirements of ISO/IEC 8652 regardless of
the application of this International Standard.This International Standard prescribes the method for obtaining a
certification that an Ada language processor conforms to ISO/IEC 8652. Customers desiring to acquire a
language processor certified as conforming should explicitly require that certification by citing this International
Standard.
1.5 Certification should not be construed as guaranteeing that the certified product is free of non-conformities or
defects; it only certifies that no evidence of non-conformity was found during the certification process.
2 Conformity
2.1 An Ada language processor is said to be “certified as conforming” if so assessed by an Ada Conformity
Assessment Laboratory (ACAL) and the Ada Conformity Assessment Authority (ACAA). In performing this
certification,the ACAL and the ACAA shall consider the results of testing performed by the ACAL.The ACAL
testing shall be performed in accordance with the Ada Conformity Assessment Procedure (ACAP)using the
Ada Conformity Assessment Test Suite (ACATS).
2.2 This International Standard places requirements upon the ACAL, ACAA, ACAP and ACATS.
NOTES
1 Conformity of an “implementation” of the Ada language standard is defined by subclause 1.1.3 of ISO/IEC 8652.
The term “language processor” or “compiler” in this International Standard is to be regarded as synonymous with the term
“implementation” as used in ISO/IEC 8652. This International Standard prescribes requirements for the assessment that a
language processor conforms to the requirements of ISO/IEC 8652.
2An International Standard on test methods, such as this one, does not imply any obligation to carry out any kind
of test. It merely states the method by which the assessment, if required and referred to (for example, in the same or another
standard,orina regulation, or in contract documents), should be carried out. [ISO/IEC Directives, Part 2, subclause 6.5]
© ISO/IEC 1999 – All rights reserved 1
---------------------- Page: 8 ----------------------
ISO/IEC 18009:1999(E)
3 Normative reference
The following normative documents contain provisions which, through reference in this text, constitute
provisions of this International Standard. For dated references, subsequent amendments to, or revisions of, any
of these publications do not apply. However, parties to agreements based on this International Standard are
encouraged to investigate the possibility of applying the most recent editions of the normative documents
indicated below. For undated references, the latest edition of the normative document referred to applies.
Members of ISO and IEC maintain registers of currently valid International Standards.
ISO/IEC 8652, Information technology — Programming languages — Ada.
4 Terms and definitions
For the purposes of this International Standard, the following terms and definitions apply.
4.1 Standardization
4.1.1
consensus
general agreement, characterized by the absence of sustained opposition to substantial issues by any important part
of the concerned interests and by a process that involves seeking to take into account the views of all parties
concerned and to reconcile any conflicting arguments
NOTE Consensus need not imply unanimity.
[ISO/IEC Guide 2, 1.7]
4.2 Aims of standardization
4.2.1
fitness for purpose
ability of a product, process or service to serve a defined purpose under specific conditions [ISO/IEC Guide 2, 2.1]
4.3 Normative documents
4.3.1
document
any medium with information recorded on or in it [ISO/IEC Guide 2, 3.1]
4.3.2
normative document
document that provides rules, guidelines or characteristics for activities or their results
NOTES
1Theterm“normative document” is a generic term that covers such documents as standards, technical
specifications, codes of practice and regulations.
2 The terms for different kinds of normative documents are defined considering the document and its content as a
single entity.
[ISO/IEC Guide 2, 3.1]
4.3.3
standard
document, established by consensus and approved by a recognized body, that provides, for common and
repeated use, rules, guidelines or characteristics for activities or their results, aimed at the achievement of the
optimum degree of order in a given context [ISO/IEC Guide 2, 3.2]
2 © ISO/IEC 1999 – All rights reserved
---------------------- Page: 9 ----------------------
ISO/IEC 18009:1999(E)
4.3.4
International Standard
standard that is adopted by an international standardizing/standards organization and made available to the
public [ISO/IEC Guide 2, 3.2.1.1]
4.3.5
technical specification
document that prescribes technical requirements to be fulfilled by a product, process or service
NOTES
1A technical specification would indicate, whenever appropriate, the procedure(s) by means of which it may be
determined whether the requirements given are fulfilled.
2A technical specification may be a standard,apartofa standard or independent of a standard.
[ISO/IEC Guide 2, 3.4]
4.3.6
regulation
document providing binding legislative rules, that is adopted by an authority [ISO/IEC Guide 2, 3.6]
4.4 Bodies responsible for standards and regulations
4.4.1
body
legal or administrative entity that has specific tasks and composition
NOTE Examples of bodies are organizations, authorities, companies and foundations.
[ISO/IEC Guide 2, 4.1]
4.4.2
organization
body that is based on the membership of other bodies or individuals and has an established constitution and its
own administration [ISO/IEC Guide 2, 4.2]
4.4.3
international standardizing organization
standardizing organization whose membership is open to the relevant national body from every country [ISO/IEC
Guide 2, 4.3.2]
4.4.4
authority
body that has legal powers and rights
NOTE An authority can be regional, national or local.
[ISO/IEC Guide 2, 4.5]
4.5 Type of standards
4.5.1
testing standard
standard that is concerned with test methods, sometimes supplemented with other provisions related to testing,
such as sampling, use of statistical methods, sequence of tests [ISO/IEC Guide 2, 5.3]
© ISO/IEC 1999 – All rights reserved 3
---------------------- Page: 10 ----------------------
ISO/IEC 18009:1999(E)
4.5.2
product standard
standard that specifies requirements to be fulfilled by a product or a group of products, to establish its fitness for
purpose [ISO/IEC Guide 2, 5.4]
4.6 Content of normative documents
4.6.1
provision
expression in the content of a normative document, that takes the form of a statement,an instruction,a
recommendation or a requirement
NOTE These types of provision are distinguished by the form of wording they employ; e.g. instructions are expressed in
the imperative mood, recommendations by the use of the auxiliary “should” and requirements by the use of the auxiliary
“shall.”
[ISO/IEC Guide 2, 7.1]
4.6.2
statement
provision that conveys information [ISO/IEC Guide 2, 7.2]
4.6.3
instruction
provision that conveys an action to be performed [ISO/IEC Guide 2, 7.3]
4.6.4
recommendation
provision that conveys advice or guidance [ISO/IEC Guide 2, 7.4]
4.6.5
requirement
provision that conveys criteria to be fulfilled [ISO/IEC Guide 2, 7.5]
4.6.6
exclusive requirement
requirement of a normative document that must necessarily be fulfilled in order to comply with that document
NOTE The term “mandatory requirement” should be used to mean only a requirement made compulsory by law or
regulation.
[ISO/IEC Guide 2, 7.5.1]
4.6.7
optional requirement
requirement of a normative document that must be fulfilled in order to comply with a particular option permitted by
that document
NOTE An optional requirement may be either
(a) one of two or more alternative requirements;or
(b) an additional requirement that must be fulfilled only if applicable and that may otherwise be disregarded.
[ISO/IEC Guide 2, 7.5.2]
4.6.8
deemed-to-satisfy provision
provision that indicates one or more means of compliance with a requirement of a normative document [ISO/IEC
Guide 2, 7.6]
4 © ISO/IEC 1999 – All rights reserved
---------------------- Page: 11 ----------------------
ISO/IEC 18009:1999(E)
4.6.9
descriptive provision
provision for fitness for purpose that concerns the characteristics of a product, process or service
NOTE A descriptive provision usually conveys design, constructional details, etc. with dimensions and material
composition.
[ISO/IEC Guide 2, 7.7]
4.7 Conformity assessment in general
4.7.1
conformity
fulfillment by a product, process or service of specified requirements [ISO/IEC Guide 2, 12.1]
4.7.2
conformity assessment
any activity concerned with determining directly or indirectly that relevant requirements are fulfilled
NOTE Typical examples of conformity assessment activities are sampling, testing and inspection; evaluation,
verification and assurance of conformity (supplier’s declaration, certification); registration, accreditation and approval
as well as their combinations.
[ISO/IEC Guide 2, 12.2; ISO/IEC Guide 7, 3.1]
4.7.3
conformity assessment body
body that conducts conformity assessment [ISO/IEC Guide 2, 12.3]
4.7.4
conformity assessment system
system that has its own rules of procedure and management for carrying out conformity assessment
NOTES
1 Conformity assessment systems may be operated at, for example, national, regional or international level.
2 Typical examples of conformity assessment systems are testing systems, inspection systems, and certification
systems.
[ISO/IEC Guide 2, 12.4]
4.7.5
conformity assessment scheme
conformity assessment system as related to specified products, processes or services to which the same
particular standards and rules, and the same procedure, apply
NOTE The term “program” is used in some countries to cover the same concept as “scheme.”
[ISO/IEC Guide 2, 12.5]
4.7.6
access to a conformity assessment system
opportunity for an applicant to obtain conformity assessment under the rules of the system [ISO/IEC Guide 2,
12.6]
4.7.7
participant in a conformity assessment system
conformity assessment body that operates under the rules of the system without having the opportunity to take
part in the management of the system [ISO/IEC Guide 2, 12.7]
© ISO/IEC 1999 – All rights reserved 5
---------------------- Page: 12 ----------------------
ISO/IEC 18009:1999(E)
4.7.8
member of a conformity assessment system
conformity assessment body that operates under the rules of the system and has the opportunity to take part in
the management of the system [ISO/IEC Guide 2, 12.8]
4.7.9
third party
person or body that is recognized as being independent of the parties involved, as concerns the issue in question
NOTE Parties involved are usually supplier (“first party”) and purchaser (“second party”) interests.
[ISO/IEC Guide 2, 12.9]
4.7.10
registration
procedure by which a body indicates relevant characteristics of a product, process or service, or particulars of a
body or person, in an appropriate, publicly available list [ISO/IEC Guide 2, 12.10]
4.7.11
accreditation
procedure by which an authoritative body gives formal recognition that a body or person is competent to carry out
specific tasks [ISO/IEC Guide 2, 12.11]
4.7.12
reciprocity
bilateral relationship where both parties have the same rights and obligations towards each other [ISO/IEC Guide 2,
12.12]
4.7.13
equal treatment
treatment accorded to products, processes or services originating in other countries that is no less favorable than
that accorded to like products, processes or services of national origin, in a comparable situation [ISO/IEC Guide 2,
12.13]
4.8 Determination of characteristics
4.8.1
test
technical operation that consists of the determination of one or more characteristics of a given product, process or
service according to a specified procedure [ISO/IEC Guide 2, 13.1]
4.8.2
testing
action of carrying out one or more tests [ISO/IEC Guide 2, 13.1.1]
4.8.3
test method
specified technical procedure for performing a test [ISO/IEC Guide 2, 13.2]
4.8.4
test report
document that presents test results and other information relevant to a test [ISO/IEC Guide 2, 13.3]
4.8.5
laboratory
body that calibrates and/or tests [ISO/IEC Guide 25, 3.1]
4.8.6
testing laboratory
laboratory that performs tests
6 © ISO/IEC 1999 – All rights reserved
---------------------- Page: 13 ----------------------
ISO/IEC 18009:1999(E)
NOTE The term “testing laboratory” can be used in the sense of a legal entity, a technical entity or both.
[ISO/IEC Guide 2, 13.4]
4.9 Conformity evaluation
4.9.1
conformity evaluation
systematic examination of the extent to which a product, process or service fulfills specified requirements [ISO/IEC
Guide 2, 14.1]
4.9.2
inspection
confor
...
Questions, Comments and Discussion
Ask us and Technical Secretary will try to provide an answer. You can facilitate discussion about the standard in here.