ISO 22137:2020
(Main)Space systems — Program management — Test reviews
Space systems — Program management — Test reviews
This document defines procedures, contents and requirements for test reviews which are composed of the Test Readiness Review (TRR), Post Test Review (PTR) and Test Review Board (TRB). This document is applicable to tests of space systems and space products, including environment tests and functional and performance tests, especially for system level tests and complicated tests.
Systèmes spatiaux — Management de programme — Revue d'essais
General Information
Standards Content (Sample)
INTERNATIONAL ISO
STANDARD 22137
First edition
2020-02
Space systems — Program
management — Test reviews
Systèmes spatiaux — Management de programme — Revue d'essais
Reference number
ISO 22137:2020(E)
©
ISO 2020
---------------------- Page: 1 ----------------------
ISO 22137:2020(E)
COPYRIGHT PROTECTED DOCUMENT
© ISO 2020
All rights reserved. Unless otherwise specified, or required in the context of its implementation, no part of this publication may
be reproduced or utilized otherwise in any form or by any means, electronic or mechanical, including photocopying, or posting
on the internet or an intranet, without prior written permission. Permission can be requested from either ISO at the address
below or ISO’s member body in the country of the requester.
ISO copyright office
CP 401 • Ch. de Blandonnet 8
CH-1214 Vernier, Geneva
Phone: +41 22 749 01 11
Fax: +41 22 749 09 47
Email: copyright@iso.org
Website: www.iso.org
Published in Switzerland
ii © ISO 2020 – All rights reserved
---------------------- Page: 2 ----------------------
ISO 22137:2020(E)
Contents Page
Foreword .v
Introduction .vi
1 Scope . 1
2 Normative references . 1
3 Terms, definitions and abbreviated terms . 1
3.1 Terms and definitions . 1
3.2 Abbreviated terms . 2
4 Management requirements for test reviews . 2
4.1 Purpose of test reviews . 2
4.2 Test reviews point . 3
4.3 Organization of test reviews. 3
4.4 Documentation of test reviews . 4
5 Process for test reviews. 4
5.1 Test review procedures . 4
5.2 Process for a TRR . 6
5.2.1 Overview . 6
5.2.2 Initiate process of TRR . 6
5.2.3 On-site review process of TRR . 6
5.2.4 Implement review process of TRR . 6
5.2.5 Conclude process of TRR . 6
5.3 Process for PTR. 6
5.3.1 Overview . 6
5.3.2 Initiate process of PTR . 7
5.3.3 Implement review process of PTR . 7
5.3.4 Conclude process of PTR . . 7
5.4 Process for TRB . 7
5.4.1 Overview . 7
5.4.2 Initiate process of TRB. 8
5.4.3 Implement review process of TRB . 8
5.4.4 Conclude process of TRB . 8
6 Content of test reviews . 8
6.1 Content of TRR . 8
6.1.1 Overview . 8
6.1.2 Test documentation . 9
6.1.3 Configuration of item under test . 9
6.1.4 Test configuration .10
6.1.5 Inspection status of the KIP, the MIP .10
6.1.6 Test facility, environmental conditions, test instrumentation .10
6.1.7 Cleanliness conditions, hazards and safety .11
6.1.8 Ground Support Equipment .11
6.1.9 Status of test software .11
6.1.10 Status of non-conformance .11
6.1.11 Status of waivers and deviations .11
6.1.12 Engineering change status .11
6.1.13 Personnel qualification .11
6.1.14 Test procedure status .11
6.1.15 Test pass/fail criteria completeness .11
6.1.16 Assignment of responsibilities .12
6.1.17 Test schedule .12
6.1.18 Risk identification and control measures . .12
6.2 Content of Post Test Review .12
6.2.1 Overview .12
© ISO 2020 – All rights reserved iii
---------------------- Page: 3 ----------------------
ISO 22137:2020(E)
6.2.2 Test data .12
6.2.3 Test anomalies and Non-Conformance Reports .12
6.2.4 Test performance . .12
6.2.5 Status of the item under test .12
6.2.6 Ground Support Equipment status .12
6.2.7 Item under test configuration.13
6.2.8 Open points .13
6.3 Content of Test Review Board .13
6.3.1 Overview .13
6.3.2 Test documentation .13
6.3.3 Test performance . .13
6.3.4 Test results .13
6.3.5 Status of the item under test .13
6.3.6 Open Non-Conformance Reports .14
6.3.7 Lessons to be drawn .14
7 Implement requirements for test reviews .14
Annex A (informative) An example of a test readiness checklist .15
Annex B (informative) TRR report plan .19
Bibliography .20
iv © ISO 2020 – All rights reserved
---------------------- Page: 4 ----------------------
ISO 22137:2020(E)
Foreword
ISO (the International Organization for Standardization) is a worldwide federation of national standards
bodies (ISO member bodies). The work of preparing International Standards is normally carried out
through ISO technical committees. Each member body interested in a subject for which a technical
committee has been established has the right to be represented on that committee. International
organizations, governmental and non-governmental, in liaison with ISO, also take part in the work.
ISO collaborates closely with the International Electrotechnical Commission (IEC) on all matters of
electrotechnical standardization.
The procedures used to develop this document and those intended for its further maintenance are
described in the ISO/IEC Directives, Part 1. In particular, the different approval criteria needed for the
different types of ISO documents should be noted. This document was drafted in accordance with the
editorial rules of the ISO/IEC Directives, Part 2 (see www .iso .org/ directives).
Attention is drawn to the possibility that some of the elements of this document may be the subject of
patent rights. ISO shall not be held responsible for identifying any or all such patent rights. Details of
any patent rights identified during the development of the document will be in the Introduction and/or
on the ISO list of patent declarations received (see www .iso .org/ patents).
Any trade name used in this document is information given for the convenience of users and does not
constitute an endorsement.
For an explanation of the voluntary nature of standards, the meaning of ISO specific terms and
expressions related to conformity assessment, as well as information about ISO's adherence to the
World Trade Organization (WTO) principles in the Technical Barriers to Trade (TBT) see www .iso .org/
iso/ foreword .html.
This document was prepared by Technical Committee ISO/TC 20, Aircraft and space vehicles,
Subcommittee SC 14, Space systems and operations.
Any feedback or questions on this document should be directed to the user’s national standards body. A
complete listing of these bodies can be found at www .iso .org/ members .html.
© ISO 2020 – All rights reserved v
---------------------- Page: 5 ----------------------
ISO 22137:2020(E)
Introduction
Space products are complicated, but need to work reliably in space. Tests on the ground which simulate
the space environment are complicated as well, but help to confirm the readiness status of equipment.
Evaluation after testing confirms the effectiveness of test data and is very important to ensure the
achievement of test objectives. Test reviews are effective management tools to ensure the test is
successful on the first attempt, and these are composed of three types of reviews:
— Test Readiness Review (TRR);
— Post Test Review (PTR);
— Test Review Board (TRB).
TRRs, PTRs and TRBs are necessary especially for system tests and complicated tests. Sometimes, the
PTR and TRB can be combined, and TRRs for several tests can also be combined.
This document provides the requirements for organizing and performing test reviews which include
management for test reviews, processes for test reviews, content of test reviews, and implementation
for test reviews. In addition, this document provides common set requirements for test reviews which
will encourage international space co-operation and reduce the costs of planning and performing test
reviews.
vi © ISO 2020 – All rights reserved
---------------------- Page: 6 ----------------------
INTERNATIONAL STANDARD ISO 22137:2020(E)
Space systems — Program management — Test reviews
1 Scope
This document defines procedures, contents and requirements for test reviews which are composed of
the Test Readiness Review (TRR), Post Test Review (PTR) and Test Review Board (TRB).
This document is applicable to tests of space systems and space products, including environment tests
and functional and performance tests, especially for system level tests and complicated tests.
2 Normative references
The following documents are referred to in the text in such a way that some or all of their content
constitutes requirements of this document. For dated references, only the edition cited applies. For
undated references, the latest edition of the referenced document (including any amendments) applies.
ISO 10795, Space systems — Programme management and quality — Vocabulary
3 Terms, definitions and abbreviated terms
3.1 Terms and definitions
For the purposes of this document, the terms and definitions given in ISO 10795 and the following apply.
ISO and IEC maintain terminological databases for use in standardization at the following addresses:
— ISO Online browsing platform: available at https:// www .iso .org/ obp
— IEC Electropedia: available at http:// www .electropedia .org/
3.1.1
milestone
designated project status that indicates the amount of progress made toward project completion, or
that should be achieved before the project proceeds to a new phase
[SOURCE: ISO 21349:2007, 3.2]
3.1.2
milestone criteria
observable facts that indicate a milestone has been reached
[SOURCE: ISO 21349:2007, 3.3]
3.1.3
review board
body, organized into sub-entities, as necessary, consisting of a chairperson or delegated person and
members, charged with evaluating the evidence of project status, along with identifying issues and
necessary corrective actions, to determine that the objectives and success criteria of a review milestone
have been met
Note 1 to entry: The purpose of the review board is to prepare an objective evaluation of the project status.
Achievement of an objective evaluation is aided by use of independent experts who have no prior association
with the project and no personal conflict of interest with respect to the outcome of the review.
© ISO 2020 – All rights reserved 1
---------------------- Page: 7 ----------------------
ISO 22137:2020(E)
[SOURCE: ISO 21349:2007, 3.8, modified — duplication of "review board" within definition has been
removed]
3.1.4
review policy
policy that provides either requirements or guidance (or both) for the overall conduct of the review
[SOURCE: ISO 21349:2007, 3.11]
3.1.5
test block
aggregation of several tests grouped by discipline
Note 1 to entry: Typical test blocks for space segment elements are (not all):
— integration;
— leak pressure;
— EMC conducted;
— thermal;
— functional and performance test.
3.2 Abbreviated terms
AIT Assembly, Integration and Test
AITP Assembly, Integration and Test Plan
EMC Electromagnetic Compatibility
EGSE Electrical Ground Support Equipment
GSE Ground Support Equipment
KIP Key Inspection Point
MGSE Mechanical Ground Support Equipment
MIP Mandatory Inspection Point
NCR Non-conformance Report
PTR Post Test Review
TRB Test Review Board
TRR Test Readiness Review
4 Management requirements for test reviews
4.1 Purpose of test reviews
Test reviews are a series of formal reviews to determine the suitability, adequacy and effectiveness of
test readiness, test procedures and test results as the milestone of starting the test or declaring the test
completed formally.
2 © ISO 2020 – All rights reserved
---------------------- Page: 8 ----------------------
ISO 22137:2020(E)
Test reviews shall conclude the following formal reviews:
a) Test Readiness Review (TRR): Before the start of test activity, a TRR shall be held to verify that all
conditions allow the test to proceed.
b) Post-Test Review (PTR): A PTR shall be held in order to formally declare the test completed and
allow the release of the item under test and test facility for further activities.
c) Test Review Board (TRB): A TRB shall be held to review all results and conclude on test
completeness and achievement of objectives.
The purpose of test reviews is to implement effective test management for the project. TRR, PTR
and TRB can ensure that execution of the test programme and delivery of the test results meet the
requirements of the customer and the project.
4.2 Test reviews point
Test reviews start at the end of the production phase and are implemented at the stage of AIT.
Completeness of the TRR is the milestone of the start-up test, and completeness of the PTR and TRB are
the milestones of the concluding test.
4.3 Organization of test reviews
Test reviews are organized by the supplier. According to programme management requirements,
customers should participate in some test review meetings.
a) The following parties shall participate or check the implementation process of TRR and confirm its
results:
1) the chairperson, who is the product assurance manager of the authority responsible for the test;
2) product assurances from all involved parties;
3) project engineers from all involved parties;
4) test director;
5) AIT representatives from all involved parties;
6) specialists, when necessary from all involved parties;
7) facility representatives;
8) others as relevant.
b) The following parties shall participate or check the implementation process of PTR and confirm its
results:
1) the chairperson, who is the test director;
2) project engineers;
3) AIT representatives;
4) facility representatives;
5) others, including specialists, as relevant.
c) The following parties shall participate or check the implementation process of TRB and confirm its
results:
1) the chairperson, who is the director of the authority responsible for project technology;
© ISO 2020 – All rights reserved 3
---------------------- Page: 9 ----------------------
ISO 22137:2020(E)
2) project engineers;
3) AIT representatives;
4) facility representatives;
5) others, include specialists, as relevant.
4.4 Documentation of test reviews
Before the test review, the supplier shall develop and prepare test review documents according to
customer requirements.
Prior to the TRR, the supplier should develop a test readiness checklist and/or a TRR report, and
should prepare relevant documents used to implement tests according to 6.1.2. For system level tests
and large-scale tests, a TRR report is needed, such as for the EMC tests of spacecraft. However, a TRR
checklist can replace a TRR report for subsystem tests and a product level test. Annex A provides an
example of a test readiness checklist. Annex B provides example contents of a TRR report. Prior to the
PTR, the supplier should prepare test data according to customer requirements. Prior to the TRB, the
supplier should develop a test report according to ISO 17566.
5 Process for test reviews
5.1 Test review procedures
A TRR shall be implemented before a test. When the test is completed, a PTR shall be implemented,
following which, based on the summary of the test activity, a TRB shall be implemented. For the
procedures of a test review see Figure 1.
a) The process of a TRR should comprise 4 steps:
1) Step 1: "initiate process" of the TRR;
2) Step 2: "check process" of the TRR on the spot;
3) Step 3: implement a "review process" of the TRR;
4) Step 4: "conclude process" of the TRR.
b) The process of a PTR should comprise 3 steps:
1) Step 1: "initiate process" of the PTR;
2) Step 2: implement a "review process" of the PTR;
3) Step 3: "conclude process" of the PTR.
c) The process of a TRB should comprise 3 steps:
1) Step 1: "initiate process" of the TRB;
2) Step 2: implement a "review process" of the TRB;
3) Step 3: "conclude process" of the TRB.
4 © ISO 2020 – All rights reserved
---------------------- Page: 10 ----------------------
ISO 22137:2020(E)
Figure 1 — Procedures for a test review
© ISO 2020 – All rights reserved 5
---------------------- Page: 11 ----------------------
ISO 22137:2020(E)
5.2 Process for a TRR
5.2.1 Overview
A TRR activity is performed to check, verify and review all the conditions including the test item, test
facility, test procedures, test risks control and so on. In the initiate process, preparation of documents,
review board, and milestone criteria shall be completed. In the on-site review process, the item under
test, documents used in the test, test facility, and other test conditions shall be checked one by one,
organized by the supplier. In the review implementation process, a TRR report shall be completed and
reviewed. In the concluding review process, the conclusion of whether to proceed with the test or not
shall be provided.
5.2.2 Initiate process of TRR
The initiate process of TRR is performed to complete the precondition for the review, including the
establishment of the organization, the requirements of the review and the milestone criteria. Activities
implemented in the initiate process of the TRR are as follows:
a) Establish a review board for the TRR which should contain the participants specified in 4.3 and a
project representative from customers.
b) Select the TRR board chairperson.
c) Determine the review policy for the TRR that should contain the style and format of review
documents, the scope of distribution of the TRR meeting minutes, when and how the TRR is
implemented, and how to address the disagreement about items in the TRR between the supplier
and customers.
d) Determine the review items included in the TRR activity.
e) Develop the milestone criteria for the TRR. The criteria can be specified where all the conditions
are ready for test and risks are identified and controlled.
5.2.3 On-site review process of TRR
Prepare a test readiness checklist according to the test requirements and review items of the TRR. The
test director should organize the implementation of the test readiness check on-site and complete the
test readiness checklist.
NOTE The on-site review is the check to confirm the spacecraft configuration and test configuration.
5.2.4 Implement review process of TRR
A TRR report should be developed by the director of the test based on the results of the test readiness
check on the spot. A review meeting can be held to assess the items included in the TRR report which is
attended by the TRR board.
5.2.5 Conclude process of TRR
A conclusion on whether a test can be started or not should be released based on the result of the TRR
meeting and TRR milestone criteria. All the open actions are recorded and logged with a deadline. The
TRR meeting minutes are distributed.
5.3 Process for PTR
5.3.1 Overview
A PTR activity is performed to evaluate the test data for completeness. In the initiate process, the
preparation of test data and a check of the item under test and the test facility shall be completed. In the
6 © ISO 2020 – All rights reserved
---------------------- Page: 12 ----------------------
ISO 22137:2020(E)
process of the implementation review, the execution of the test for effectiveness and the test data for
completeness shall be reviewed. In the process of concluding review, a conclusion of whether the test
should be completed or not should be provided.
5.3.2 Initiate process of PTR
The initiate process of the PTR is performed to complete the precondition for review, including the
establishment of the organization, the requirements of the review and the milestone criteria. Activities
implemented in the initiate process of the PTR are as follows:
a) When the abnormity of test data or the curve of test data appears, the PTR meeting is necessary.
Otherwise, the PTR can be implemented as the confirming process of test data and the test item.
For the PTR meeting, the following activities are needed:
— Establish a review board and select the PTR board chairperson for the PTR which should
contain the participants specified in 4.3 and a project representative from customers or the
TRR review board.
— Determine the review policy for the PTR that should contain the scope of distribution of the PTR
meeting minutes, when and how the PTR is implemented, and how to addre
...
Questions, Comments and Discussion
Ask us and Technical Secretary will try to provide an answer. You can facilitate discussion about the standard in here.