Space systems -- Program management -- Test reviews

This document defines procedures, contents and requirements for test reviews which are composed of the Test Readiness Review (TRR), Post Test Review (PTR) and Test Review Board (TRB). This document is applicable to tests of space systems and space products, including environment tests and functional and performance tests, especially for system level tests and complicated tests.

Systèmes spatiaux -- Management de programme -- Revue d'essais

General Information

Status
Published
Publication Date
25-Feb-2020
Current Stage
6060 - International Standard published
Start Date
23-Jan-2020
Completion Date
26-Feb-2020
Ref Project

Buy Standard

Standard
ISO 22137:2020 - Space systems -- Program management -- Test reviews
English language
20 pages
sale 15% off
Preview
sale 15% off
Preview

Standards Content (sample)

INTERNATIONAL ISO
STANDARD 22137
First edition
2020-02
Space systems — Program
management — Test reviews
Systèmes spatiaux — Management de programme — Revue d'essais
Reference number
ISO 22137:2020(E)
ISO 2020
---------------------- Page: 1 ----------------------
ISO 22137:2020(E)
COPYRIGHT PROTECTED DOCUMENT
© ISO 2020

All rights reserved. Unless otherwise specified, or required in the context of its implementation, no part of this publication may

be reproduced or utilized otherwise in any form or by any means, electronic or mechanical, including photocopying, or posting

on the internet or an intranet, without prior written permission. Permission can be requested from either ISO at the address

below or ISO’s member body in the country of the requester.
ISO copyright office
CP 401 • Ch. de Blandonnet 8
CH-1214 Vernier, Geneva
Phone: +41 22 749 01 11
Fax: +41 22 749 09 47
Email: copyright@iso.org
Website: www.iso.org
Published in Switzerland
ii © ISO 2020 – All rights reserved
---------------------- Page: 2 ----------------------
ISO 22137:2020(E)
Contents Page

Foreword ..........................................................................................................................................................................................................................................v

Introduction ................................................................................................................................................................................................................................vi

1 Scope ................................................................................................................................................................................................................................. 1

2 Normative references ...................................................................................................................................................................................... 1

3 Terms, definitions and abbreviated terms ................................................................................................................................ 1

3.1 Terms and definitions ....................................................................................................................................................................... 1

3.2 Abbreviated terms ............................................................................................................................................................................... 2

4 Management requirements for test reviews ........................................................................................................................... 2

4.1 Purpose of test reviews ................................................................................................................................................................... 2

4.2 Test reviews point ................................................................................................................................................................................ 3

4.3 Organization of test reviews........................................................................................................................................................ 3

4.4 Documentation of test reviews ................................................................................................................................................. 4

5 Process for test reviews................................................................................................................................................................................. 4

5.1 Test review procedures ................................................................................................................................................................... 4

5.2 Process for a TRR .................................................................................................................................................................................. 6

5.2.1 Overview ................................................................................................................................................................................. 6

5.2.2 Initiate process of TRR ............................................................................................................................................... 6

5.2.3 On-site review process of TRR ............................................................................................................................. 6

5.2.4 Implement review process of TRR ................................................................................................................... 6

5.2.5 Conclude process of TRR .......................................................................................................................................... 6

5.3 Process for PTR....................................................................................................................................................................................... 6

5.3.1 Overview ................................................................................................................................................................................. 6

5.3.2 Initiate process of PTR ................................................................................................................................................ 7

5.3.3 Implement review process of PTR ................................................................................................................... 7

5.3.4 Conclude process of PTR .................. ......................................................................................................................... 7

5.4 Process for TRB ...................................................................................................................................................................................... 7

5.4.1 Overview ................................................................................................................................................................................. 7

5.4.2 Initiate process of TRB................................................................................................................................................ 8

5.4.3 Implement review process of TRB ................................................................................................................... 8

5.4.4 Conclude process of TRB .......................................................................................................................................... 8

6 Content of test reviews ................................................................................................................................................................................... 8

6.1 Content of TRR ........................................................................................................................................................................................ 8

6.1.1 Overview ................................................................................................................................................................................. 8

6.1.2 Test documentation ....................................................................................................................................................... 9

6.1.3 Configuration of item under test ........................................................................................................................ 9

6.1.4 Test configuration ........................................................................................................................................................10

6.1.5 Inspection status of the KIP, the MIP ...........................................................................................................10

6.1.6 Test facility, environmental conditions, test instrumentation ...............................................10

6.1.7 Cleanliness conditions, hazards and safety ...........................................................................................11

6.1.8 Ground Support Equipment ................................................................................................................................11

6.1.9 Status of test software ..............................................................................................................................................11

6.1.10 Status of non-conformance ..................................................................................................................................11

6.1.11 Status of waivers and deviations ....................................................................................................................11

6.1.12 Engineering change status ...................................................................................................................................11

6.1.13 Personnel qualification ...........................................................................................................................................11

6.1.14 Test procedure status ...............................................................................................................................................11

6.1.15 Test pass/fail criteria completeness ............................................................................................................11

6.1.16 Assignment of responsibilities .........................................................................................................................12

6.1.17 Test schedule ....................................................................................................................................................................12

6.1.18 Risk identification and control measures .................. ..............................................................................12

6.2 Content of Post Test Review .....................................................................................................................................................12

6.2.1 Overview ..............................................................................................................................................................................12

© ISO 2020 – All rights reserved iii
---------------------- Page: 3 ----------------------
ISO 22137:2020(E)

6.2.2 Test data ...............................................................................................................................................................................12

6.2.3 Test anomalies and Non-Conformance Reports ................................................................................12

6.2.4 Test performance ...................................................................... ....................................................................................12

6.2.5 Status of the item under test ..............................................................................................................................12

6.2.6 Ground Support Equipment status ...............................................................................................................12

6.2.7 Item under test configuration............................................................................................................................13

6.2.8 Open points .......................................................................................................................................................................13

6.3 Content of Test Review Board .................................................................................................................................................13

6.3.1 Overview ..............................................................................................................................................................................13

6.3.2 Test documentation ....................................................................................................................................................13

6.3.3 Test performance ...................................................................... ....................................................................................13

6.3.4 Test results .........................................................................................................................................................................13

6.3.5 Status of the item under test ..............................................................................................................................13

6.3.6 Open Non-Conformance Reports ....................................................................................................................14

6.3.7 Lessons to be drawn ..................................................................................................................................................14

7 Implement requirements for test reviews ..............................................................................................................................14

Annex A (informative) An example of a test readiness checklist .........................................................................................15

Annex B (informative) TRR report plan .........................................................................................................................................................19

Bibliography .............................................................................................................................................................................................................................20

iv © ISO 2020 – All rights reserved
---------------------- Page: 4 ----------------------
ISO 22137:2020(E)
Foreword

ISO (the International Organization for Standardization) is a worldwide federation of national standards

bodies (ISO member bodies). The work of preparing International Standards is normally carried out

through ISO technical committees. Each member body interested in a subject for which a technical

committee has been established has the right to be represented on that committee. International

organizations, governmental and non-governmental, in liaison with ISO, also take part in the work.

ISO collaborates closely with the International Electrotechnical Commission (IEC) on all matters of

electrotechnical standardization.

The procedures used to develop this document and those intended for its further maintenance are

described in the ISO/IEC Directives, Part 1. In particular, the different approval criteria needed for the

different types of ISO documents should be noted. This document was drafted in accordance with the

editorial rules of the ISO/IEC Directives, Part 2 (see www .iso .org/ directives).

Attention is drawn to the possibility that some of the elements of this document may be the subject of

patent rights. ISO shall not be held responsible for identifying any or all such patent rights. Details of

any patent rights identified during the development of the document will be in the Introduction and/or

on the ISO list of patent declarations received (see www .iso .org/ patents).

Any trade name used in this document is information given for the convenience of users and does not

constitute an endorsement.

For an explanation of the voluntary nature of standards, the meaning of ISO specific terms and

expressions related to conformity assessment, as well as information about ISO's adherence to the

World Trade Organization (WTO) principles in the Technical Barriers to Trade (TBT) see www .iso .org/

iso/ foreword .html.

This document was prepared by Technical Committee ISO/TC 20, Aircraft and space vehicles,

Subcommittee SC 14, Space systems and operations.

Any feedback or questions on this document should be directed to the user’s national standards body. A

complete listing of these bodies can be found at www .iso .org/ members .html.
© ISO 2020 – All rights reserved v
---------------------- Page: 5 ----------------------
ISO 22137:2020(E)
Introduction

Space products are complicated, but need to work reliably in space. Tests on the ground which simulate

the space environment are complicated as well, but help to confirm the readiness status of equipment.

Evaluation after testing confirms the effectiveness of test data and is very important to ensure the

achievement of test objectives. Test reviews are effective management tools to ensure the test is

successful on the first attempt, and these are composed of three types of reviews:

— Test Readiness Review (TRR);
— Post Test Review (PTR);
— Test Review Board (TRB).

TRRs, PTRs and TRBs are necessary especially for system tests and complicated tests. Sometimes, the

PTR and TRB can be combined, and TRRs for several tests can also be combined.

This document provides the requirements for organizing and performing test reviews which include

management for test reviews, processes for test reviews, content of test reviews, and implementation

for test reviews. In addition, this document provides common set requirements for test reviews which

will encourage international space co-operation and reduce the costs of planning and performing test

reviews.
vi © ISO 2020 – All rights reserved
---------------------- Page: 6 ----------------------
INTERNATIONAL STANDARD ISO 22137:2020(E)
Space systems — Program management — Test reviews
1 Scope

This document defines procedures, contents and requirements for test reviews which are composed of

the Test Readiness Review (TRR), Post Test Review (PTR) and Test Review Board (TRB).

This document is applicable to tests of space systems and space products, including environment tests

and functional and performance tests, especially for system level tests and complicated tests.

2 Normative references

The following documents are referred to in the text in such a way that some or all of their content

constitutes requirements of this document. For dated references, only the edition cited applies. For

undated references, the latest edition of the referenced document (including any amendments) applies.

ISO 10795, Space systems — Programme management and quality — Vocabulary
3 Terms, definitions and abbreviated terms
3.1 Terms and definitions

For the purposes of this document, the terms and definitions given in ISO 10795 and the following apply.

ISO and IEC maintain terminological databases for use in standardization at the following addresses:

— ISO Online browsing platform: available at https:// www .iso .org/ obp
— IEC Electropedia: available at http:// www .electropedia .org/
3.1.1
milestone

designated project status that indicates the amount of progress made toward project completion, or

that should be achieved before the project proceeds to a new phase
[SOURCE: ISO 21349:2007, 3.2]
3.1.2
milestone criteria
observable facts that indicate a milestone has been reached
[SOURCE: ISO 21349:2007, 3.3]
3.1.3
review board

body, organized into sub-entities, as necessary, consisting of a chairperson or delegated person and

members, charged with evaluating the evidence of project status, along with identifying issues and

necessary corrective actions, to determine that the objectives and success criteria of a review milestone

have been met

Note 1 to entry: The purpose of the review board is to prepare an objective evaluation of the project status.

Achievement of an objective evaluation is aided by use of independent experts who have no prior association

with the project and no personal conflict of interest with respect to the outcome of the review.

© ISO 2020 – All rights reserved 1
---------------------- Page: 7 ----------------------
ISO 22137:2020(E)

[SOURCE: ISO 21349:2007, 3.8, modified — duplication of "review board" within definition has been

removed]
3.1.4
review policy

policy that provides either requirements or guidance (or both) for the overall conduct of the review

[SOURCE: ISO 21349:2007, 3.11]
3.1.5
test block
aggregation of several tests grouped by discipline
Note 1 to entry: Typical test blocks for space segment elements are (not all):
— integration;
— leak pressure;
— EMC conducted;
— thermal;
— functional and performance test.
3.2 Abbreviated terms
AIT Assembly, Integration and Test
AITP Assembly, Integration and Test Plan
EMC Electromagnetic Compatibility
EGSE Electrical Ground Support Equipment
GSE Ground Support Equipment
KIP Key Inspection Point
MGSE Mechanical Ground Support Equipment
MIP Mandatory Inspection Point
NCR Non-conformance Report
PTR Post Test Review
TRB Test Review Board
TRR Test Readiness Review
4 Management requirements for test reviews
4.1 Purpose of test reviews

Test reviews are a series of formal reviews to determine the suitability, adequacy and effectiveness of

test readiness, test procedures and test results as the milestone of starting the test or declaring the test

completed formally.
2 © ISO 2020 – All rights reserved
---------------------- Page: 8 ----------------------
ISO 22137:2020(E)
Test reviews shall conclude the following formal reviews:

a) Test Readiness Review (TRR): Before the start of test activity, a TRR shall be held to verify that all

conditions allow the test to proceed.

b) Post-Test Review (PTR): A PTR shall be held in order to formally declare the test completed and

allow the release of the item under test and test facility for further activities.

c) Test Review Board (TRB): A TRB shall be held to review all results and conclude on test

completeness and achievement of objectives.

The purpose of test reviews is to implement effective test management for the project. TRR, PTR

and TRB can ensure that execution of the test programme and delivery of the test results meet the

requirements of the customer and the project.
4.2 Test reviews point

Test reviews start at the end of the production phase and are implemented at the stage of AIT.

Completeness of the TRR is the milestone of the start-up test, and completeness of the PTR and TRB are

the milestones of the concluding test.
4.3 Organization of test reviews

Test reviews are organized by the supplier. According to programme management requirements,

customers should participate in some test review meetings.

a) The following parties shall participate or check the implementation process of TRR and confirm its

results:

1) the chairperson, who is the product assurance manager of the authority responsible for the test;

2) product assurances from all involved parties;
3) project engineers from all involved parties;
4) test director;
5) AIT representatives from all involved parties;
6) specialists, when necessary from all involved parties;
7) facility representatives;
8) others as relevant.

b) The following parties shall participate or check the implementation process of PTR and confirm its

results:
1) the chairperson, who is the test director;
2) project engineers;
3) AIT representatives;
4) facility representatives;
5) others, including specialists, as relevant.

c) The following parties shall participate or check the implementation process of TRB and confirm its

results:

1) the chairperson, who is the director of the authority responsible for project technology;

© ISO 2020 – All rights reserved 3
---------------------- Page: 9 ----------------------
ISO 22137:2020(E)
2) project engineers;
3) AIT representatives;
4) facility representatives;
5) others, include specialists, as relevant.
4.4 Documentation of test reviews

Before the test review, the supplier shall develop and prepare test review documents according to

customer requirements.

Prior to the TRR, the supplier should develop a test readiness checklist and/or a TRR report, and

should prepare relevant documents used to implement tests according to 6.1.2. For system level tests

and large-scale tests, a TRR report is needed, such as for the EMC tests of spacecraft. However, a TRR

checklist can replace a TRR report for subsystem tests and a product level test. Annex A provides an

example of a test readiness checklist. Annex B provides example contents of a TRR report. Prior to the

PTR, the supplier should prepare test data according to customer requirements. Prior to the TRB, the

supplier should develop a test report according to ISO 17566.
5 Process for test reviews
5.1 Test review procedures

A TRR shall be implemented before a test. When the test is completed, a PTR shall be implemented,

following which, based on the summary of the test activity, a TRB shall be implemented. For the

procedures of a test review see Figure 1.
a) The process of a TRR should comprise 4 steps:
1) Step 1: "initiate process" of the TRR;
2) Step 2: "check process" of the TRR on the spot;
3) Step 3: implement a "review process" of the TRR;
4) Step 4: "conclude process" of the TRR.
b) The process of a PTR should comprise 3 steps:
1) Step 1: "initiate process" of the PTR;
2) Step 2: implement a "review process" of the PTR;
3) Step 3: "conclude process" of the PTR.
c) The process of a TRB should comprise 3 steps:
1) Step 1: "initiate process" of the TRB;
2) Step 2: implement a "review process" of the TRB;
3) Step 3: "conclude process" of the TRB.
4 © ISO 2020 – All rights reserved
---------------------- Page: 10 ----------------------
ISO 22137:2020(E)
Figure 1 — Procedures for a test review
© ISO 2020 – All rights reserved 5
---------------------- Page: 11 ----------------------
ISO 22137:2020(E)
5.2 Process for a TRR
5.2.1 Overview

A TRR activity is performed to check, verify and review all the conditions including the test item, test

facility, test procedures, test risks control and so on. In the initiate process, preparation of documents,

review board, and milestone criteria shall be completed. In the on-site review process, the item under

test, documents used in the test, test facility, and other test conditions shall be checked one by one,

organized by the supplier. In the review implementation process, a TRR report shall be completed and

reviewed. In the concluding review process, the conclusion of whether to proceed with the test or not

shall be provided.
5.2.2 Initiate process of TRR

The initiate process of TRR is performed to complete the precondition for the review, including the

establishment of the organization, the requirements of the review and the milestone criteria. Activities

implemented in the initiate process of the TRR are as follows:

a) Establish a review board for the TRR which should contain the participants specified in 4.3 and a

project representative from customers.
b) Select the TRR board chairperson.

c) Determine the review policy for the TRR that should contain the style and format of review

documents, the scope of distribution of the TRR meeting minutes, when and how the TRR is

implemented, and how to address the disagreement about items in the TRR between the supplier

and customers.
d) Determine the review items included in the TRR activity.

e) Develop the milestone criteria for the TRR. The criteria can be specified where all the conditions

are ready for test and risks are identified and controlled.
5.2.3 On-site review process of TRR

Prepare a test readiness checklist according to the test requirements and review items of the TRR. The

test director should organize the implementation of the test readiness check on-site and complete the

test readiness checklist.

NOTE The on-site review is the check to confirm the spacecraft configuration and test configuration.

5.2.4 Implement review process of TRR

A TRR report should be developed by the director of the test based on the results of the test readiness

check on the spot. A review meeting can be held to assess the items included in the TRR report which is

attended by the TRR board.
5.2.5 Conclude process of TRR

A conclusion on whether a test can be started or not should be released based on the result of the TRR

meeting and TRR milestone criteria. All the open actions are recorded and logged with a deadline. The

TRR meeting minutes are distributed.
5.3 Process for PTR
5.3.1 Overview

A PTR activity is performed to evaluate the test data for completeness. In the initiate process, the

preparation of test data and a check of the item under test and the test facility shall be completed. In the

6 © ISO 2020 – All rights reserved
---------------------- Page: 12 ----------------------
ISO 22137:2020(E)

process of the implementation review, the execution of the test for effectiveness and the test data for

completeness shall be reviewed. In the process of concluding review, a conclusion of whether the test

should be completed or not should be provided.
5.3.2 Initiate process of PTR

The initiate process of the PTR is performed to complete the precondition for review, including the

establishment of the organization, the requirements of the review and the milestone criteria. Activities

implemented in the initiate process of the PTR are as follows:

a) When the abnormity of test data or the curve of test data appears, the PTR meeting is necessary.

Otherwise, the PTR can be implemented as the confirming process of test data and the test item.

For the PTR meeting, the following activities are needed:

— Establish a review board and select the PTR board chairperson for the PTR which should

contain the participants specified in 4.3 and a project representative from customers or the

TRR review board.

— Determine the review policy for the PTR that should contain the scope of distribution of the PTR

meeting minutes, when and how the PTR is implemented, and how to addre
...

Questions, Comments and Discussion

Ask us and Technical Secretary will try to provide an answer. You can facilitate discussion about the standard in here.