Software and systems engineering -- Software testing

Ingénierie du logiciel et des systèmes -- Essais du logiciel

General Information

Status
Published
Current Stage
4060 - Close of voting
Start Date
03-Oct-2020
Completion Date
02-Oct-2020
Ref Project

RELATIONS

Buy Standard

Draft
ISO/IEC/IEEE DIS 29119-3 - Software and systems engineering -- Software testing
English language
79 pages
sale 15% off
Preview
sale 15% off
Preview
Draft
ISO/IEC/IEEE DIS 29119-3 - Software and systems engineering -- Software testing
English language
79 pages
sale 15% off
Preview
sale 15% off
Preview

Standards Content (sample)

DRAFT INTERNATIONAL STANDARD
ISO/IEC/IEEE/DIS 29119-3
ISO/IEC JTC 1/SC 7 Secretariat: BIS
Voting terminates on:
Voting begins on:
2020-07-10 2020-10-02
Software and systems engineering — Software testing —
Part 3:
Test documentation
Ingénierie du logiciel et des systèmes — Essais du logiciel —
Partie 3: Documentation des essais
ICS: 35.080
THIS DOCUMENT IS A DRAFT CIRCULATED
FOR COMMENT AND APPROVAL. IT IS
THEREFORE SUBJECT TO CHANGE AND MAY
NOT BE REFERRED TO AS AN INTERNATIONAL
STANDARD UNTIL PUBLISHED AS SUCH.
IN ADDITION TO THEIR EVALUATION AS
BEING ACCEPTABLE FOR INDUSTRIAL,
This document is circulated as received from the committee secretariat.
TECHNOLOGICAL, COMMERCIAL AND
USER PURPOSES, DRAFT INTERNATIONAL
STANDARDS MAY ON OCCASION HAVE TO
BE CONSIDERED IN THE LIGHT OF THEIR
POTENTIAL TO BECOME STANDARDS TO
WHICH REFERENCE MAY BE MADE IN
Reference number
NATIONAL REGULATIONS.
ISO/IEC/IEEE/DIS 29119-3:2020(E)
RECIPIENTS OF THIS DRAFT ARE INVITED
TO SUBMIT, WITH THEIR COMMENTS,
NOTIFICATION OF ANY RELEVANT PATENT
ISO/IEC 2020
RIGHTS OF WHICH THEY ARE AWARE AND TO
PROVIDE SUPPORTING DOCUMENTATION. IEEE 2020
---------------------- Page: 1 ----------------------
ISO/IEC/IEEE/DIS 29119-3:2020(E)
COPYRIGHT PROTECTED DOCUMENT
© ISO/IEC 2020
© IEEE 2020

All rights reserved. Unless otherwise specified, or required in the context of its implementation, no part of this publication may

be reproduced or utilized otherwise in any form or by any means, electronic or mechanical, including photocopying, or posting

on the internet or an intranet, without prior written permission. Permission can be requested from either ISO or IEEE at the

respective address below or ISO’s member body in the country of the requester.
ISO copyright office Institute of Electrical and Electronics Engineers, Inc
CP 401 • Ch. de Blandonnet 8 3 Park Avenue, New York
CH-1214 Vernier, Geneva NY 10016-5997, USA
Phone: +41 22 749 01 11
Fax: +41 22 749 09 47
Email: copyright@iso.org Email: stds.ipr@ieee.org
Website: www.iso.org Website: www.ieee.org
Published in Switzerland
© ISO/IEC 2020 – All rights reserved
ii © IEEE 2020 – All rights reserved
---------------------- Page: 2 ----------------------
ISO/IEC/IEEE/DIS 29119-3:2020(E)
Contents Page

1 Scope ............................................................................................................................................ 1

2 Normative references .................................................................................................................. 2

3 Terms and definitions ................................................................................................................. 2

4 Conformance ................................................................................................................................ 5

4.1 Intended usage ............................................................................................................................. 5

4.1.1 Full conformance ......................................................................................................................... 6

4.1.2 Tailored conformance ................................................................................................................. 6

5 Common document information ................................................................................................ 6

5.1 Overview ....................................................................................................................................... 6

5.2 Common document contents ..................................................................................................... 6

5.2.1 Unique identifier ........................................................................................................................... 6

5.2.2 Issuing organization .................................................................................................................... 6

5.2.3 Approval authority ....................................................................................................................... 6

5.2.4 Change history ............................................................................................................................. 6

5.2.5 Status ............................................................................................................................................ 7

5.2.6 Introduction .................................................................................................................................. 7

5.2.7 Scope ............................................................................................................................................ 7

5.2.8 References .................................................................................................................................... 7

5.2.9 Glossary ........................................................................................................................................ 7

6 Organizational Test Process documentation ........................................................................... 7

6.1 Overview ....................................................................................................................................... 7

6.2 Test Policy .................................................................................................................................... 8

6.2.1 Overview ....................................................................................................................................... 8

6.2.2 Objectives of testing ................................................................................................................... 8

6.2.3 Test process ................................................................................................................................. 8

6.2.4 Test organization structure ........................................................................................................ 8

6.2.5 Tester training .............................................................................................................................. 8

6.2.6 Tester ethics ................................................................................................................................. 8

6.2.7 Standards ..................................................................................................................................... 8

6.2.8 Other relevant policies ................................................................................................................ 8

6.2.9 Measuring the value of testing ................................................................................................... 8

6.2.10 Test asset archiving and reuse .................................................................................................. 8

6.2.11 Test process improvement ......................................................................................................... 9

6.3 Organizational Test Practices .................................................................................................... 9

6.3.1 Overview ....................................................................................................................................... 9

6.3.2 Organization-level test practice statements ........................................................................... 10

6.3.3 Test level/type-specific organizational test practice statements ......................................... 11

7 Test Management Processes documentation ........................................................................ 12

7.1 Overview ..................................................................................................................................... 12

7.2 Test Plan ..................................................................................................................................... 12

7.2.1 Overview ..................................................................................................................................... 12

7.2.2 Context of testing ...................................................................................................................... 13

7.2.3 Assumptions and constraints .................................................................................................. 13

7.2.4 Stakeholders .............................................................................................................................. 13

7.2.5 Testing communication ............................................................................................................ 13

7.2.6 Risk register ............................................................................................................................... 13

7.2.7 Test strategy ............................................................................................................................... 14

7.2.8 Testing activities and estimates ............................................................................................... 16

7.2.9 Staffing ........................................................................................................................................ 16

7.2.10 Schedule ..................................................................................................................................... 17

© ISO/IEC 2020 – All rights reserved
ii © IEEE 2020 – All rights reserved
---------------------- Page: 3 ----------------------
ISO/IEC/IEEE/DIS 29119-3:2020(E)

7.3 Test Status Report ...................................................................................................................... 17

7.3.1 Overview ...................................................................................................................................... 17

7.3.2 Test status ................................................................................................................................... 17

7.3.3 Reporting period ......................................................................................................................... 17

7.3.4 Progress against Test Plan ....................................................................................................... 18

7.3.5 Factors blocking progress ........................................................................................................ 18

7.3.6 Test measures ............................................................................................................................ 18

7.3.7 New and changed risks.............................................................................................................. 18

7.3.8 Planned testing ........................................................................................................................... 18

7.4 Test Completion Report ............................................................................................................. 18

7.4.1 Overview ...................................................................................................................................... 18

7.4.2 Summary of testing performed ................................................................................................. 18

7.4.3 Deviations from planned testing ............................................................................................... 18

7.4.4 Test completion evaluation ....................................................................................................... 18

7.4.5 Factors that blocked progress .................................................................................................. 19

7.4.6 Test measures ............................................................................................................................ 19

7.4.7 Residual risks ............................................................................................................................. 19

7.4.8 Test deliverables ........................................................................................................................ 19

7.4.9 Reusable test assets .................................................................................................................. 19

7.4.10 Lessons learned ......................................................................................................................... 19

8 Dynamic Test Processes documentation ................................................................................ 19

8.1 Overview ...................................................................................................................................... 19

8.2 Test Model Specification ........................................................................................................... 20

8.2.1 Overview ...................................................................................................................................... 20

8.2.2 Unique identifier ......................................................................................................................... 20

8.2.3 Objective ..................................................................................................................................... 20

8.2.4 Priority ......................................................................................................................................... 20

8.2.5 Test strategy extract .................................................................................................................. 21

8.2.6 Test model ................................................................................................................................... 21

8.2.7 Traceability .................................................................................................................................. 21

8.3 Test Case Specification ............................................................................................................. 21

8.3.1 Overview ...................................................................................................................................... 21

8.3.2 Test coverage items ................................................................................................................... 21

8.3.3 Test cases ................................................................................................................................... 22

8.4 Test Procedure Specification .................................................................................................... 23

8.4.1 Overview ...................................................................................................................................... 23

8.4.2 Unique identifier ......................................................................................................................... 24

8.4.3 Objective ..................................................................................................................................... 24

8.4.4 Priority ......................................................................................................................................... 24

8.4.5 Start up ........................................................................................................................................ 24

8.4.6 Ordered test cases ..................................................................................................................... 24

8.4.7 Relationship to other procedures ............................................................................................. 24

8.4.8 Stop and wrap up ....................................................................................................................... 24

8.5 Test Data Requirements ............................................................................................................ 25

8.5.1 Overview ...................................................................................................................................... 25

8.5.2 Unique identifier ......................................................................................................................... 25

8.5.3 Description .................................................................................................................................. 25

8.5.4 Responsibility ............................................................................................................................. 25

8.5.5 Period needed ............................................................................................................................. 25

8.5.6 Resetting needs .......................................................................................................................... 25

8.5.7 Archiving or disposal ................................................................................................................. 25

8.6 Test Environment Requirements .............................................................................................. 25

8.6.1 Overview ...................................................................................................................................... 25

8.6.2 Unique identifier ......................................................................................................................... 26

8.6.3 Test environment item ............................................................................................................... 26

8.6.4 Description .................................................................................................................................. 26

8.6.5 Responsibility ............................................................................................................................. 26

8.6.6 Period needed ............................................................................................................................. 26

8.7 Test Data Readiness Report ...................................................................................................... 26

© ISO/IEC 2020 – All rights reserved
© IEEE 2020 – All rights reserved iii
---------------------- Page: 4 ----------------------
ISO/IEC/IEEE/DIS 29119-3:2020(E)

8.7.1 Overview ..................................................................................................................................... 26

8.7.2 Unique identifier ......................................................................................................................... 27

8.7.3 Description of status ................................................................................................................. 27

8.8 Test Environment Readiness Report ....................................................................................... 27

8.8.1 Overview ..................................................................................................................................... 27

8.8.2 Unique identifier ......................................................................................................................... 27

8.8.3 Description of status ................................................................................................................. 27

8.9 Actual Results ............................................................................................................................ 27

8.10 Test Result .................................................................................................................................. 28

8.11 Test Execution Log .................................................................................................................... 28

8.11.1 Overview ..................................................................................................................................... 28

8.11.2 Unique identifier ......................................................................................................................... 28

8.11.3 Date/time ..................................................................................................................................... 28

8.11.4 Description ................................................................................................................................. 29

8.11.5 Impact ......................................................................................................................................... 29

8.12 Test Incident Report .................................................................................................................. 29

8.12.1 Overview ..................................................................................................................................... 29

8.12.2 Timing information .................................................................................................................... 29

8.12.3 Originator .................................................................................................................................... 29

8.12.4 Context ........................................................................................................................................ 29

8.12.5 Description of the incident ....................................................................................................... 30

8.12.6 Originator’s assessment of severity ........................................................................................ 30

8.12.7 Originator’s assessment of priority ......................................................................................... 30

8.12.8 Risk ............................................................................................................................................. 30

8.12.9 Status of the incident ................................................................................................................ 30

Annex A (normative) ISO/IEC/IEEE 29119-2 Normative Requirements Mapped to

ISO/IEC/IEEE 29119-3 Information Items ................................................................................. 31

A.1 Overview ..................................................................................................................................... 31

A.2 Mapping – Common Document Information ........................................................................... 31

A.3 Mapping – Test Documentation Contents ............................................................................... 31

6.2 Test Policy ......................................................................................................................................... 31

6.3 Organizational Test Practices ......................................................................................................... 32

7.2 Test Plan ............................................................................................................................................ 32

7.3 Test Status Report ............................................................................................................................ 33

7.4 Test Completion Report ................................................................................................................... 33

8.2 Test Model Specification .................................................................................................................. 33

8.3 Test Case Specification ................................................................................................................... 33

8.4 Test Procedure Specification .......................................................................................................... 34

8.5 Test Data Requirements ................................................................................................................... 34

8.6 Test Environment Requirements .................................................................................................... 34

8.7 Test Data Readiness Report ............................................................................................................ 34

8.8 Test Environment Readiness Report .............................................................................................. 34

8.9 Actual Results ................................................................................................................................... 34

8.10 Test Result ....................................................................................................................................... 34

8.11 Test Execution Log ......................................................................................................................... 34

8.12 Incident Report................................................................................................................................ 34

Annex B (informative) Overview of Examples ...................................................................................... 36

B.1 Overview ..................................................................................................................................... 36

Annex C (informative) Test Policy ......................................................................................................... 37

C.1 Example 1 – Agile Corporation ................................................................................................. 37

C.2 Example 2 – Traditional Ltd ...................................................................................................... 38

Annex D (informative) Organizational Test Practices .......................................................................... 39

D.1 Example 1 – Agile Corporation ................................................................................................. 39

D.2 Example 2 – Traditional Ltd ...................................................................................................... 41

Annex E (informative) Test Plan ............................................................................................................ 44

E.1 Example 1 – Agile Corporation ................................................................................................. 44

E.2 Example 2 – Traditional Ltd ...................................................................................................... 45

© ISO/IEC 2020 – All rights reserved
iv © IEEE 2020 – All rights reserved
---------------------- Page: 5 ----------------------
ISO/IEC/IEEE/DIS 29119-3:2020(E)

Annex F (informative) Test Status Report ............................................................................................. 51

F.1 Example 1 – Agile Corporation ................................................................................................. 51

G.2 Example 2 – Traditional Ltd ....................................................................................................... 52

Annex G (informative) Test Completion Report .................................................................................... 54

G.1 Example 1 – Agile Corporation ................................................................................................. 54

G.2 Example 2 – Traditional Ltd ....................................................................................................... 55

Annex H (informative) Test Model Specification................................................................................... 56

H.1 Example 1 – Agile Corporation ................................................................................................. 56

H.2 Example 2 – Traditional Ltd ....................................................................................................... 57

Annex I (informative) Test Case Specification ...................................................................................... 58

I.1 Example 1 – Agile Corporation ................................................................................................. 58

I.2 Example 2 – Traditional Ltd ....................................................................................................... 58

Annex J (informative) Test Procedure Specification ............................................................................ 61

J.1.1 Example 1.1 – Agile Corporation .............................................................................................. 61

J.1.2 Example 1.2 – Agile Corporation .............................................................................................. 61

J.2 Example 2 – Traditional Ltd ....................................................................................................... 62

Annex K (informative) Test Data Requirements.................................................................................... 63

K.1 Example 1 – Agile Corporation ................................................................................................. 63

K.2 Example 2 – Traditional Ltd ....................................................................................................... 63

Annex L (informative) Test Environment Requirements ...................................................................... 64

L.1 Example 1 – Agile Corporation ................................................................................................. 64

L.2 Example – Traditional Ltd .................................................................

...

DRAFT INTERNATIONAL STANDARD
ISO/IEC/IEEE/DIS 29119-3
ISO/IEC JTC 1/SC 7 Secretariat: BIS
Voting begins on: Voting terminates on:
2020-07-10 2020-09-10
Software and systems engineering — Software testing —
Part 3:
Test documentation
Ingénierie du logiciel et des systèmes — Essais du logiciel —
Partie 3: Documentation des essais
ICS: 35.080
THIS DOCUMENT IS A DRAFT CIRCULATED
FOR COMMENT AND APPROVAL. IT IS
THEREFORE SUBJECT TO CHANGE AND MAY
NOT BE REFERRED TO AS AN INTERNATIONAL
STANDARD UNTIL PUBLISHED AS SUCH.
IN ADDITION TO THEIR EVALUATION AS
BEING ACCEPTABLE FOR INDUSTRIAL,
This document is circulated as received from the committee secretariat.
TECHNOLOGICAL, COMMERCIAL AND
USER PURPOSES, DRAFT INTERNATIONAL
STANDARDS MAY ON OCCASION HAVE TO
BE CONSIDERED IN THE LIGHT OF THEIR
POTENTIAL TO BECOME STANDARDS TO
WHICH REFERENCE MAY BE MADE IN
Reference number
NATIONAL REGULATIONS.
ISO/IEC/IEEE/DIS 29119-3:2020(E)
RECIPIENTS OF THIS DRAFT ARE INVITED
TO SUBMIT, WITH THEIR COMMENTS,
NOTIFICATION OF ANY RELEVANT PATENT
ISO/IEC 2020
RIGHTS OF WHICH THEY ARE AWARE AND TO
PROVIDE SUPPORTING DOCUMENTATION. IEEE 2020
---------------------- Page: 1 ----------------------
ISO/IEC/IEEE/DIS 29119-3:2020(E)
COPYRIGHT PROTECTED DOCUMENT
© ISO/IEC 2020
© IEEE 2020

All rights reserved. Unless otherwise specified, or required in the context of its implementation, no part of this publication may

be reproduced or utilized otherwise in any form or by any means, electronic or mechanical, including photocopying, or posting

on the internet or an intranet, without prior written permission. Permission can be requested from either ISO or IEEE at the

respective address below or ISO’s member body in the country of the requester.
ISO copyright office Institute of Electrical and Electronics Engineers, Inc
CP 401 • Ch. de Blandonnet 8 3 Park Avenue, New York
CH-1214 Vernier, Geneva NY 10016-5997, USA
Phone: +41 22 749 01 11
Fax: +41 22 749 09 47
Email: copyright@iso.org Email: stds.ipr@ieee.org
Website: www.iso.org Website: www.ieee.org
Published in Switzerland
© ISO/IEC 2020 – All rights reserved
ii © IEEE 2020 – All rights reserved
---------------------- Page: 2 ----------------------
ISO/IEC/IEEE/DIS 29119-3:2020(E)
Contents Page

1 Scope ............................................................................................................................................ 1

2 Normative references .................................................................................................................. 2

3 Terms and definitions ................................................................................................................. 2

4 Conformance ................................................................................................................................ 5

4.1 Intended usage ............................................................................................................................. 5

4.1.1 Full conformance ......................................................................................................................... 6

4.1.2 Tailored conformance ................................................................................................................. 6

5 Common document information ................................................................................................ 6

5.1 Overview ....................................................................................................................................... 6

5.2 Common document contents ..................................................................................................... 6

5.2.1 Unique identifier ........................................................................................................................... 6

5.2.2 Issuing organization .................................................................................................................... 6

5.2.3 Approval authority ....................................................................................................................... 6

5.2.4 Change history ............................................................................................................................. 6

5.2.5 Status ............................................................................................................................................ 7

5.2.6 Introduction .................................................................................................................................. 7

5.2.7 Scope ............................................................................................................................................ 7

5.2.8 References .................................................................................................................................... 7

5.2.9 Glossary ........................................................................................................................................ 7

6 Organizational Test Process documentation ........................................................................... 7

6.1 Overview ....................................................................................................................................... 7

6.2 Test Policy .................................................................................................................................... 8

6.2.1 Overview ....................................................................................................................................... 8

6.2.2 Objectives of testing ................................................................................................................... 8

6.2.3 Test process ................................................................................................................................. 8

6.2.4 Test organization structure ........................................................................................................ 8

6.2.5 Tester training .............................................................................................................................. 8

6.2.6 Tester ethics ................................................................................................................................. 8

6.2.7 Standards ..................................................................................................................................... 8

6.2.8 Other relevant policies ................................................................................................................ 8

6.2.9 Measuring the value of testing ................................................................................................... 8

6.2.10 Test asset archiving and reuse .................................................................................................. 8

6.2.11 Test process improvement ......................................................................................................... 9

6.3 Organizational Test Practices .................................................................................................... 9

6.3.1 Overview ....................................................................................................................................... 9

6.3.2 Organization-level test practice statements ........................................................................... 10

6.3.3 Test level/type-specific organizational test practice statements ......................................... 11

7 Test Management Processes documentation ........................................................................ 12

7.1 Overview ..................................................................................................................................... 12

7.2 Test Plan ..................................................................................................................................... 12

7.2.1 Overview ..................................................................................................................................... 12

7.2.2 Context of testing ...................................................................................................................... 13

7.2.3 Assumptions and constraints .................................................................................................. 13

7.2.4 Stakeholders .............................................................................................................................. 13

7.2.5 Testing communication ............................................................................................................ 13

7.2.6 Risk register ............................................................................................................................... 13

7.2.7 Test strategy ............................................................................................................................... 14

7.2.8 Testing activities and estimates ............................................................................................... 16

7.2.9 Staffing ........................................................................................................................................ 16

7.2.10 Schedule ..................................................................................................................................... 17

© ISO/IEC 2020 – All rights reserved
ii © IEEE 2020 – All rights reserved
---------------------- Page: 3 ----------------------
ISO/IEC/IEEE/DIS 29119-3:2020(E)

7.3 Test Status Report ...................................................................................................................... 17

7.3.1 Overview ...................................................................................................................................... 17

7.3.2 Test status ................................................................................................................................... 17

7.3.3 Reporting period ......................................................................................................................... 17

7.3.4 Progress against Test Plan ....................................................................................................... 18

7.3.5 Factors blocking progress ........................................................................................................ 18

7.3.6 Test measures ............................................................................................................................ 18

7.3.7 New and changed risks.............................................................................................................. 18

7.3.8 Planned testing ........................................................................................................................... 18

7.4 Test Completion Report ............................................................................................................. 18

7.4.1 Overview ...................................................................................................................................... 18

7.4.2 Summary of testing performed ................................................................................................. 18

7.4.3 Deviations from planned testing ............................................................................................... 18

7.4.4 Test completion evaluation ....................................................................................................... 18

7.4.5 Factors that blocked progress .................................................................................................. 19

7.4.6 Test measures ............................................................................................................................ 19

7.4.7 Residual risks ............................................................................................................................. 19

7.4.8 Test deliverables ........................................................................................................................ 19

7.4.9 Reusable test assets .................................................................................................................. 19

7.4.10 Lessons learned ......................................................................................................................... 19

8 Dynamic Test Processes documentation ................................................................................ 19

8.1 Overview ...................................................................................................................................... 19

8.2 Test Model Specification ........................................................................................................... 20

8.2.1 Overview ...................................................................................................................................... 20

8.2.2 Unique identifier ......................................................................................................................... 20

8.2.3 Objective ..................................................................................................................................... 20

8.2.4 Priority ......................................................................................................................................... 20

8.2.5 Test strategy extract .................................................................................................................. 21

8.2.6 Test model ................................................................................................................................... 21

8.2.7 Traceability .................................................................................................................................. 21

8.3 Test Case Specification ............................................................................................................. 21

8.3.1 Overview ...................................................................................................................................... 21

8.3.2 Test coverage items ................................................................................................................... 21

8.3.3 Test cases ................................................................................................................................... 22

8.4 Test Procedure Specification .................................................................................................... 23

8.4.1 Overview ...................................................................................................................................... 23

8.4.2 Unique identifier ......................................................................................................................... 24

8.4.3 Objective ..................................................................................................................................... 24

8.4.4 Priority ......................................................................................................................................... 24

8.4.5 Start up ........................................................................................................................................ 24

8.4.6 Ordered test cases ..................................................................................................................... 24

8.4.7 Relationship to other procedures ............................................................................................. 24

8.4.8 Stop and wrap up ....................................................................................................................... 24

8.5 Test Data Requirements ............................................................................................................ 25

8.5.1 Overview ...................................................................................................................................... 25

8.5.2 Unique identifier ......................................................................................................................... 25

8.5.3 Description .................................................................................................................................. 25

8.5.4 Responsibility ............................................................................................................................. 25

8.5.5 Period needed ............................................................................................................................. 25

8.5.6 Resetting needs .......................................................................................................................... 25

8.5.7 Archiving or disposal ................................................................................................................. 25

8.6 Test Environment Requirements .............................................................................................. 25

8.6.1 Overview ...................................................................................................................................... 25

8.6.2 Unique identifier ......................................................................................................................... 26

8.6.3 Test environment item ............................................................................................................... 26

8.6.4 Description .................................................................................................................................. 26

8.6.5 Responsibility ............................................................................................................................. 26

8.6.6 Period needed ............................................................................................................................. 26

8.7 Test Data Readiness Report ...................................................................................................... 26

© ISO/IEC 2020 – All rights reserved
© IEEE 2020 – All rights reserved iii
---------------------- Page: 4 ----------------------
ISO/IEC/IEEE/DIS 29119-3:2020(E)

8.7.1 Overview ..................................................................................................................................... 26

8.7.2 Unique identifier ......................................................................................................................... 27

8.7.3 Description of status ................................................................................................................. 27

8.8 Test Environment Readiness Report ....................................................................................... 27

8.8.1 Overview ..................................................................................................................................... 27

8.8.2 Unique identifier ......................................................................................................................... 27

8.8.3 Description of status ................................................................................................................. 27

8.9 Actual Results ............................................................................................................................ 27

8.10 Test Result .................................................................................................................................. 28

8.11 Test Execution Log .................................................................................................................... 28

8.11.1 Overview ..................................................................................................................................... 28

8.11.2 Unique identifier ......................................................................................................................... 28

8.11.3 Date/time ..................................................................................................................................... 28

8.11.4 Description ................................................................................................................................. 29

8.11.5 Impact ......................................................................................................................................... 29

8.12 Test Incident Report .................................................................................................................. 29

8.12.1 Overview ..................................................................................................................................... 29

8.12.2 Timing information .................................................................................................................... 29

8.12.3 Originator .................................................................................................................................... 29

8.12.4 Context ........................................................................................................................................ 29

8.12.5 Description of the incident ....................................................................................................... 30

8.12.6 Originator’s assessment of severity ........................................................................................ 30

8.12.7 Originator’s assessment of priority ......................................................................................... 30

8.12.8 Risk ............................................................................................................................................. 30

8.12.9 Status of the incident ................................................................................................................ 30

Annex A (normative) ISO/IEC/IEEE 29119-2 Normative Requirements Mapped to

ISO/IEC/IEEE 29119-3 Information Items ................................................................................. 31

A.1 Overview ..................................................................................................................................... 31

A.2 Mapping – Common Document Information ........................................................................... 31

A.3 Mapping – Test Documentation Contents ............................................................................... 31

6.2 Test Policy ......................................................................................................................................... 31

6.3 Organizational Test Practices ......................................................................................................... 32

7.2 Test Plan ............................................................................................................................................ 32

7.3 Test Status Report ............................................................................................................................ 33

7.4 Test Completion Report ................................................................................................................... 33

8.2 Test Model Specification .................................................................................................................. 33

8.3 Test Case Specification ................................................................................................................... 33

8.4 Test Procedure Specification .......................................................................................................... 34

8.5 Test Data Requirements ................................................................................................................... 34

8.6 Test Environment Requirements .................................................................................................... 34

8.7 Test Data Readiness Report ............................................................................................................ 34

8.8 Test Environment Readiness Report .............................................................................................. 34

8.9 Actual Results ................................................................................................................................... 34

8.10 Test Result ....................................................................................................................................... 34

8.11 Test Execution Log ......................................................................................................................... 34

8.12 Incident Report................................................................................................................................ 34

Annex B (informative) Overview of Examples ...................................................................................... 36

B.1 Overview ..................................................................................................................................... 36

Annex C (informative) Test Policy ......................................................................................................... 37

C.1 Example 1 – Agile Corporation ................................................................................................. 37

C.2 Example 2 – Traditional Ltd ...................................................................................................... 38

Annex D (informative) Organizational Test Practices .......................................................................... 39

D.1 Example 1 – Agile Corporation ................................................................................................. 39

D.2 Example 2 – Traditional Ltd ...................................................................................................... 41

Annex E (informative) Test Plan ............................................................................................................ 44

E.1 Example 1 – Agile Corporation ................................................................................................. 44

E.2 Example 2 – Traditional Ltd ...................................................................................................... 45

© ISO/IEC 2020 – All rights reserved
iv © IEEE 2020 – All rights reserved
---------------------- Page: 5 ----------------------
ISO/IEC/IEEE/DIS 29119-3:2020(E)

Annex F (informative) Test Status Report ............................................................................................. 51

F.1 Example 1 – Agile Corporation ................................................................................................. 51

G.2 Example 2 – Traditional Ltd ....................................................................................................... 52

Annex G (informative) Test Completion Report .................................................................................... 54

G.1 Example 1 – Agile Corporation ................................................................................................. 54

G.2 Example 2 – Traditional Ltd ....................................................................................................... 55

Annex H (informative) Test Model Specification................................................................................... 56

H.1 Example 1 – Agile Corporation ................................................................................................. 56

H.2 Example 2 – Traditional Ltd ....................................................................................................... 57

Annex I (informative) Test Case Specification ...................................................................................... 58

I.1 Example 1 – Agile Corporation ................................................................................................. 58

I.2 Example 2 – Traditional Ltd ....................................................................................................... 58

Annex J (informative) Test Procedure Specification ............................................................................ 61

J.1.1 Example 1.1 – Agile Corporation .............................................................................................. 61

J.1.2 Example 1.2 – Agile Corporation .............................................................................................. 61

J.2 Example 2 – Traditional Ltd ....................................................................................................... 62

Annex K (informative) Test Data Requirements.................................................................................... 63

K.1 Example 1 – Agile Corporation ................................................................................................. 63

K.2 Example 2 – Traditional Ltd ....................................................................................................... 63

Annex L (informative) Test Environment Requirements ...................................................................... 64

L.1 Example 1 – Agile Corporation ................................................................................................. 64

L.2 Example – Traditional Ltd ....................................................................

...

Questions, Comments and Discussion

Ask us and Technical Secretary will try to provide an answer. You can facilitate discussion about the standard in here.