ISO/IEC/IEEE 29119-5:2024

Software and systems engineering — Software testing — Part 5: Keyword-driven testing

This document defines an efficient and consistent solution for keyword-driven testing by: — giving an introduction to keyword-driven testing; — providing a reference approach to implement keyword-driven testing; — defining requirements on frameworks for keyword-driven testing to enable testers to share their work items, such as test cases, test data, keywords, or complete test specifications; — defining requirements for tools that support keyword-driven testing; these requirements are applicable to any tool that supports the keyword-driven approach (e.g. test automation, test design and test management tools); — defining interfaces and a common data exchange format to ensure that tools from different vendors can exchange their data (e.g. test cases, test data and test results); — defining levels of hierarchical keywords, and advising use of hierarchical keywords; this includes describing specific types of keywords (e.g. keywords for navigation or for checking a value) and when to use "flat" structured keywords; — providing an initial list of example generic technical (low-level) keywords, such as "inputData" or "checkValue"; these keywords can be used to specify test cases on a technical level and can be combined to create business-level keywords as required. This document is applicable to all those who want to create keyword-driven test specifications, create corresponding frameworks, or build test automation based on keywords.

Ingénierie du logiciel et des systèmes — Essais du logiciel — Partie 5: Essais axés sur des mots-clés

General Information

• Status: Published
• Publication Date: 18-Dec-2024
• ICS: 35.080 - Software
• Technical Committee: ISO/IEC JTC 1/SC 7 - Software and systems engineering
• Drafting Committee: ISO/IEC JTC 1/SC 7 - Software and systems engineering
• Current Stage: 6060 - International Standard published
• Start Date: 19-Dec-2024
• Due Date: 19-Dec-2024
• Completion Date: 19-Dec-2024

Relations

• Revises: ISO/IEC/IEEE 29119-5:2016 - Software and systems engineering — Software testing — Part 5: Keyword-Driven Testing
• Effective Date: 17-Jun-2023

Standards Content (Sample)

International
Standard
ISO/IEC/IEEE
29119-5
Second edition
Software and systems
2024-12
engineering — Software testing —
Part 5:
Keyword-driven testing
Ingénierie du logiciel et des systèmes — Essais du logiciel —
Partie 5: Essais axés sur des mots-clés
Reference number © ISO/IEC 2024
© ISO/IEC 2024
© IEEE 2024
All rights reserved. Unless otherwise specified, or required in the context of its implementation, no part of this publication may
be reproduced or utilized otherwise in any form or by any means, electronic or mechanical, including photocopying, or posting
on the internet or an intranet, without prior written permission. Permission can be requested from either ISO or IEEE at the
respective address below or ISO’s member body in the country of the requester.
ISO copyright office Institute of Electrical and Electronics Engineers, Inc
CP 401 • Ch. de Blandonnet 8 3 Park Avenue, New York
CH-1214 Vernier, Geneva NY 10016-5997, USA
Phone: [phone]
Email: [e-mail] Email: [e-mail]
Website: www.iso.org Website: www.ieee.org
Published in Switzerland
© ISO/IEC 2024, © IEEE 2024 – All rights reserved
ii
Contents Page
Foreword .v
Introduction .vi
1 Scope . 1
2 Normative references . 1
3 Terms and definitions . 1
4 Conformance . 5
4.1 Intended usage .5
4.2 Full conformance .5
4.3 Tailored conformance .5
5 Introduction to keyword-driven testing . 5
5.1 Overview .5
5.2 Layers in keyword-driven testing .8
5.2.1 Overview .8
5.2.2 Domain layer .9
5.2.3 Test interface layer .10
5.2.4 Multiple layers .10
5.3 Types of keywords .11
5.3.1 Simple keywords .11
5.3.2 Composite keywords . 12
5.3.3 Navigation/interaction (input) and verification (output) . 15
5.3.4 Keywords that determine test results . 15
5.4 Keywords and data .16
6 Application of keyword-driven testing . 17
6.1 Overview .17
6.2 Identifying and documenting keywords .17
6.3 Composing test cases .18
6.4 Keywords and data-driven testing .19
6.5 Modularity and refactoring .19
6.6 Keyword-driven testing in the test design and implementation process . 20
6.6.1 Overview . 20
6.6.2 Create test model (TD1) .21
6.6.3 Identify test coverage items (TD2) .21
6.6.4 Derive test cases (TD3) .21
6.6.5 Create test procedures (TD4) . 22
6.7 Converting non-keyword-driven test cases into keyword-driven test cases . 22
7 Keyword-driven testing frameworks .23
7.1 Overview . 23
7.2 Components of a keyword-driven testing framework . 23
7.2.1 Overview . 23
7.2.2 Keyword-driven editor . 25
7.2.3 Decomposer . 25
7.2.4 Data sequencer . 26
7.2.5 Manual test assistant . . 26
7.2.6 Tool bridge . 26
7.2.7 Test execution environment and test execution engine . 26
7.2.8 Keyword library . 26
7.2.9 Data .27
7.2.10 Script repository .27
7.2.11 Documentation and organizational processes .27
7.3 Basic attributes of the keyword-driven testing framework .27
7.3.1 General information on basic attributes .27
7.3.2 Documentation.27

© ISO/IEC 2024, © IEEE 2024 – All rights reserved
iii
7.3.3 Keyword-driven editor (tool) . 28
7.3.4 Decomposer and data sequencer . 29
7.3.5 Manual test assistant (tool) . 29
7.3.6 Tool bridge . 29
7.3.7 Test execution engine . . 29
7.3.8 Keyword library . 30
7.3.9 Script repository . 30
7.4 Advanced attributes of frameworks . 30
7.4.1 General information on advanced attributes . 30
7.4.2 Documentation. 30
7.4.3 Keyword-driven editor (tool) .31
7.4.4 Decomposer and data sequencer .31
7.4.5 Manual test assistant . .31
7.4.6 Tool bridge .31
7.4.7 Test execution environment and test execution engine .31
7.4.8 Keyword library .32
7.4.9 Test data support . 33
7.4.10 Script repository . 33
8 Data interchange
...