ISO/IEC 25041:2012

Systems and software engineering — Systems and software Quality Requirements and Evaluation (SQuaRE) — Evaluation guide for developers, acquirers and independent evaluators

ISO/IEC 25041:2012 provides requirements, recommendations and guidelines for system and software product quality evaluation, for the application of ISO/IEC 25040. Intended audiences of ISO/IEC 25041:2012 are developers, acquirers and independent evaluators of the system and software product. ISO/IEC 25041:2012 is part of ISO/IEC 250nn SQuaRE series of International Standards. It is not limited to any specific application area, and can be used for quality evaluation of any type of system and software product.

Ingénierie des systèmes et du logiciel — Exigences de qualité et évaluation des systèmes et du logiciel (SQuaRE) — Guide d'évaluation pour les développeurs, les acquéreurs et les évaluateurs indépendants

General Information

• Status: Published
• Publication Date: 08-Oct-2012
• ICS: 35.080 - Software
• Technical Committee: ISO/IEC JTC 1/SC 7 - Software and systems engineering
• Drafting Committee: ISO/IEC JTC 1/SC 7 - Software and systems engineering
• Current Stage: 9093 - International Standard confirmed
• Completion Date: 09-Aug-2024

Relations

• Consolidated By: ISO 3759:2011 - Textiles — Preparation, marking and measuring of fabric specimens and garments in tests for determination of dimensional change
• Effective Date: 06-Jun-2022
• Revises: ISO/IEC 14598-3:2000 - Software engineering — Product evaluation — Part 3: Process for developers
• Effective Date: 03-Dec-2011
• Revises: ISO/IEC 14598-5:1998 - Information technology — Software product evaluation — Part 5: Process for evaluators
• Effective Date: 03-Dec-2011
• Revises: ISO/IEC 14598-4:1999 - Software engineering — Product evaluation — Part 4: Process for acquirers
• Effective Date: 03-Dec-2011
• Revised: ISO/IEC 14598-6:2001 - Software engineering — Product evaluation — Part 6: Documentation of evaluation modules
• Effective Date: 07-May-2011

Standards Content (Sample)

INTERNATIONAL ISO/IEC
STANDARD 25041
First edition
2012-10-15
Systems and software engineering —
Systems and software Quality
Requirements and Evaluation
(SQuaRE) — Evaluation guide for
developers, acquirers and independent
evaluators
Ingénierie des systèmes et du logiciel — Exigences de qualité et
évaluation des systèmes et du logiciel (SQuaRE) — Guide d'évaluation
pour les développeurs, les acquéreurs et les évaluateurs indépendants

Reference number
©
ISO/IEC 2012
©  ISO/IEC 2012
All rights reserved. Unless otherwise specified, no part of this publication may be reproduced or utilized in any form or by any means,
electronic or mechanical, including photocopying and microfilm, without permission in writing from either ISO at the address below or
ISO's member body in the country of the requester.
ISO copyright office
Case postale 56  CH-1211 Geneva 20
Tel. + 41 22 749 01 11
Fax + 41 22 749 09 47
E-mail [e-mail]
Web www.iso.org
Published in Switzerland
ii © ISO/IEC 2012 – All rights reserved

Contents Page
Foreword . v
Introduction . vi
1  Scope . 1
2  Conformance . 1
3  Normative references . 1
4  Terms and definitions . 2
5  Concept of evaluation from the viewpoint of each role . 3
5.1  Framework of the product quality evaluation from the perspective of each role. 3
5.2  Target entity of software product quality evaluation . 4
5.3  Roles and responsibilities . 6
5.3.1  Roles and responsibilities of developers . 6
5.3.2  Roles and responsibilities of acquirers . 6
5.3.3  Roles and responsibilities of independent evaluators . 7
6  Organization level requirements and recommendations for software product quality
evaluation . 7
6.1  General requirements and recommendations . 7
6.2  Documentation of software product quality evaluation . 8
6.3  Organization level requirements and recommendations to support each role . 9
6.3.1  General requirements . 9
6.3.2  Organizational level recommendations for developers . 10
6.3.3  Organization level requirements and recommendations for acquirers . 10
6.3.4  Organization level requirements for independent evaluators . 11
7  Requirements and recommendation for developers evaluation process . 11
7.1  General requirements . 11
7.2  Establish the evaluation requirements . 12
7.2.1  Inputs and outcomes of this process . 12
7.2.2  Establish the purpose of the evaluation . 12
7.2.3  Obtain the software product quality requirements . 13
7.2.4  Identify product parts to be included in the evaluation . 14
7.2.5  Define the stringency of the evaluation . 15
7.3  Specify the evaluation . 15
7.3.1  Inputs and outcomes of this process . 15
7.3.2  Select quality measures (evaluation modules) . 16
7.3.3  Define decision criteria for quality measures . 18
7.3.4  Define decision criteria for evaluation . 18
7.4  Design the evaluation . 19
7.4.1  Inputs and outcomes of this process . 19
7.4.2  Plan evaluation activities . 19
7.5  Execute the evaluation. 21
7.5.1  Inputs and outcomes of this process . 21
7.5.2  Make measurements . 22
7.5.3  Apply decision criteria for quality measures . 23
7.5.4  Apply decision criteria for evaluation . 23
7.6  Conclude the evaluation . 24
7.6.1  Inputs and outcomes of this process . 24
7.6.2  Review the evaluation results . 25
7.6.3  Create the evaluation report . 26
7.6.4  Review quality evaluation and provide feedback to the organization . 28
© ISO/IEC 2012 – All rights reserved iii

7.6.5  Perform disposition of evaluation data .28
8  Requirements and recommendations for acquirers evaluation process .29
8.1  General requirements .29
8.2  Establish the evaluation requirements .29
8.2.1  Inputs and outcomes of this process .29
8.2.2  Establish the purpose of the evaluation .30
8.2.3  Obtain the software product quality requirements .34
8.2.4  Identify product parts to be included in the evaluation .34
8.2.5  Define the stringency of the evaluation .35
8.3  Specify the evaluation .36
8.3.1  Inputs and outcomes of this process .36
8.3.2  Select quality measures (evaluation modules) .37
8.3.3  Define decision criteria for quality measures .38
8.3.4  Define decision criteria for evaluation .38
8.4  Design the evaluation .38
8.4.1  Inputs and outcomes of this process .38
8.4.2  Plan evaluation activities .39
8.5  Execute the evaluation .40
8.5.1  Inputs and outcomes of this process .40
8.5.2  Make measurements .40
8.5.3  Apply decision criteria for quality measures .41
8.5.4  Apply decision criteria for evaluation.41
8.6  Conclude the evaluation .42
8.6.1  Inputs and outcomes of this process .42
8.6.2  Review the evaluation result .42
8.6.3  Create the evaluation report .42
8.6.4  Review quality evaluation and provide feedback to the organization .42
8.6.5  Perform disposition of evaluation data .42
9  Requirements and recommendations for independent evaluators evaluation process .42
9.1  General requirements .42
9.2  Establish the evaluation requirements .45
9.2.1  Inputs and outcomes of this process .45
9.2.2  Establish the purpose of the evaluation .45
9.2.3  Obtain the software product quality requirements .45
9.2.4  Identify products parts to be included in the evaluation .45
9.2.5  Define the stringency of the evaluation .47
9.3  Specify the evaluation .47
9.3.1  Inputs and outcomes of this process .47
9.3.2  Select quality measures (evaluation modules) .47
9.3.3  Define decision criteria for quality measures .48
9.3.4  Define decision criteria for evaluation .48
9.4  Design the evaluation .48
9.4.1  Inputs and outcomes of this process .48
9.4.2  Plan evaluation activities .48
9.5  Execute the evaluation .49
9.5.1  Inputs and outcomes of this process .49
9.5.2  Make measurements .49
9.5.3  Apply decision criteria for quality measures .
...

INTERNATIONAL ISO/IEC
STANDARD 25041
First edition
2012-10-15
Systems and software engineering —
Systems and software Quality
Requirements and Evaluation
(SQuaRE) — Evaluation guide for
developers, acquirers and independent
evaluators
Ingénierie des systèmes et du logiciel — Exigences de qualité et
évaluation des systèmes et du logiciel (SQuaRE) — Guide d'évaluation
pour les développeurs, les acquéreurs et les évaluateurs indépendants

Reference number
©
ISO/IEC 2012
©  ISO/IEC 2012
All rights reserved. Unless otherwise specified, no part of this publication may be reproduced or utilized in any form or by any means,
electronic or mechanical, including photocopying and microfilm, without permission in writing from either ISO at the address below or
ISO's member body in the country of the requester.
ISO copyright office
Case postale 56  CH-1211 Geneva 20
Tel. + 41 22 749 01 11
Fax + 41 22 749 09 47
E-mail [e-mail]
Web www.iso.org
Published in Switzerland
ii © ISO/IEC 2012 – All rights reserved

Contents Page
Foreword . v
Introduction . vi
1  Scope . 1
2  Conformance . 1
3  Normative references . 1
4  Terms and definitions . 2
5  Concept of evaluation from the viewpoint of each role . 3
5.1  Framework of the product quality evaluation from the perspective of each role. 3
5.2  Target entity of software product quality evaluation . 4
5.3  Roles and responsibilities . 6
5.3.1  Roles and responsibilities of developers . 6
5.3.2  Roles and responsibilities of acquirers . 6
5.3.3  Roles and responsibilities of independent evaluators . 7
6  Organization level requirements and recommendations for software product quality
evaluation . 7
6.1  General requirements and recommendations . 7
6.2  Documentation of software product quality evaluation . 8
6.3  Organization level requirements and recommendations to support each role . 9
6.3.1  General requirements . 9
6.3.2  Organizational level recommendations for developers . 10
6.3.3  Organization level requirements and recommendations for acquirers . 10
6.3.4  Organization level requirements for independent evaluators . 11
7  Requirements and recommendation for developers evaluation process . 11
7.1  General requirements . 11
7.2  Establish the evaluation requirements . 12
7.2.1  Inputs and outcomes of this process . 12
7.2.2  Establish the purpose of the evaluation . 12
7.2.3  Obtain the software product quality requirements . 13
7.2.4  Identify product parts to be included in the evaluation . 14
7.2.5  Define the stringency of the evaluation . 15
7.3  Specify the evaluation . 15
7.3.1  Inputs and outcomes of this process . 15
7.3.2  Select quality measures (evaluation modules) . 16
7.3.3  Define decision criteria for quality measures . 18
7.3.4  Define decision criteria for evaluation . 18
7.4  Design the evaluation . 19
7.4.1  Inputs and outcomes of this process . 19
7.4.2  Plan evaluation activities . 19
7.5  Execute the evaluation. 21
7.5.1  Inputs and outcomes of this process . 21
7.5.2  Make measurements . 22
7.5.3  Apply decision criteria for quality measures . 23
7.5.4  Apply decision criteria for evaluation . 23
7.6  Conclude the evaluation . 24
7.6.1  Inputs and outcomes of this process . 24
7.6.2  Review the evaluation results . 25
7.6.3  Create the evaluation report . 26
7.6.4  Review quality evaluation and provide feedback to the organization . 28
© ISO/IEC 2012 – All rights reserved iii

7.6.5  Perform disposition of evaluation data .28
8  Requirements and recommendations for acquirers evaluation process .29
8.1  General requirements .29
8.2  Establish the evaluation requirements .29
8.2.1  Inputs and outcomes of this process .29
8.2.2  Establish the purpose of the evaluation .30
8.2.3  Obtain the software product quality requirements .34
8.2.4  Identify product parts to be included in the evaluation .34
8.2.5  Define the stringency of the evaluation .35
8.3  Specify the evaluation .36
8.3.1  Inputs and outcomes of this process .36
8.3.2  Select quality measures (evaluation modules) .37
8.3.3  Define decision criteria for quality measures .38
8.3.4  Define decision criteria for evaluation .38
8.4  Design the evaluation .38
8.4.1  Inputs and outcomes of this process .38
8.4.2  Plan evaluation activities .39
8.5  Execute the evaluation .40
8.5.1  Inputs and outcomes of this process .40
8.5.2  Make measurements .40
8.5.3  Apply decision criteria for quality measures .41
8.5.4  Apply decision criteria for evaluation.41
8.6  Conclude the evaluation .42
8.6.1  Inputs and outcomes of this process .42
8.6.2  Review the evaluation result .42
8.6.3  Create the evaluation report .42
8.6.4  Review quality evaluation and provide feedback to the organization .42
8.6.5  Perform disposition of evaluation data .42
9  Requirements and recommendations for independent evaluators evaluation process .42
9.1  General requirements .42
9.2  Establish the evaluation requirements .45
9.2.1  Inputs and outcomes of this process .45
9.2.2  Establish the purpose of the evaluation .45
9.2.3  Obtain the software product quality requirements .45
9.2.4  Identify products parts to be included in the evaluation .45
9.2.5  Define the stringency of the evaluation .47
9.3  Specify the evaluation .47
9.3.1  Inputs and outcomes of this process .47
9.3.2  Select quality measures (evaluation modules) .47
9.3.3  Define decision criteria for quality measures .48
9.3.4  Define decision criteria for evaluation .48
9.4  Design the evaluation .48
9.4.1  Inputs and outcomes of this process .48
9.4.2  Plan evaluation activities .48
9.5  Execute the evaluation .49
9.5.1  Inputs and outcomes of this process .49
9.5.2  Make measurements .49
9.5.3  Apply decision criteria for quality measures .
...