ISO/IEC 25045:2010
(Main)Systems and software engineering — Systems and software Quality Requirements and Evaluation (SQuaRE) — Evaluation module for recoverability
Systems and software engineering — Systems and software Quality Requirements and Evaluation (SQuaRE) — Evaluation module for recoverability
ISO/IEC 25045:2010 is one of the SQuaRE series of International Standards, which provides a framework for software products quality requirements and evaluation including the requirements for methods of software product measurement and evaluation. ISO/IEC 25045:2010 uses a methodology involving two types of evaluation for recoverability. One part of the method makes use of the disturbance injection methodology and a list of disturbances based on common categories of operational faults and events to evaluate the quality measure of resiliency. The second quality measure is based on a set of questions that is defined for each disturbance to evaluate the quality measure of autonomic recovery index by assessing how well the system detects, analyses, and resolves the disturbance without human intervention. ISO/IEC 25045:2010 is applicable to information systems executing transactions in a system supporting single or multiple concurrent users, where speedy recovery and ease of managing recovery is important to the acquirer, owner/operator, and the developer.
Ingénierie des systèmes et du logiciel — Exigences de qualité et évaluation des systèmes et du logiciel (SQuaRE) — Module d'évaluation pour la possibilité de récupération
General Information
Relations
Buy Standard
Standards Content (Sample)
INTERNATIONAL ISO/IEC
STANDARD 25045
First edition
2010-09-01
Systems and software engineering —
Systems and software Quality
Requirements and Evaluation
(SQuaRE) — Evaluation module for
recoverability
Ingénierie des systèmes et du logiciel — Exigences de qualité et
évaluation des systèmes et du logiciel (SQuaRE) — Module
d'évaluation pour la possibilité de récupération
Reference number
©
ISO/IEC 2010
PDF disclaimer
This PDF file may contain embedded typefaces. In accordance with Adobe's licensing policy, this file may be printed or viewed but
shall not be edited unless the typefaces which are embedded are licensed to and installed on the computer performing the editing. In
downloading this file, parties accept therein the responsibility of not infringing Adobe's licensing policy. The ISO Central Secretariat
accepts no liability in this area.
Adobe is a trademark of Adobe Systems Incorporated.
Details of the software products used to create this PDF file can be found in the General Info relative to the file; the PDF-creation
parameters were optimized for printing. Every care has been taken to ensure that the file is suitable for use by ISO member bodies. In
the unlikely event that a problem relating to it is found, please inform the Central Secretariat at the address given below.
© ISO/IEC 2010
All rights reserved. Unless otherwise specified, no part of this publication may be reproduced or utilized in any form or by any means,
electronic or mechanical, including photocopying and microfilm, without permission in writing from either ISO at the address below or
ISO's member body in the country of the requester.
ISO copyright office
Case postale 56 • CH-1211 Geneva 20
Tel. + 41 22 749 01 11
Fax + 41 22 749 09 47
E-mail copyright@iso.org
Web www.iso.org
Published in Switzerland
ii © ISO/IEC 2010 – All rights reserved
Contents Page
Foreword .iv
Introduction.v
1 Scope.1
1.1 Characteristics.1
1.2 Level of evaluation .1
1.3 Technique.1
1.4 Applicability .2
2 Conformance .2
3 Normative references.2
4 Terms and definitions .3
5 Inputs and measures.3
5.1 Evaluation methodology.3
5.1.1 Practical considerations relating to the methodology .5
5.1.2 Disturbances.5
5.2 Input for the evaluation.8
5.2.1 The SUT description.8
5.2.2 The workload description.9
5.2.3 The fault load description.10
5.3 Data elements .11
5.3.1 Output from the baseline run .11
5.3.2 Output from the test run .11
5.3.3 Completion of the Autonomic Maturity Questionnaire.12
5.4 Quality Measures.12
5.4.1 Summary of the Quality Measures and Quality Measure Elements (QME) .12
5.4.2 Quality Measure - Resiliency.12
5.4.3 Quality Measure - Autonomic Recovery Index.13
5.4.4 Quality Measure Element (QME) - Number of transactions under disturbance.15
5.4.5 Quality Measure Element (QME) - Number of transactions under no disturbance .16
5.4.6 Quality Measure Element (QME) - Autonomic Maturity Score.16
6 Interpretation of results .17
6.1 Mapping of measures.17
6.2 Reporting.17
6.3 Application Procedure .17
Annex A (informative) Sample Report .18
Bibliography.37
© ISO/IEC 2010 – All rights reserved iii
Foreword
ISO (the International Organization for Standardization) and IEC (the International Electrotechnical
Commission) form the specialized system for worldwide standardization. National bodies that are members of
ISO or IEC participate in the development of International Standards through technical committees
established by the respective organization to deal with particular fields of technical activity. ISO and IEC
technical committees collaborate in fields of mutual interest. Other international organizations, governmental
and non-governmental, in liaison with ISO and IEC, also take part in the work. In the field of information
technology, ISO and IEC have established a joint technical committee, ISO/IEC JTC 1.
International Standards are drafted in accordance with the rules given in the ISO/IEC Directives, Part 2.
The main task of the joint technical committee is to prepare International Standards. Draft International
Standards adopted by the joint technical committee are circulated to national bodies for voting. Publication as
an International Standard requires approval by at least 75 % of the national bodies casting a vote.
Attention is drawn to the possibility that some of the elements of this document may be the subject of patent
rights. ISO and IEC shall not be held responsible for identifying any or all such patent rights.
ISO/IEC 25045 was prepared by Joint Technical Committee ISO/IEC JTC 1, Information technology,
Subcommittee SC 7, Software and systems engineering.
ISO/IEC 25045 is one of the SQuaRE series of International Standards, which consists of the following
divisions under the general title Systems and software engineering — Systems and software Quality
Requirements and Evaluation (SQuaRE):
• Quality Management Division (ISO/IEC 2500n),
• Quality Model Division (ISO/IEC 2501n),
• Quality Measurement Division (ISO/IEC 2502n),
• Quality Requirements Division (ISO/IEC 2503n),
• Quality Evaluation Division (ISO/IEC 2504n).
iv © ISO/IEC 2010 – All rights reserved
Introduction
The evaluation of software product quality is vital to both the acquisition and development of software that
meets quality requirements. The relative importance of the various characteristics of software quality depends
on the mission or objectives of the system of which it is a part; software products need to be evaluated to
decide whether relevant quality characteristics meet the requirements of the system.
The essential parts of software quality evaluation are a quality model, the method of evaluation, software
measurement, and supporting tools. To develop good software, quality requirements should be specified, the
software quality assurance process should be planned, implemented and controlled, and both intermediate
products and end products should be evaluated.
This International Standard is part of the SQuaRE series of International Standards. It contains general
requirements for specification and evaluation of systems and software quality and clarifies the associated
general concepts. It provides a framework for evaluating the quality of software products and states the
requirements for methods of software product measurement and evaluation.
The general goal of creating the SQuaRE series of International Standards is to move to a logically organized,
enriched and unified series covering two main processes: software quality requirements specification and
software quality evaluation, supported by a software quality measurement process. The purpose of the
SQuaRE series of International Standards is to assist those developing and acquiring software products with
the specification and evaluation of quality requirements. It establishes criteria for the specification of systems
and software quality requirements, their measurement, and evaluation. It includes a two-part quality model for
aligning customer definitions of quality with attributes of the development process. In addition, the series
provides recommended measures of software product quality attributes that can be used by developers,
acquirers, and evaluators.
SQuaRE provides
• terms and definitions,
• reference models,
• a general guide,
• individual division guides, and
• International Standards for requirements specification, planning and management, measurement and
evaluation purposes.
SQuaRE includes International Standards on quality model and measures, as well as on quality requirements
and evaluation.
SQuaRE replaces the current ISO/IEC 9126 series and the ISO/IEC 14598 series.
ISO/IEC 25040, Systems and software engineering — Systems and software Quality Requirements and
Evaluation (SQuaRE) — Evaluation reference model and guide will replace a part of ISO/IEC 14598-1,
Information technology — Software product evaluation — Part 1: General overview.
ISO/IEC 25041, Systems and software engineering — Systems and software Quality Requirements and
Evaluation (SQuaRE) — Evaluation modules will replace ISO/IEC 14598-6, Software engineering — Product
evaluation — Documentation of evaluation modules.
ISO/IEC 25001, Software engineering — Software product Quality Requirements and Evaluation
(SQuaRE) — Planning and management replaces ISO/IEC 14598-2, Software engineering — Product
evaluation — Part 2: Planning and management.
© ISO/IEC 2010 – All rights reserved v
Quality Model
Division
2501n
Quality
Quality
Quality
Evaluation
Management Division
Requirements
Division
Division
2500n
2504n
2503n
Quality
Measurement Division
2502n
Figure 1 – Organization of the SQuaRE series of International Standards
Figure 1 illustrates the organization of the SQuaRE series, representing families of standards, also called
divisions.
The divisions within SQuaRE model are:
• ISO/IEC 2500n - Quality Management Division. The International Standards that form this division
define all common models, terms and definitions further referred to by all other International Standards
from the SQuaRE series. Referring paths (guidance through SQuaRE documents) and high level practical
suggestions in applying proper standards to specific application cases offer help to all types of users. The
division also provides requirements and guidance for a supporting function which is responsible for the
management of software product requirements specification and evaluation.
• ISO/IEC 2501n - Quality Model Division. The International Standard that forms this division presents a
detailed quality model including internal, external and quality in use characteristics. Furthermore, the
internal and external software quality characteristics are decomposed into sub-characteristics. Practical
guidance on the use of the quality model is also provided.
• ISO/IEC 2502n - Quality Measurement Division. The International Standards that form this division
include a software product quality measurement reference model, mathematical definitions of quality
measures, and practical guidance for their application. Presented measures apply to internal software
quality, external software quality and quality in use. Measurement primitives forming foundations for the
latter measures are defined and presented.
• ISO/IEC 2503n - Quality Requirements Division. The International Standard that forms this division
helps in specifying quality requirements. These quality requirements can be used in the proc
...
INTERNATIONAL ISO/IEC
STANDARD 25045
First edition
2010-09-01
Systems and software engineering —
Systems and software Quality
Requirements and Evaluation
(SQuaRE) — Evaluation module for
recoverability
Ingénierie des systèmes et du logiciel — Exigences de qualité et
évaluation des systèmes et du logiciel (SQuaRE) — Module
d'évaluation pour la possibilité de récupération
Reference number
©
ISO/IEC 2010
PDF disclaimer
This PDF file may contain embedded typefaces. In accordance with Adobe's licensing policy, this file may be printed or viewed but
shall not be edited unless the typefaces which are embedded are licensed to and installed on the computer performing the editing. In
downloading this file, parties accept therein the responsibility of not infringing Adobe's licensing policy. The ISO Central Secretariat
accepts no liability in this area.
Adobe is a trademark of Adobe Systems Incorporated.
Details of the software products used to create this PDF file can be found in the General Info relative to the file; the PDF-creation
parameters were optimized for printing. Every care has been taken to ensure that the file is suitable for use by ISO member bodies. In
the unlikely event that a problem relating to it is found, please inform the Central Secretariat at the address given below.
© ISO/IEC 2010
All rights reserved. Unless otherwise specified, no part of this publication may be reproduced or utilized in any form or by any means,
electronic or mechanical, including photocopying and microfilm, without permission in writing from either ISO at the address below or
ISO's member body in the country of the requester.
ISO copyright office
Case postale 56 • CH-1211 Geneva 20
Tel. + 41 22 749 01 11
Fax + 41 22 749 09 47
E-mail copyright@iso.org
Web www.iso.org
Published in Switzerland
ii © ISO/IEC 2010 – All rights reserved
Contents Page
Foreword .iv
Introduction.v
1 Scope.1
1.1 Characteristics.1
1.2 Level of evaluation .1
1.3 Technique.1
1.4 Applicability .2
2 Conformance .2
3 Normative references.2
4 Terms and definitions .3
5 Inputs and measures.3
5.1 Evaluation methodology.3
5.1.1 Practical considerations relating to the methodology .5
5.1.2 Disturbances.5
5.2 Input for the evaluation.8
5.2.1 The SUT description.8
5.2.2 The workload description.9
5.2.3 The fault load description.10
5.3 Data elements .11
5.3.1 Output from the baseline run .11
5.3.2 Output from the test run .11
5.3.3 Completion of the Autonomic Maturity Questionnaire.12
5.4 Quality Measures.12
5.4.1 Summary of the Quality Measures and Quality Measure Elements (QME) .12
5.4.2 Quality Measure - Resiliency.12
5.4.3 Quality Measure - Autonomic Recovery Index.13
5.4.4 Quality Measure Element (QME) - Number of transactions under disturbance.15
5.4.5 Quality Measure Element (QME) - Number of transactions under no disturbance .16
5.4.6 Quality Measure Element (QME) - Autonomic Maturity Score.16
6 Interpretation of results .17
6.1 Mapping of measures.17
6.2 Reporting.17
6.3 Application Procedure .17
Annex A (informative) Sample Report .18
Bibliography.37
© ISO/IEC 2010 – All rights reserved iii
Foreword
ISO (the International Organization for Standardization) and IEC (the International Electrotechnical
Commission) form the specialized system for worldwide standardization. National bodies that are members of
ISO or IEC participate in the development of International Standards through technical committees
established by the respective organization to deal with particular fields of technical activity. ISO and IEC
technical committees collaborate in fields of mutual interest. Other international organizations, governmental
and non-governmental, in liaison with ISO and IEC, also take part in the work. In the field of information
technology, ISO and IEC have established a joint technical committee, ISO/IEC JTC 1.
International Standards are drafted in accordance with the rules given in the ISO/IEC Directives, Part 2.
The main task of the joint technical committee is to prepare International Standards. Draft International
Standards adopted by the joint technical committee are circulated to national bodies for voting. Publication as
an International Standard requires approval by at least 75 % of the national bodies casting a vote.
Attention is drawn to the possibility that some of the elements of this document may be the subject of patent
rights. ISO and IEC shall not be held responsible for identifying any or all such patent rights.
ISO/IEC 25045 was prepared by Joint Technical Committee ISO/IEC JTC 1, Information technology,
Subcommittee SC 7, Software and systems engineering.
ISO/IEC 25045 is one of the SQuaRE series of International Standards, which consists of the following
divisions under the general title Systems and software engineering — Systems and software Quality
Requirements and Evaluation (SQuaRE):
• Quality Management Division (ISO/IEC 2500n),
• Quality Model Division (ISO/IEC 2501n),
• Quality Measurement Division (ISO/IEC 2502n),
• Quality Requirements Division (ISO/IEC 2503n),
• Quality Evaluation Division (ISO/IEC 2504n).
iv © ISO/IEC 2010 – All rights reserved
Introduction
The evaluation of software product quality is vital to both the acquisition and development of software that
meets quality requirements. The relative importance of the various characteristics of software quality depends
on the mission or objectives of the system of which it is a part; software products need to be evaluated to
decide whether relevant quality characteristics meet the requirements of the system.
The essential parts of software quality evaluation are a quality model, the method of evaluation, software
measurement, and supporting tools. To develop good software, quality requirements should be specified, the
software quality assurance process should be planned, implemented and controlled, and both intermediate
products and end products should be evaluated.
This International Standard is part of the SQuaRE series of International Standards. It contains general
requirements for specification and evaluation of systems and software quality and clarifies the associated
general concepts. It provides a framework for evaluating the quality of software products and states the
requirements for methods of software product measurement and evaluation.
The general goal of creating the SQuaRE series of International Standards is to move to a logically organized,
enriched and unified series covering two main processes: software quality requirements specification and
software quality evaluation, supported by a software quality measurement process. The purpose of the
SQuaRE series of International Standards is to assist those developing and acquiring software products with
the specification and evaluation of quality requirements. It establishes criteria for the specification of systems
and software quality requirements, their measurement, and evaluation. It includes a two-part quality model for
aligning customer definitions of quality with attributes of the development process. In addition, the series
provides recommended measures of software product quality attributes that can be used by developers,
acquirers, and evaluators.
SQuaRE provides
• terms and definitions,
• reference models,
• a general guide,
• individual division guides, and
• International Standards for requirements specification, planning and management, measurement and
evaluation purposes.
SQuaRE includes International Standards on quality model and measures, as well as on quality requirements
and evaluation.
SQuaRE replaces the current ISO/IEC 9126 series and the ISO/IEC 14598 series.
ISO/IEC 25040, Systems and software engineering — Systems and software Quality Requirements and
Evaluation (SQuaRE) — Evaluation reference model and guide will replace a part of ISO/IEC 14598-1,
Information technology — Software product evaluation — Part 1: General overview.
ISO/IEC 25041, Systems and software engineering — Systems and software Quality Requirements and
Evaluation (SQuaRE) — Evaluation modules will replace ISO/IEC 14598-6, Software engineering — Product
evaluation — Documentation of evaluation modules.
ISO/IEC 25001, Software engineering — Software product Quality Requirements and Evaluation
(SQuaRE) — Planning and management replaces ISO/IEC 14598-2, Software engineering — Product
evaluation — Part 2: Planning and management.
© ISO/IEC 2010 – All rights reserved v
Quality Model
Division
2501n
Quality
Quality
Quality
Evaluation
Management Division
Requirements
Division
Division
2500n
2504n
2503n
Quality
Measurement Division
2502n
Figure 1 – Organization of the SQuaRE series of International Standards
Figure 1 illustrates the organization of the SQuaRE series, representing families of standards, also called
divisions.
The divisions within SQuaRE model are:
• ISO/IEC 2500n - Quality Management Division. The International Standards that form this division
define all common models, terms and definitions further referred to by all other International Standards
from the SQuaRE series. Referring paths (guidance through SQuaRE documents) and high level practical
suggestions in applying proper standards to specific application cases offer help to all types of users. The
division also provides requirements and guidance for a supporting function which is responsible for the
management of software product requirements specification and evaluation.
• ISO/IEC 2501n - Quality Model Division. The International Standard that forms this division presents a
detailed quality model including internal, external and quality in use characteristics. Furthermore, the
internal and external software quality characteristics are decomposed into sub-characteristics. Practical
guidance on the use of the quality model is also provided.
• ISO/IEC 2502n - Quality Measurement Division. The International Standards that form this division
include a software product quality measurement reference model, mathematical definitions of quality
measures, and practical guidance for their application. Presented measures apply to internal software
quality, external software quality and quality in use. Measurement primitives forming foundations for the
latter measures are defined and presented.
• ISO/IEC 2503n - Quality Requirements Division. The International Standard that forms this division
helps in specifying quality requirements. These quality requirements can be used in the proc
...
Questions, Comments and Discussion
Ask us and Technical Secretary will try to provide an answer. You can facilitate discussion about the standard in here.