prEN ISO/IEC 25059

Software engineering - Systems and software Quality Requirements and Evaluation (SQuaRE) - Quality model for AI systems (ISO/IEC 25059:2023)

This document outlines a quality model for AI systems and is an application-specific extension to the standards on SQuaRE. The characteristics and sub-characteristics detailed in the model provide consistent terminology for specifying, measuring and evaluating AI system quality. The characteristics and sub-characteristics detailed in the model also provide a set of quality characteristics against which stated quality requirements can be compared for completeness.

System- und Software-Engineering - Qualitätskriterien und Bewertung von Systemen und Softwareprodukten (SQuaRE) - Qualitätsmodell für KI-Systeme (ISO/IEC 25059:2023)

Ingénierie des systèmes et des logiciels - Critères de qualité et évaluation des systèmes et des produits logiciels (SQuaRE) - Modèle de qualité pour les systèmes d’IA (ISO/IEC 25059:2023)

Programsko inženirstvo - Zahteve za kakovost in vrednotenje sistemov in programske opreme (SQuaRE) - Model kakovosti za sisteme UI (ISO/IEC 25059:2023)

General Information

• Status: Not Published
• Publication Date: 03-May-2026
• ICS: 35.080 - Software
• Technical Committee: CEN/CLC/JTC 21 - Artificial Intelligence
• Current Stage: 4060 - Closure of enquiry - Enquiry
• Start Date: 27-Jun-2024
• Due Date: 28-Jan-2025
• Completion Date: 27-Jun-2024
• Ref Project: oSIST prEN ISO/IEC 25059:2024 - Software engineering - Systems and software Quality Requirements and Evaluation (SQuaRE) - Quality model for AI systems (ISO/IEC 25059:2023)

Standards Content (Sample)

SLOVENSKI STANDARD
01-junij-2024
Programsko inženirstvo - Zahteve za kakovost in vrednotenje sistemov in
programske opreme (SQuaRE) - Model kakovosti za sisteme UI (ISO/IEC
25059:2023)
Software engineering - Systems and software Quality Requirements and Evaluation
(SQuaRE) - Quality model for AI systems (ISO/IEC 25059:2023)
System- und Software-Engineering - Qualitätskriterien und Bewertung von Systemen
und Softwareprodukten (SQuaRE) - Qualitätsmodell für KI-Systeme (ISO/IEC
25059:2023)
Ingénierie des systèmes et des logiciels - Critères de qualité et évaluation des systèmes
et des produits logiciels (SQuaRE) - Modèle de qualité pour les systèmes d’IA (ISO/IEC
25059:2023)
Ta slovenski standard je istoveten z: prEN ISO/IEC 25059
ICS:
35.080 Programska oprema Software
2003-01.Slovenski inštitut za standardizacijo. Razmnoževanje celote ali delov tega standarda ni dovoljeno.

INTERNATIONAL ISO/IEC
STANDARD 25059
First edition
2023-06
Software engineering — Systems and
software Quality Requirements and
Evaluation (SQuaRE) — Quality model
for AI systems
Reference number
ISO/IEC 25059:2023(E)
© ISO/IEC 2023
ISO/IEC 25059:2023(E)
© ISO/IEC 2023
All rights reserved. Unless otherwise specified, or required in the context of its implementation, no part of this publication may
be reproduced or utilized otherwise in any form or by any means, electronic or mechanical, including photocopying, or posting on
the internet or an intranet, without prior written permission. Permission can be requested from either ISO at the address below
or ISO’s member body in the country of the requester.
ISO copyright office
CP 401 • Ch. de Blandonnet 8
CH-1214 Vernier, Geneva
Phone: [phone]
Email: [e-mail]
Website: www.iso.org
Published in Switzerland
ii
© ISO/IEC 2023 – All rights reserved

ISO/IEC 25059:2023(E)
Contents Page
Foreword .iv
Introduction .v
1 Scope . 1
2 Normative references . 1
3 Terms and definitions . 1
3.1 General . 1
3.2 Product quality . 2
3.3 Quality in use . 3
4 Abbreviated terms . 3
5 Product quality model .3
5.1 General . 3
5.2 User controllability . 4
5.3 Functional adaptability. 4
5.4 Functional correctness . 4
5.5 Robustness . 4
5.6 Transparency . 5
5.7 Intervenability . 5
6 Quality in use model .6
6.1 General . 6
6.2 Societal and ethical risk mitigation . 6
6.3 Transparency . 7
Annex A (informative) SQuaRE. 8
Annex B (informative) How a risk-based approach relates to a quality-based approach and
quality models .10
Annex C (informative) Performance .13
Bibliography .14
iii
© ISO/IEC 2023 – All rights reserved

ISO/IEC 25059:2023(E)
Foreword
ISO (the International Organization for Standardization) and IEC (the International Electrotechnical
Commission) form the specialized system for worldwide standardization. National bodies that are
members of ISO or IEC participate in the development of International Standards through technical
committees established by the respective organization to deal with particular fields of technical
activity. ISO and IEC technical committees collaborate in fields of mutual interest. Other international
organizations, governmental and non-governmental, in liaison with ISO and IEC, also take part in the
work.
The procedures used to develop this document and those intended for its further maintenance
are described in the ISO/IEC Directives, Part 1. In particular, the different approval criteria
needed for the different types of document should be noted. This document was drafted in
accordance with the editorial rules of the ISO/IEC Directives, Part 2 (see www.iso.org/directives or
www.iec.ch/members_experts/refdocs).
ISO and IEC draw attention to the possibility that the implementation of this document may involve the
use of (a) patent(s). ISO and IEC take no position concerning the evidence, validity or applicability of
any claimed patent rights in respect thereof. As of the date of publication of this document, ISO and IEC
had not received notice of (a) patent(s) which may be required to implement this document. However,
implementers are cautioned that this may not represent the latest information, which may be obtained
from the patent database available at www.iso.org/patents and https://patents.iec.ch. ISO and IEC shall
not be held responsible for identifying any or all such patent rights.
Any trade name used in this document is information given for the convenience of users and does not
constitute an endorsement.
For an explanation of the voluntary nature of standards, the meaning of ISO specific terms and
expressions related to conformity assessment, as well as information about ISO's adherence to
the World Trade Organization (WTO) principles in the Technical Barriers to Trade (TBT) see
www.iso.org/iso/foreword.html. In the IEC, see www.iec.ch/understanding-standards.
This document was prepared by Joint Technical Committee ISO/IEC JTC 1, Information technology,
Subcommittee SC 42, Artificial intelligence.
Any feedback or questions on this document should be directed to the user’s national standards
body. A complete listing of these bodies can be found at www.iso.org/members.html and
www.iec.ch/national-committees.
iv
© ISO/IEC 2023 – All rights reserved

ISO/IEC 25059:2023(E)
Introduction
High-quality software products and computer systems are crucial to stakeholders. Quality models,
quality requirements, quality measurement, and quality evaluation are standardized within the
International Standards on SQuaRE, see Annex A for further information.
AI systems require additional properties and characteristics of systems to be considered, and
stakeholders have varied needs. AI systems have different properties and characteristics. For example,
AI systems can:
— replace human decision-making;
— be based on noisy, or incomplete data;
— be probabilistic;
— adapt during operation.
[2]
According to ISO/IEC TR 24028, trustworthiness has been understood and treated as both an ongoing
organizational process as well as a non-functional requirement specifying emergent properties of a
system — that is, a set of inherent characteristics with their attributes — within the context of quality
of use as indicated in ISO/IEC 25010.
ISO/IEC TR 24028 discusses the applicability to AI systems of that have been developed for conventional
software. According to ISO/IEC TR 24028, does not sufficiently address the data-driven unpredictable
nature of AI systems. While considering the existing body of work, ISO/IEC TR 24028 identifies the
need for developing new International Standards for AI systems that can go beyond the characteristics
and requirements of conventional software development.
ISO/IEC TR 24028 contains a related discussion on different approaches to testing and evaluation
of AI systems. It states that for testing of an AI system, modified versions of existing software and
hardware verification and validation techniques are needed. It identifies several conceptual differences
between many AI systems and conventional systems and concludes that “the ability of the [AI] system
to achieve the planned and desired result … may not always be measurable by conventional approaches
[3]
to software testing”. Testing of AI systems is addressed in ISO/IEC TR 29119-11:2020.
This document outlines an application-specific AI system extension to the SQuaRE quality model
specified in ISO/IEC 25010.
AI systems perform tasks. One or more tasks can be defined for an AI system. Quality requirements can
be specified for the evaluation of task fulfilment.
The quality model is considered from two perspectives, product quality as described in Clause 5 and
quality in use in Clause 6. The relevance of these terms is explained, and links to other standardization
[4][5]
deliverables (e.g. the ISO/IEC 24029 series ) are highlighted.
[6]
ISO/IEC 25012:2008 contains a model for data quality that is complementary to the model defined in
[7]
this document. ISO/IEC 25012:2008 is being extended for AI systems by the ISO/IEC 5259 series.
v
© ISO/IEC 2023 – All rights reserved

INTERNATIONAL STANDARD ISO/IEC 25059:2023(E)
Software engineering — Systems and software Quality
Requirements and Evaluation (SQuaRE) — Quality model
for AI systems
1 Scope
This document outlines a quality model for AI systems and is an application-specific extension to
the standards on SQuaRE. The characteristics and sub-characteristics detailed in the model provide
consistent terminology for specifying, measuring and evaluating AI system quality. The characteristics
and sub-characteristics detailed in the model also provide a set of quality characteristics against which
stated quality requirements can be compared for completeness.
2 Normative references
The following documents are referred to in the text in such a way that some or all of their content
constitutes requirements of this document. For dated references, only the edition cited applies. For
undated references, the latest edition of the referenced document (including any amendments) applies.
ISO/IEC 25010:2011, Systems and software engineering — Systems and software Quality Requirements
and Evaluation (SQuaRE) — System and software quality models
ISO/IEC 22989:2022, Information technology — Artificial intelligence — Artificial intelligence concepts
and terminology
ISO/IEC 23053:2022, Framework for Artificial Intelligence (AI) Systems Using Machine Learning (ML)
3 Terms and definitions
For the purposes of this document, the term
...

SLOVENSKI STANDARD
01-junij-2024
Programska oprema - Zahteve za kakovost in vrednotenje sistemov in programske
opreme (SQuaRE) - Model kakovosti za sisteme UI (ISO/IEC 25059:2023)
Software engineering - Systems and software Quality Requirements and Evaluation
(SQuaRE) - Quality model for AI systems (ISO/IEC 25059:2023)
System- und Software-Engineering - Qualitätskriterien und Bewertung von Systemen
und Softwareprodukten (SQuaRE) - Qualitätsmodell für KI-Systeme (ISO/IEC
25059:2023)
Ingénierie des systèmes et des logiciels - Critères de qualité et évaluation des systèmes
et des produits logiciels (SQuaRE) - Modèle de qualité pour les systèmes d’IA (ISO/IEC
25059:2023)
Ta slovenski standard je istoveten z: prEN ISO/IEC 25059
ICS:
35.080 Programska oprema Software
2003-01.Slovenski inštitut za standardizacijo. Razmnoževanje celote ali delov tega standarda ni dovoljeno.

INTERNATIONAL ISO/IEC
STANDARD 25059
First edition
2023-06
Software engineering — Systems and
software Quality Requirements and
Evaluation (SQuaRE) — Quality model
for AI systems
Reference number
ISO/IEC 25059:2023(E)
© ISO/IEC 2023
ISO/IEC 25059:2023(E)
© ISO/IEC 2023
All rights reserved. Unless otherwise specified, or required in the context of its implementation, no part of this publication may
be reproduced or utilized otherwise in any form or by any means, electronic or mechanical, including photocopying, or posting on
the internet or an intranet, without prior written permission. Permission can be requested from either ISO at the address below
or ISO’s member body in the country of the requester.
ISO copyright office
CP 401 • Ch. de Blandonnet 8
CH-1214 Vernier, Geneva
Phone: [phone]
Email: [e-mail]
Website: www.iso.org
Published in Switzerland
ii
© ISO/IEC 2023 – All rights reserved

ISO/IEC 25059:2023(E)
Contents Page
Foreword .iv
Introduction .v
1 Scope . 1
2 Normative references . 1
3 Terms and definitions . 1
3.1 General . 1
3.2 Product quality . 2
3.3 Quality in use . 3
4 Abbreviated terms . 3
5 Product quality model .3
5.1 General . 3
5.2 User controllability . 4
5.3 Functional adaptability. 4
5.4 Functional correctness . 4
5.5 Robustness . 4
5.6 Transparency . 5
5.7 Intervenability . 5
6 Quality in use model .6
6.1 General . 6
6.2 Societal and ethical risk mitigation . 6
6.3 Transparency . 7
Annex A (informative) SQuaRE. 8
Annex B (informative) How a risk-based approach relates to a quality-based approach and
quality models .10
Annex C (informative) Performance .13
Bibliography .14
iii
© ISO/IEC 2023 – All rights reserved

ISO/IEC 25059:2023(E)
Foreword
ISO (the International Organization for Standardization) and IEC (the International Electrotechnical
Commission) form the specialized system for worldwide standardization. National bodies that are
members of ISO or IEC participate in the development of International Standards through technical
committees established by the respective organization to deal with particular fields of technical
activity. ISO and IEC technical committees collaborate in fields of mutual interest. Other international
organizations, governmental and non-governmental, in liaison with ISO and IEC, also take part in the
work.
The procedures used to develop this document and those intended for its further maintenance
are described in the ISO/IEC Directives, Part 1. In particular, the different approval criteria
needed for the different types of document should be noted. This document was drafted in
accordance with the editorial rules of the ISO/IEC Directives, Part 2 (see www.iso.org/directives or
www.iec.ch/members_experts/refdocs).
ISO and IEC draw attention to the possibility that the implementation of this document may involve the
use of (a) patent(s). ISO and IEC take no position concerning the evidence, validity or applicability of
any claimed patent rights in respect thereof. As of the date of publication of this document, ISO and IEC
had not received notice of (a) patent(s) which may be required to implement this document. However,
implementers are cautioned that this may not represent the latest information, which may be obtained
from the patent database available at www.iso.org/patents and https://patents.iec.ch. ISO and IEC shall
not be held responsible for identifying any or all such patent rights.
Any trade name used in this document is information given for the convenience of users and does not
constitute an endorsement.
For an explanation of the voluntary nature of standards, the meaning of ISO specific terms and
expressions related to conformity assessment, as well as information about ISO's adherence to
the World Trade Organization (WTO) principles in the Technical Barriers to Trade (TBT) see
www.iso.org/iso/foreword.html. In the IEC, see www.iec.ch/understanding-standards.
This document was prepared by Joint Technical Committee ISO/IEC JTC 1, Information technology,
Subcommittee SC 42, Artificial intelligence.
Any feedback or questions on this document should be directed to the user’s national standards
body. A complete listing of these bodies can be found at www.iso.org/members.html and
www.iec.ch/national-committees.
iv
© ISO/IEC 2023 – All rights reserved

ISO/IEC 25059:2023(E)
Introduction
High-quality software products and computer systems are crucial to stakeholders. Quality models,
quality requirements, quality measurement, and quality evaluation are standardized within the
International Standards on SQuaRE, see Annex A for further information.
AI systems require additional properties and characteristics of systems to be considered, and
stakeholders have varied needs. AI systems have different properties and characteristics. For example,
AI systems can:
— replace human decision-making;
— be based on noisy, or incomplete data;
— be probabilistic;
— adapt during operation.
[2]
According to ISO/IEC TR 24028, trustworthiness has been understood and treated as both an ongoing
organizational process as well as a non-functional requirement specifying emergent properties of a
system — that is, a set of inherent characteristics with their attributes — within the context of quality
of use as indicated in ISO/IEC 25010.
ISO/IEC TR 24028 discusses the applicability to AI systems of that have been developed for conventional
software. According to ISO/IEC TR 24028, does not sufficiently address the data-driven unpredictable
nature of AI systems. While considering the existing body of work, ISO/IEC TR 24028 identifies the
need for developing new International Standards for AI systems that can go beyond the characteristics
and requirements of conventional software development.
ISO/IEC TR 24028 contains a related discussion on different approaches to testing and evaluation
of AI systems. It states that for testing of an AI system, modified versions of existing software and
hardware verification and validation techniques are needed. It identifies several conceptual differences
between many AI systems and conventional systems and concludes that “the ability of the [AI] system
to achieve the planned and desired result … may not always be measurable by conventional approaches
[3]
to software testing”. Testing of AI systems is addressed in ISO/IEC TR 29119-11:2020.
This document outlines an application-specific AI system extension to the SQuaRE quality model
specified in ISO/IEC 25010.
AI systems perform tasks. One or more tasks can be defined for an AI system. Quality requirements can
be specified for the evaluation of task fulfilment.
The quality model is considered from two perspectives, product quality as described in Clause 5 and
quality in use in Clause 6. The relevance of these terms is explained, and links to other standardization
[4][5]
deliverables (e.g. the ISO/IEC 24029 series ) are highlighted.
[6]
ISO/IEC 25012:2008 contains a model for data quality that is complementary to the model defined in
[7]
this document. ISO/IEC 25012:2008 is being extended for AI systems by the ISO/IEC 5259 series.
v
© ISO/IEC 2023 – All rights reserved

INTERNATIONAL STANDARD ISO/IEC 25059:2023(E)
Software engineering — Systems and software Quality
Requirements and Evaluation (SQuaRE) — Quality model
for AI systems
1 Scope
This document outlines a quality model for AI systems and is an application-specific extension to
the standards on SQuaRE. The characteristics and sub-characteristics detailed in the model provide
consistent terminology for specifying, measuring and evaluating AI system quality. The characteristics
and sub-characteristics detailed in the model also provide a set of quality characteristics against which
stated quality requirements can be compared for completeness.
2 Normative references
The following documents are referred to in the text in such a way that some or all of their content
constitutes requirements of this document. For dated references, only the edition cited applies. For
undated references, the latest edition of the referenced document (including any amendments) applies.
ISO/IEC 25010:2011, Systems and software engineering — Systems and software Quality Requirements
and Evaluation (SQuaRE) — System and software quality models
ISO/IEC 22989:2022, Information technology — Artificial intelligence — Artificial intelligence concepts
and terminology
ISO/IEC 23053:2022, Framework for Artificial Intelligence (AI) Systems Using Machine Learning (ML)
3 Terms and definitions
For the purposes of this document, the terms and
...