ISO/IEC TS 25058:2024

Systems and software engineering — Systems and software Quality Requirements and Evaluation (SQuaRE) — Guidance for quality evaluation of artificial intelligence (AI) systems

This document provides guidance for evaluation of artificial intelligence (AI) systems using an AI system quality model. The document is applicable to all types of organizations engaged in the development and use of AI.

Ingénierie des systèmes et des logiciels — Exigences et évaluation de la qualité des systèmes et des logiciels (SQuaRE) — Lignes directrices pour l'évaluation de la qualité des systèmes d'intelligence artificielle (IA)

General Information

• Status: Published
• Publication Date: 23-Jan-2024
• ICS: 35.080 - Software
• Technical Committee: ISO/IEC JTC 1/SC 42 - Artificial intelligence
• Drafting Committee: ISO/IEC JTC 1/SC 42 - Artificial intelligence
• Current Stage: 9092 - International Standard to be revised
• Start Date: 28-Jul-2025
• Completion Date: 02-Aug-2025

Standards Content (Sample)

Technical
Specification
ISO/IEC TS 25058
First edition
Systems and software
2024-01
engineering — Systems and
software Quality Requirements and
Evaluation (SQuaRE) — Guidance
for quality evaluation of artificial
intelligence (AI) systems
Ingénierie des systèmes et des logiciels — Exigences et évaluation
de la qualité des systèmes et des logiciels (SQuaRE) — Lignes
directrices pour l'évaluation de la qualité des systèmes
d'intelligence artificielle (IA)
Reference number
© ISO/IEC 2024
All rights reserved. Unless otherwise specified, or required in the context of its implementation, no part of this publication may
be reproduced or utilized otherwise in any form or by any means, electronic or mechanical, including photocopying, or posting on
the internet or an intranet, without prior written permission. Permission can be requested from either ISO at the address below
or ISO’s member body in the country of the requester.
ISO copyright office
CP 401 • Ch. de Blandonnet 8
CH-1214 Vernier, Geneva
Phone: [phone]
Email: [e-mail]
Website: www.iso.org
Published in Switzerland
© ISO/IEC 2024 – All rights reserved
ii
Contents Page
Foreword .v
Introduction .vi
1 Scope . 1
2 Normative references . 1
3 Terms and definitions . 1
4 Overview . 1
5 Quality evaluation methodology . 3
6 Functional suitability . 3
6.1 Functional completeness .3
6.2 Functional correctness .3
6.3 Functional appropriateness .4
6.4 Functional adaptability.5
7 Performance efficiency . 5
7.1 Time behaviour .5
7.2 Resource utilization .5
7.3 Capacity .6
8 Compatibility . 6
8.1 Co-existence .6
8.2 Interoperability.6
9 Usability . 6
9.1 Appropriateness recognizability . .6
9.2 Learnability .6
9.3 Operability .7
9.4 User error protection .7
9.5 User interface aesthetics .7
9.6 Accessibility .7
9.7 User controllability .8
9.8 Transparency .8
10 Reliability . 9
10.1 Maturity .9
10.2 Availability .9
10.3 Fault tolerance .9
10.4 Recoverability .9
10.5 Robustness .9
11 Security . 10
11.1 Confidentiality .10
11.2 Integrity .10
11.3 Non-repudiation .11
11.4 Accountability .11
11.5 Authenticity . .11
11.6 Intervenability .11
12 Maintainability .11
12.1 Modularity .11
12.2 Reusability . .11
12.3 Analysability. 12
12.4 Modifiability . 12
12.5 Testability . 12
13 Portability .12
13.1 Adaptability . 12

© ISO/IEC 2024 – All rights reserved
iii
13.2 Installability . 12
13.3 Replaceability . 12
14 Effectiveness .13
15 Efficiency .13
16 Satisfaction .13
16.1 General . 13
16.2 Usefulness . 13
16.3 Trust . 13
16.4 Pleasure . 13
16.5 Comfort. 13
16.6 Transparency . 13
17 Freedom from risk .
...