ISO/IEC TS 25058:2024

Systems and software engineering — Systems and software Quality Requirements and Evaluation (SQuaRE) — Guidance for quality evaluation of artificial intelligence (AI) systems

This document provides guidance for evaluation of artificial intelligence (AI) systems using an AI system quality model. The document is applicable to all types of organizations engaged in the development and use of AI.

Ingénierie des systèmes et des logiciels — Exigences et évaluation de la qualité des systèmes et des logiciels (SQuaRE) — Lignes directrices pour l'évaluation de la qualité des systèmes d'intelligence artificielle (IA)

General Information

• Status: Published
• Publication Date: 23-Jan-2024
• ICS: 35.080 - Software
• Technical Committee: ISO/IEC JTC 1/SC 42 - Artificial intelligence
• Drafting Committee: ISO/IEC JTC 1/SC 42 - Artificial intelligence
• Current Stage: 6060 - International Standard published
• Start Date: 24-Jan-2024
• Due Date: 11-May-2024
• Completion Date: 24-Jan-2024

Standards Content (Sample)

FINAL
TECHNICAL ISO/IEC DTS
DRAFT
SPECIFICATION 25058
ISO/IEC JTC 1/SC 42
Systems and software engineering —
Secretariat: ANSI
Systems and software Quality
Voting begins on:
2023-09-28 Requirements and Evaluation
(SQuaRE) — Guidance for quality
Voting terminates on:
2023-11-23
evaluation of artificial intelligence
(AI) systems
RECIPIENTS OF THIS DRAFT ARE INVITED TO
SUBMIT, WITH THEIR COMMENTS, NOTIFICATION
OF ANY RELEVANT PATENT RIGHTS OF WHICH
THEY ARE AWARE AND TO PROVIDE SUPPOR TING
DOCUMENTATION.
IN ADDITION TO THEIR EVALUATION AS
Reference number
BEING ACCEPTABLE FOR INDUSTRIAL, TECHNO-
ISO/IEC DTS 25058:2023(E)
LOGICAL, COMMERCIAL AND USER PURPOSES,
DRAFT INTERNATIONAL STANDARDS MAY ON
OCCASION HAVE TO BE CONSIDERED IN THE
LIGHT OF THEIR POTENTIAL TO BECOME STAN-
DARDS TO WHICH REFERENCE MAY BE MADE IN
NATIONAL REGULATIONS. © ISO/IEC 2023

---------------------- Page: 1 ----------------------
ISO/IEC DTS 25058:2023(E)
FINAL
TECHNICAL ISO/IEC DTS
DRAFT
SPECIFICATION 25058
ISO/IEC JTC 1/SC 42
Systems and software engineering —
Secretariat: ANSI
Systems and software Quality
Voting begins on:
Requirements and Evaluation
(SQuaRE) — Guidance for quality
Voting terminates on:
evaluation of artificial intelligence
(AI) systems
COPYRIGHT PROTECTED DOCUMENT
© ISO/IEC 2023
All rights reserved. Unless otherwise specified, or required in the context of its implementation, no part of this publication may
be reproduced or utilized otherwise in any form or by any means, electronic or mechanical, including photocopying, or posting on
the internet or an intranet, without prior written permission. Permission can be requested from either ISO at the address below
or ISO’s member body in the country of the requester.
RECIPIENTS OF THIS DRAFT ARE INVITED TO
ISO copyright office
SUBMIT, WITH THEIR COMMENTS, NOTIFICATION
OF ANY RELEVANT PATENT RIGHTS OF WHICH
CP 401 • Ch. de Blandonnet 8
THEY ARE AWARE AND TO PROVIDE SUPPOR TING
CH-1214 Vernier, Geneva
DOCUMENTATION.
Phone: [phone]
IN ADDITION TO THEIR EVALUATION AS
Reference number
Email: [e-mail]
BEING ACCEPTABLE FOR INDUSTRIAL, TECHNO­
ISO/IEC DTS 25058:2023(E)
Website: www.iso.org
LOGICAL, COMMERCIAL AND USER PURPOSES,
DRAFT INTERNATIONAL STANDARDS MAY ON
Published in Switzerland
OCCASION HAVE TO BE CONSIDERED IN THE
LIGHT OF THEIR POTENTIAL TO BECOME STAN­
DARDS TO WHICH REFERENCE MAY BE MADE IN
ii
  © ISO/IEC 2023 – All rights reserved
NATIONAL REGULATIONS. © ISO/IEC 2023

---------------------- Page: 2 ----------------------
ISO/IEC DTS 25058:2023(E)
Contents Page
Foreword .v
Introduction . vi
1 Scope . 1
2 Normative references . 1
3 Terms and definitions . 1
4 Overview . 1
5 Quality evaluation methodology .3
6 Functional suitability . 3
6.1 Functional completeness . 3
6.2 Functional correctness . 3
6.3 Functional appropriateness . 4
6.4 Functional adaptability.
...

ISO/IEC WD TSDTS 25058:2023(X)
ISO/IEC JTC 1/SC 42/WG 3
Secretariat: ANSI
Date: 2023-06-2209-14
Systems and software engineering — Systems and software
Quality Requirements and Evaluation (SQuaRE) — Guidance for
quality evaluation of AIartificial intelligence (AI) systems

DTSFDIS stage

Warning for WDs and CDs
This document is not an ISO International Standard. It is distributed for review and comment. It is subject to
change without notice and may not be referred to as an International Standard.
Recipients of this draft are invited to submit, with their comments, notification of any relevant patent rights of
which they are aware and to provide supporting documentation.



© ISO 2023 – All rights reserved

---------------------- Page: 1 ----------------------
ISO #####-#:####(X)
© ISO 2023
2 © ISO #### – All rights reserved

---------------------- Page: 2 ----------------------
ISO/IEC DTS 25058:(E)
© ISO/IEC 2023
All rights reserved. Unless otherwise specified, or required in the context of its implementation, no part of this
publication may be reproduced or utilized otherwise in any form or by any means, electronic or mechanical,
including photocopying, or posting on the internet or an intranet, without prior written permission. Permission can
be requested from either ISO at the address below or ISO’s member body in the country of the requester.
ISO copyright office
CP 401 • Ch. de Blandonnet 8
CH-1214 Vernier, Geneva
Phone: + 41 22 749 01 11
EmailE-mail: [e-mail]
Website: www.iso.orgwww.iso.org
Published in Switzerland
© ISO/IEC 2023 – All rights reserved iii

---------------------- Page: 3 ----------------------
ISO/IEC DTS 25058:(E)
Contents
Foreword . vi
Introduction . vii
1 Scope . 1
2 Normative references . 1
3 Terms and definitions . 1
4 Overview . 2
5 Quality evaluation methodology. 4
6 Functional suitability . 4
6.1 Functional completeness . 4
6.2 Functional correctness . 4
6.3 Functional appropriateness. 5
6.4 Functional adaptability . 6
7 Performance efficiency . 6
7.1 Time behaviour . 6
7.2 Resource utilization . 7
7.3 Capacity . 7
8 Compatibility . 7
8.1 Co-existence .
...