SIST-TP EN ISO/IEC/TR 24027:2025

Information technology - Artificial intelligence (AI) - Bias in AI systems and AI aided decision making (ISO/IEC TR 24027:2021)

This document addresses bias in relation to AI systems, especially with regards to AI-aided decision-making. Measurement techniques and methods for assessing bias are described, with the aim to address and treat bias-related vulnerabilities. All AI system lifecycle phases are in scope, including but not limited to data collection, training, continual learning, design, testing, evaluation and use.

Künstliche Intelligenz (KI) - Bias in KI-Systemen und KI-gestützter Entscheidungsfindung (ISO/IEC TR 24027:2021)

Technologie de l'information - Intelligence artificielle (IA) - Biais dans les systèmes d’IA et dans la prise de décision assistée par IA (ISO/IEC TR 24027:2021)

Informacijska tehnologija - Umetna inteligenca (UI) - Pristranskost v sistemih UI in odločanje, podprto z UI (ISO/IEC TR 24027:2021)

General Information

• Status: Published
• Public Enquiry End Date: 13-Nov-2023
• Publication Date: 16-Jun-2025
• ICS: 35.020 - Information technology (IT) in general
• Technical Committee: UMI - Artificial intelligence
• Current Stage: 6060 - National Implementation/Publication (Adopted Project)
• Start Date: 20-May-2025
• Due Date: 25-Jul-2025
• Completion Date: 17-Jun-2025
• Ref Project: CEN/CLC ISO/IEC/TR 24027:2023 - Information technology - Artificial intelligence (AI) - Bias in AI systems and AI aided decision making (ISO/IEC TR 24027:2021)

Standards Content (Sample)

SLOVENSKI STANDARD
01-julij-2025
Informacijska tehnologija - Umetna inteligenca (UI) - Pristranskost v sistemih UI in
odločanje, podprto z UI (ISO/IEC TR 24027:2021)
Information technology - Artificial intelligence (AI) - Bias in AI systems and AI aided
decision making (ISO/IEC TR 24027:2021)
Künstliche Intelligenz (KI) - Bias in KI-Systemen und KI-gestützter Entscheidungsfindung
(ISO/IEC TR 24027:2021)
Technologie de l'information - Intelligence artificielle (IA) - Biais dans les systèmes d’IA
et dans la prise de décision assistée par IA (ISO/IEC TR 24027:2021)
Ta slovenski standard je istoveten z: CEN/CLC ISO/IEC/TR 24027:2023
ICS:
35.020 Informacijska tehnika in Information technology (IT) in
tehnologija na splošno general
2003-01.Slovenski inštitut za standardizacijo. Razmnoževanje celote ali delov tega standarda ni dovoljeno.

TECHNICAL REPORT CEN/CLC ISO/IEC/TR
RAPPORT TECHNIQUE
TECHNISCHER REPORT
December 2023
ICS 35.020
English version
Information technology - Artificial intelligence (AI) - Bias
in AI systems and AI aided decision making (ISO/IEC TR
24027:2021)
Technologie de l'information - Intelligence artificielle Künstliche Intelligenz (KI) - Bias in KI-Systemen und
(IA) - Biais dans les systèmes d'IA et dans la prise de KI-gestützter Entscheidungsfindung (ISO/IEC TR
décision assistée par IA (ISO/IEC TR 24027:2021) 24027:2021)

This Technical Report was approved by CEN on 17 December 2023. It has been drawn up by the Technical Committee
CEN/CLC/JTC 21.
CEN and CENELEC members are the national standards bodies and national electrotechnical committees of Austria, Belgium,
Bulgaria, Croatia, Cyprus, Czech Republic, Denmark, Estonia, Finland, France, Germany, Greece, Hungary, Iceland, Ireland, Italy,
Latvia, Lithuania, Luxembourg, Malta, Netherlands, Norway, Poland, Portugal, Republic of North Macedonia, Romania, Serbia,
Slovakia, Slovenia, Spain, Sweden, Switzerland, Türkiye and United Kingdom.

CEN-CENELEC Management Centre:
Rue de la Science 23, B-1040 Brussels
© 2023 CEN/CENELEC All rights of exploitation in any form and by any means
Ref. No. CEN/CLC ISO/IEC/TR 24027:2023 E
reserved worldwide for CEN national Members and for
CENELEC Members.
Contents Page
European foreword . 3

European foreword
The text of ISO/IEC TR 24027:2021 has been prepared by Technical Committee ISO/IEC JTC 1
"Information technology” of the International Organization for Standardization (ISO) and has been
taken over as CEN/CLC ISO/IEC/TR 24027:2023 by Technical Committee CEN-CENELEC/ JTC 21
“Artificial Intelligence” the secretariat of which is held by DS.
Attention is drawn to the possibility that some of the elements of this document may be the subject of
patent rights. CEN-CENELEC shall not be held responsible for identifying any or all such patent rights.
Any feedback and questions on this document should be directed to the users’ national standards body.
A complete listing of these bodies can be found on the CEN and CENELEC websites.
Endorsement notice
The text of ISO/IEC TR 24027:2021 has been approved by CEN-CENELEC as
TECHNICAL ISO/IEC TR
REPORT 24027
First edition
2021-11
Information technology — Artificial
intelligence (AI) — Bias in AI systems
and AI aided decision making
Technologie de l'information — Intelligence artificielle (IA) —
Tendance dans les systèmes de l'IA et dans la prise de décision assistée
par l'IA
Reference number
ISO/IEC TR 24027:2021(E)
© ISO/IEC 2021
ISO/IEC TR 24027:2021(E)
© ISO/IEC 2021
All rights reserved. Unless otherwise specified, or required in the context of its implementation, no part of this publication may
be reproduced or utilized otherwise in any form or by any means, electronic or mechanical, including photocopying, or posting on
the internet or an intranet, without prior written permission. Permission can be requested from either ISO at the address below
or ISO’s member body in the country of the requester.
ISO copyright office
CP 401 • Ch. de Blandonnet 8
CH-1214 Vernier, Geneva
Phone: [phone]
Email: [e-mail]
Website: www.iso.org
Published in Switzerland
ii
© ISO/IEC 2021 – All rights reserved

ISO/IEC TR 24027:2021(E)
Contents Page
Foreword .v
Introduction . vi
1 Scope . 1
2 Normative references . 1
3 Terms and definitions . 1
3.1 Artificial intelligence . 1
3.2 Bias . 2
4 Abbreviations . 3
5 Overview of bias and fairness . 3
5.1 General . 3
5.2 Overview of bias . 3
5.3 Overview of fairness. 5
6 Sources of unwanted bias in AI systems . 6
6.1 General . 6
6.2 Human cognitive biases. 7
6.2.1 General . 7
6.2.2 Automation bias . 7
6.2.3 Group attribution bias . 8
6.2.4 Implicit bias . . 8
6.2.5 Confirmation bias . 8
6.2.6 In-group bias . 8
6.2.7 Out-group homogeneity bias . 8
6.2.8 Societal bias . 9
6.2.9 Rule-based system design . . 9
6.2.10 Requirements bias . 10
6.3 Data bias . 10
6.3.1 General . 10
6.3.2 Statistical bias. 10
6.3.3 Data labels and labelling process . 11
6.3.4 Non-representative sampling . 11
6.3.5 Missing features and labels . 11
6.3.6 Data processing .12
6.3.7 Simpson's paradox .12
6.3.8 Data aggregation . 12
6.3.9 Distributed training . 12
6.3.10 Other sources of data bias .12
6.4 Bias introduced by engineering decisions .12
6.4.1 General .12
6.4.2 Feature engineering .12
6.4.3 Algorithm selection .13
6.4.4 Hyperparameter tuning. 13
6.4.5 Informativeness . 14
6.4.6 Model bias . 14
6.4.7 Model interaction . 14
7 Assessment of bias and fairness in AI systems .14
7.1 General . 14
7.2 Confusion matrix . 15
7.3 Equalized odds . 16
7.4 Equality of opportunity . 16
7.5 Demographic parity .
...