Methods for Testing & Specification (MTS); AI Testing; Guidelines for Documentation of AI-enabled Systems

DTR/MTS-104119

General Information

Status
Not Published
Current Stage
12 - Citation in the OJ (auto-insert)
Due Date
30-Sep-2025
Completion Date
18-Sep-2025
Ref Project
Standard
ETSI TR 104 119 V1.1.1 (2025-09) - Methods for Testing & Specification (MTS); AI Testing; Guidelines for Documentation of AI-enabled Systems
English language
71 pages
sale 15% off
Preview
sale 15% off
Preview

Standards Content (Sample)


TECHNICAL REPORT
Methods for Testing & Specification (MTS);
AI Testing;
Guidelines for Documentation of
AI-enabled Systems
2 ETSI TR 104 119 V1.1.1 (2025-09)

Reference
DTR/MTS-104119
Keywords
AI, testing
ETSI
650 Route des Lucioles
F-06921 Sophia Antipolis Cedex - FRANCE

Tel.: +33 4 92 94 42 00  Fax: +33 4 93 65 47 16

Siret N° 348 623 562 00017 - APE 7112B
Association à but non lucratif enregistrée à la
Sous-Préfecture de Grasse (06) N° w061004871

Important notice
The present document can be downloaded from the
ETSI Search & Browse Standards application.
The present document may be made available in electronic versions and/or in print. The content of any electronic and/or
print versions of the present document shall not be modified without the prior written authorization of ETSI. In case of any
existing or perceived difference in contents between such versions and/or in print, the prevailing version of an ETSI
deliverable is the one made publicly available in PDF format on ETSI deliver repository.
Users should be aware that the present document may be revised or have its status changed,
this information is available in the Milestones listing.
If you find errors in the present document, please send your comments to
the relevant service listed under Committee Support Staff.
If you find a security vulnerability in the present document, please report it through our
Coordinated Vulnerability Disclosure (CVD) program.
Notice of disclaimer & limitation of liability
The information provided in the present deliverable is directed solely to professionals who have the appropriate degree of
experience to understand and interpret its content in accordance with generally accepted engineering or
other professional standard and applicable regulations.
No recommendation as to products and services or vendors is made or should be implied.
No representation or warranty is made that this deliverable is technically accurate or sufficient or conforms to any law
and/or governmental rule and/or regulation and further, no representation or warranty is made of merchantability or fitness
for any particular purpose or against infringement of intellectual property rights.
In no event shall ETSI be held liable for loss of profits or any other incidental or consequential damages.

Any software contained in this deliverable is provided "AS IS" with no warranties, express or implied, including but not
limited to, the warranties of merchantability, fitness for a particular purpose and non-infringement of intellectual property
rights and ETSI shall not be held liable in any event for any damages whatsoever (including, without limitation, damages
for loss of profits, business interruption, loss of information, or any other pecuniary loss) arising out of or related to the use
of or inability to use the software.
Copyright Notification
No part may be reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying and
microfilm except as authorized by written permission of ETSI.
The content of the PDF version shall not be modified without the written authorization of ETSI.
The copyright and the foregoing restriction extend to reproduction in all media.

© ETSI 2025.
All rights reserved.
ETSI
3 ETSI TR 104 119 V1.1.1 (2025-09)

Contents
Intellectual Property Rights . 6
Foreword . 6
Modal verbs terminology . 6
1 Scope . 7
2 References . 7
2.1 Normative references . 7
2.2 Informative references . 7
3 Definition of terms, symbols and abbreviations . 12
3.1 Terms . 12
3.2 Symbols . 14
3.3 Abbreviations . 14
4 Purpose of Documentation . 14
5 Motivation for a Harmonized Documentation Scheme . 16
5.1 Current AI Documentation Schemes . 16
5.2 Gaps to EU AI Act Requirements . 16
5.3 Summary . 17
6 Approach for Documenting AI-enabled Systems . 18
6.1 Overview . 18
6.2 Documentation items (what to document) . 18
6.3 Documentation stakeholders (roles) . 19
6.3.1 General . 19
6.3.2 Audience analysis . 20
6.3.3 Stakeholder categories and documentation requirements . 21
6.3.3.1 AI Provider . 21
6.3.3.2 AI Producer . 21
6.3.3.3 AI Customer . 22
6.3.3.4 AI Partner . 22
6.3.3.5 AI Subject . 22
6.3.3.6 Relevant Authorities. 22
6.4 AI-system life cycle. 23
6.5 Documentation Techniques for Effective Information Management . 25
6.5.1 General . 25
6.5.2 (Motivation and) Overview. 26
6.5.3 Questionnaires . 26
6.5.4 Information Sheets . 26
6.5.5 Checklists . 27
6.5.5 Templates . 27
6.5.6 White Papers . 27
6.5.7 Knowledge Graphs . 28
6.5.8 Visual Techniques (Diagrams, Flowcharts, Infographics) . 28
6.5.9 Interactive Techniques . 28
6.5.10 Domain-Specific Language (DSL) . 28
6.5.11 Summary . 29
6.6 Quality aspects of documentation. 31
6.6.1 General . 31
6.6.2 Correctness . 31
6.6.3 Consistency . 31
6.6.4 Comprehensibility . 31
6.6.5 Conciseness. 31
6.6.6 Minimalism . 31
6.6.7 Accessibility . 32
6.6.8 Systematic understanding . 32
6.7 Documentation Approach . 32
ETSI
4 ETSI TR 104 119 V1.1.1 (2025-09)

7 Guidance for EU AI Act Compliant Documentation . 33
7.1 Introduction to the EU AI Act . 33
7.2 Mapping of EU AI Act Stakeholder . 35
7.3 Documentation Guidance for High-Risk AI Systems . 36
7.3.1 General . 36
7.3.2 Risk Management System (Art. 9) . 37
7.3.3 Data and Data Governance (Art. 10) . 38
7.3.4 Record-Keeping (Art. 12) . 39
7.3.5 Transparency and Information to Deployers (Art. 13) . 40
7.3.6 Human Oversight (Art. 14) . 40
7.3.7 Accuracy, Robustness, and Cybersecurity (Art. 15) . 41
7.3.8 Technical Documentation (Art. 11) . 42
7.4 Documentation Requirements for GPAI models . 45
7.4.1 General . 45
7.4.2 GPAI Models without Systemic Risk . 45
7.4.3 GPAI Models with Systemic Risk . 45
7.4.4 Documentation . 46
Annex A: Sample Documentation Scenarios . 47
A.1 Healthcare Use Case . 47
A.1.1 Use Case Description . 47
A.1.2 Documentation Approach . 47
A.1.2.1 Key Documentation Requirements . 47
A.1.2.2 Example 1: General AI System Description . 47
A.1.2.3 Example 2: Design and Development Documentation . 49
A.2 AI-Based Person Detection for Construction Machinery . 52
A.2.1 Use Case Description . 52
A.2.2 Documentation Approach . 52
A.2.2.1 Key Documentation Requirements . 52
A.2.2.2 Example 1: General AI System Description . 52
A.2.2.3 Example 2: Data Documentation . 53
Annex B: Trustworthy AI: Definition and core characteristics . 55
B.1 Definition of Trustworthy AI . 55
B.2 Relevant frameworks and guidelines . 56
B.3 Operationalization of Trustworthiness in the EU AI Act . 57
Annex C: Risk Mitigation by Documentation . 58
Annex D: Documentation Schemes and Gap Analysis to the EU AI Act . 62
D.1 Data-Focused Documentation Approaches . 62
D.1.1 Datasheet for Datasets . 62
D.1.2 DescribeML . 62
D.1.3 Dataset Nutrition Label . 63
D.1.4 Data Cards . 63
D.1.5 Dataset Development Life Cycle Documentation Framework . 63
D.2 Model-And-Method-Focused Documentation Approaches . 64
D.2.1 Model Cards . 64
D.2.2 Method Card . 65
D.3 System-Focused Documentation Approaches . 65
D.3.1 FactSheets. 65
D.3.2 System Cards . 66
D.4 Domain Specific Documentation Approaches . 66
D.4.1 Model Facts Label . 66
D.4.2 Risk Cards . 66
D.4.3 Datasheet for Subjective and Objective Quality Assessment Datasets. 67
ETSI
5 ETSI TR 104 119 V1.1.1 (2025-09)

D.4.4 Assurance Cases to document the reasoning behind other documented artifacts . 67
D.5 Gap Analysis to EU AI Act . 68
History . 71

ETSI
6 ETSI TR 104 119 V1.1.1 (2025-09)

Intellectual Property Rights
Essential patents
IPRs essential or potentially essential to normative deliverables may have been declared to ETSI. The declarations
pertaining to these essential IPRs, if any, are publicly available for ETSI members and non-members, and can be
found in ETSI SR 000 314: "Intellectual Property Rights (IPRs); Essential, or potentially Essential, IPRs notified to
ETSI in respect of ETSI standards", which is available from the ETSI Secretariat. Latest updates are available on the
ETSI IPR online database.
Pursuant to the ETSI Directives including the ETSI IPR Policy, no investigation regarding the essentiality of IPRs,
including IPR searches, has been carried out by ETSI. No guarantee can be given as to the existence of other IPRs not
referenced in ETSI SR 000 314 (or the updates on the ETSI Web server) which are, or may be, or may become,
essential to the present document.
Trademarks
The present document may include trademarks and/or tradenames which are asserted and/or registered by their owners.
ETSI claims no ownership of these except for any which are indicated as being the property of ETSI, and conveys no
right to use or reproduce any trademark and/or tradename. Mention of those trademarks in the present document does
not constitute an endorsement by ETSI of products, services or organizations associated with those trademarks.
DECT™, PLUGTESTS™, UMTS™ and the ETSI logo are trademarks of ETSI registered for the benefit of its
Members. 3GPP™, LTE™ and 5G™ logo are trademarks of ETSI registered for the benefit of its Members and of the
3GPP Organizational Partners. oneM2M™ logo is a trademark of ETSI registered for the benefit of its Members and of ®
the oneM2M Partners. GSM and the GSM logo are trademarks registered and owned by the GSM Association.
Foreword
This Technical Report (TR) has been produced by ETSI Technical Committee Methods for Testing and Specification
(MTS).
Modal verbs terminology
In the present document "should", "should not", "may", "need not", "will", "will not", "can" and "cannot" are to be
interpreted as described in clause 3.2 of the ETSI Drafting Rules (Verbal forms for the expression of provisions).
"must" and "must not" are NOT allowed in ETSI deliverables except when used in direct citation.

ETSI
7 ETSI TR 104 119 V1.1.1 (2025-09)

1 Scope
The present document provides guidelines and recommendations for documentation schemes that support the
continuous and consistent documentation of quality and quality related attributes for AI-enabled systems.
This includes an analysis of current documentation schemes and Use case examples. It also defines a process how to
document AI-enabled systems.
2 References
2.1 Normative references
Normative references are not applicable in the present document.
2.2 Informative references
References are either specific (identified by date of publication and/or edition number or version number) or
non-specific. For specific references, only the cited version applies. For non-specific references, the latest version of the
referenced document (including any amendments) applies.
NOTE: While any hyperlinks included in this clause were valid at the time of publication, ETSI cannot guarantee
their long-term validity.
The following referenced documents may be useful in implementing an ETSI deliverable or add to the reader's
understanding, but are not required for conformance to the present document.
[i.1] ISO/IEC TR 24028:2020: "Information technology — Artificial intelligence — Overview of
trustworthiness in artificial intelligence".
[i.2] Regulation (EU) 2024/1689 of the European Parliament and of the Council of 13 June 2024 laying
down harmonised rules on artificial intelligence and amending Regulations (EC) No 300/2008,
(EU) No 167/2013, (EU) No 168/2013, i.92i.2 (EU) 2018/858, (EU) 2018/1139 and (EU)
2019/2144 and Directives 2014/90/EU, (EU) 2016/797 and (EU) 2020/1828.
[i.3] OECD, adopted on 2019-05-22, amended on 2023-11-08: "Recommendation of the Council on
Artificial Intelligence".
[i.4] ISO/IEC 22989:2022: "Information technology — Artificial intelligence — Artificial intelligence
concepts and terminology".
[i.5] High-Level Expert Group on Artificial Intelligence (HLEG AI), published 2019-04-08: "Ethics
guidelines for trustworthy AI".
[i.6] ISO/IEC 25059:2023: "Software engineering — Systems and software Quality Requirements and
Evaluation (SQuaRE) — Quality model for AI systems".
[i.7] ISO/IEC 25010:2023: "Systems and software engineering — Systems and software Quality
Requirements and Evaluation (SQuaRE) — Product quality model".
[i.8] ISO/IEC 25019:2023: "Systems and software engineering — Systems and software Quality
Requirements and Evaluation (SQuaRE) — Quality-in-use model".
[i.9] ISO/IEC TR 5469:2024: "Artificial intelligence — Functional safety and AI systems".
[i.10] ISO/IEC 23894:2023: "Information technology — Artificial intelligence — Guidance on risk
management".
[i.11] ISO/IEC 42001:2023: "Artificial intelligence - Management system".
ETSI
8 ETSI TR 104 119 V1.1.1 (2025-09)

[i.12] ISO/IEC 27001:2022: "Information security, cybersecurity and privacy protection — Information
security management systems — Requirements".
[i.13] ISO 31000:2018: "Risk management — Guidelines".
[i.14] ISO 9241-210:2019: "Ergonomics of human-system interaction - Part 210: Human-centred design
for interactive systems".
[i.15] ISO 14971:2019: "Medical devices — Application of risk management to medical devices".
[i.16] ISO 13849-1:2023: "Safety of machinery — Safety-related parts of control systems. Part 1:
General principles for design".
[i.17] ISO 21815-1:2022: "Earth-moving machinery — Collision warning and avoidance. Part 1: General
requirements".
[i.18] EN ISO 16001:2017 "Earth-moving machinery — Object detection systems and visibility
aids — Performance requirements and tests".
[i.19] T. Gebru, J. Morgenstern, B. Vecchione, et al.: "Datasheets for datasets", Communications of the
ACM, volume 64, issue 12, pp. 86-92.
[i.20] J. Giner-Miguelez, A. Gómez, and J. Cabot: "DescribeML: a tool for describing machine learning
th
datasets", MODELS '22 Proceedings of the 25 International Conference on Model Driven
Engineering Languages and Systems, pp. 22-26, published 2022-11-09.
[i.21] D. Adkins, B. Alsallakh, A. Cheema, et al.: "Method cards for prescriptive machine-learning
transparency", CAIN '22 Proceedings of the 1st International Conference on AI Engineering:
Software Engineering for AI, pp. 90-100, published 2022-10-17.
[i.22] M. Arnold, R. K. E. Bellamy, M. Hind, et al.: "FactSheets: Increasing trust in AI services through
supplier's declarations of conformity", IBM Journal of Research and Development, volume 63,
issue 4/5, pp. 6:1-13, published 2019-09-18.
[i.23] ISO/IEC TR 29119-11:2020: "Software and systems engineering — Software testing — Part 11:
Guidelines on the testing of AI-based systems".
[i.24] ISO/IEC/IEEE 26514:2022: "Systems and software engineering — Design and development of
information for users".
[i.25] ETSI EG 204 061: "Human Factors (HF); ETSI Accessibility Strategy; Accessibility of ETSI
Deliverables and Improvement of the Development Process of Deliverables".
[i.26] EN 301 549 (V3.2.1) (2021-03): "Accessibility requirements for ICT products and services".
[i.27] ISO/IEC/IEEE 26511:2018: "Systems and software engineering — Requirements for managers of
information for users of systems, software, and services".
[i.28] ISO/IEC/IEEE 26512:2018: "Systems and software engineering — Requirements for acquirers and
suppliers of information for users".
[i.29] ISO/IEC/IEEE 26513:2017: "Systems and software engineering — Requirements for testers and
reviewers of information for users".
[i.30] ISO/IEC/IEEE 15026-2:2022: "Systems and software engineering — Systems and software
assurance — Part 2: Assurance case".
[i.31] Center for Democracy & Technology (CDT): "Best Practices in AI Documentation: The
Imperative of Evidence from Practice".
[i.32] Chmielinski, K. S., Newman, S., Taylor, M., Joseph, J., Thomas, K., Yurkofsky, J., & Qiu, Y. C.:
nd
"The dataset nutrition label (2 gen): Leveraging context to mitigate harms in artificial
intelligence", arXiv preprint arXiv:2201.03954.
[i.33] Procope C., Cheema A., Adkins D., Alsallakh B., Green N., McReynolds E., Pehl G., Wang E., &
Zvyagina P.: "System-Level Transparency of Machine Learning", Technical Report, Meta AI.
ETSI
9 ETSI TR 104 119 V1.1.1 (2025-09)

[i.34] Hutchinson, B., Smart, A., Hanna, A., Denton, E., Greer, C., Kjartansson, O., & Mitchell, M.:
"Towards accountability for machine learning datasets: Practices from software engineering and
infrastructure", In Proceedings of the 2021 ACM conference on fairness, accountability, and
transparency (pp. 560-575).
[i.35] Pushkarna, M., Zaldivar, A., & Kjartansson, O.: "Data cards: Purposeful and transparent dataset
documentation for responsible ai", In Proceedings of the 2022 ACM Conference on Fairness,
Accountability, and Transparency (pp. 1776-1826).
[i.36] L. Derczynski, H. Rose Kirk, V. Balachandran, et al.: "Assessing Language Model Deployment
with Risk Cards", v1, published 2023-03-31.
[i.37] N. Barman, Y. Reznik, and M. Martini: "Datasheet for Subjective and Objective Quality
th
Assessment Datasets", IEEE, 15 International Conference on Quality of Multimedia Experience
(QoMEX) 2023, published 2023-07-18.
[i.38] M. P. Sendak, M. Gao, N. Brajer, and S. Balu: "Presenting machine learning model information to
clinical end users with model facts labels", npj Digit. Med. 3, 41, published 2020-03-23.
[i.39] M. P. Hauer, T. D. Krafft, K. Zweig: "Overview of transparency and inspectability mechanisms to
achieve accountability of artificial intelligence systems", Cambridge University Press, published
2023-11-24.
[i.40] M. Mitchell, S. Wu, A. Zaldivar, et al.: "Model Cards for Model Reporting", Proceedings of the
Conference on Fairness, Accountability, and Transparency, pp. 220-229, published 2019-01-29.
[i.41] T. K. Gilbert, N. Lambert, S. Dean, et al.: "Reward Reports for Reinforcement Learning", AIES
'23 Proceedings of the 2023 AAAI/ACM Conference on AI, Ethics, and Society, pp. 84-130,
published 2023-08-29.
[i.42] Zweig, K. A., Wenzelburger, G., & Krafft, T. D.: "On chances and risks of security related
algorithmic decision making systems", European Journal for Security Research, 3, pp. 181-203.
[i.43] Wirth, R., & Hipp, J.: "CRISP-DM: Towards a standard process model for data mining", In
Proceedings of the 4th international conference on the practical applications of knowledge
discovery and data mining (Vol. 1, pp. 29-39).
[i.44] Angelina McMillan-Major, Emily M. Bender: "A Guide for Creating and Documenting Language
Datasets with Data Statements Schema Version 3".
[i.45] Angelina McMillan-Major, Salomey Osei, et al.: "Reusable Templates and Guides For
Documenting Datasets and Models for Natural Language Processing and Generation: A Case
Study of the HuggingFace and GEM Data and Model Cards".
[i.46] Diaz, M., Kivlichan, I. D., Rosen, R., Baker, D., Amironesei, R., Prabhakaran, V., & Denton, E.
(2022, June): "CrowdWorkSheets: Accounting for individual and collective identities underlying
crowdsourced dataset annotation".
[i.47] Goel, K., Rajani, N. F., Vig, J., Tan, S., Wu, J., Zheng, S., Xiong, C., Bansal, M., & Ré, C. (2021,
January): "Robustness Gym: Unifying the NLP evaluation landscape".
[i.48] Raji, I. D., & Yang, J. (2020, January): "ABOUT ML: Annotation and Benchmarking on
Understanding and Transparency of Machine Learning Lifecycles".
[i.49] Shen, H., Deng, W. H., et al.: "Value Cards: An Educational Toolkit for Teaching Social Impacts
of Machine Learning through Deliberation", Proceedings of the 2021 ACM Conference on
Fairness, Accountability, and Transparency.
[i.50] C. Seifert, S. Scherzinger, et al.: "Towards Generating Consumer Labels for Machine Learning
Models", Invited Paper 2019.
[i.51] Directive (EU) 2016/2102 of the European Parliament and of the Council of 26 October 2016 on
the accessibility of the websites and mobile applications of public sector bodies.
ETSI
10 ETSI TR 104 119 V1.1.1 (2025-09)

[i.52] Floridi, L., Cowls, J., Beltrametti, M. et al.: "AI4People—An Ethical Framework for a Good AI
Society: Opportunities, Risks, Principles, and Recommendations", Minds & Machines 28,
pp. 689-707 (2018).
[i.53] Adewole Adamson and Avery Smith: "Machine Learning and Health Care Disparities in
Dermatology". JAMA Dermatology 154 (08/2018).
[i.54] S. Alder: "AI Company Exposed 2.5 Million Patient Records Over the Internet". HIPPA Journal
(2020).
[i.55] Anmol Arora: "Conceptualising Artificial Intelligence as a Digital Healthcare Innovation: An
Introductory Review". Medical Devices: Evidence and Research Volume 13 (08/2020),
pp. 223-230.
[i.56] Regulation (EU) 2017/745 of the European Parliament and of the Council of 5 April 2017 on
medical devices, amending Directive 2001/83/EC, Regulation (EC) No 178/2002 and
Regulation (EC) No 1223/2009 and repealing Council Directives 90/385/EEC and 93/42/EEC.
[i.57] K. Ferryman and M. Pitcan: "Fairness in precision medicine". Data & Society, 2018.
[i.58] S. D. Fihn, S. Saria, E. Mendonça, S. Hain, M. Matheny, N. Shah, H. Liu, and A. Auerbach:
"Deploying AI in clinical settings". In Artificial intelligence in health care: The hope, the hype, the
promise, the peril, Matheny M, Israni ST, Ahmed M, and Whicher D (Eds.). National Academy of
Medicine, Washington, DC, 2019.
[i.59] U.S. Food and Drug Administration (FDA): "Proposed Regulatory Framework for Modifications
to Artificial Intelligence / Machine Learning (AI/ML)-Based Software as a Medical Device
(SaMD)", 2019.
[i.60] Sara Gerke, Timo Minssen, and Glenn Cohen: "Ethical and legal challenges of artificial
intelligence-driven healthcare", 2020, pp. 295-336.
[i.61] M. Ghassemi: "Exploring Healthy Models in ML for Health. AI for Healthcare Equity
Conference", AI & Health at MIT, 2021.
[i.62] WHO TEAM: Health Ethics & Governance: "Ethics and governance of artificial intelligence for
health: WHO guidance". Geneva: World Health Organization (WHO), 2021.
[i.63] Lucy Hocking, Sarah Parks, Marlene Altenhofer, and Salil Gunashekar: "Reuse of health data by
the European pharmaceutical industry: Current practice and implications for the future", 2019.
[i.64] Kelly M. Hoffman, Sophie Trawalter, Jordan R. Axt, and M. Norman Oliver: "Racial bias in pain
assessment and treatment recommendations, and false beliefs about biological differences between
blacks and whites". Proceedings of the National Academy of Sciences 113, 16 (2016),
pp. 4296-4301, 2016.
[i.65] Bert-Jaap Koops: "The concept of function creep". Law, Innovation and Technology 13, 1 (2021),
pp. 29-56, 2021.
[i.66] Zachary Chase Lipton: "The Doctor Just Won't Accept That!", arXiv: Machine Learning (2017).
[i.67] Alex McKeown, Miranda Mourby, Paul Harrison, Sophie Walker, Mark Sheehan, and Ilina Singh:
"Ethical Issues in Consent for the Reuse of Data in Health Data Platforms". Science and
Engineering Ethics 27 (02/2021).
[i.68] Marçal Mora-Cantallops, Salvador Sánchez-Alonso, Elena García-Barriocanal, and Miguel-Angel
Sicilia: "Traceability for Trustworthy AI: A Review of Models and Tools". Big Data and
Cognitive Computing 5, 2 (2021).
[i.69] Myura Nagendran, Yang Chen, Christopher A Lovejoy, Anthony C Gordon, Matthieu
Komorowski, Hugh Harvey, Eric J Topol, John P A Ioannidis, Gary S Collins, and Mahiben
Maruthappu: "Artificial intelligence versus clinicians: systematic review of design, reporting
standards, and claims of deep learning studies". BMJ 368 (03/2020), m689.
[i.70] BBC News (2017): "Google DeepMind NHS app test broke UK privacy law".
ETSI
11 ETSI TR 104 119 V1.1.1 (2025-09)

[i.71] J. Brian Pickering: "Trust, but Verify: Informed Consent, AI Technologies, and Public Health
Emergencies". Future Internet 13 (2021), p. 132.
[i.72] Thomas Ploug and Soren Holm.: "Meta Consent - A Flexible Solution to the Problem of
Secondary Use of Health Data". Bioethics 30, 9 (2016), pp. 721-732.
[i.73] Inioluwa Deborah Raji, Andrew Smart, Rebecca N. White, Margaret Mitchell, Timnit Gebru, Ben
Hutchinson, Jamila Smith-Loud, Daniel Theron, and Parker Barnes: "Closing the AI
Accountability Gap: Defining an End-to-End Framework for Internal Algorithmic Auditing",
2020.
[i.74] Andrew D. Selbst and Julia E. Powles: "Meaningful Information" and the Right to Explanation. In
FAT, 2017.
[i.75] Ameneh Shamekhi, Ha Trinh, Timothy W. Bickmore, Tamara R. DeAngelis, Theresa Ellis,
Bethlyn V. Houlihan, and Nancy K. Latham: "A Virtual Self-Care Coach for Individuals with
th
Spinal Cord Injury". In Proceedings of the 18 International ACM SIGACCESS Conference on
Computers and Accessibility (Reno, Nevada, USA) (ASSETS '16). Association for Computing
Machinery, New York, NY, USA, pp. 327-328.
[i.76] Helen Smith: "Clinical AI: opacity, accountability, responsibility and liability". AI & SOCIETY
36 (06/2021).
[i.77] Darshali Vyas, Leo Eisenstein, and David Jones: "Hidden in Plain Sight — Reconsidering the Use
of Race Correction in Clinical Algorithms". New England Journal of Medicine 383 (06 2020).
[i.78] Blay Whitby: "Automating Medicine the Ethical Way", 2015.
[i.79] Guang Yang, Qinghao Ye, and Jun Xia: "Unbox the Black-box for the Medical Explainable AI via
Multi-modal and Multi-centre Data Fusion: A Mini-Review", Two Showcases and Beyond, 2021.
[i.80] Robert Challen, Joshua Denny, Martin Pitt, Luke Gompels, Tom Edwards, and Krasimira
Tsaneva-Atanasova: "Artificial intelligence, bias and clinical safety". BMJ Quality & Safety 28
(01/2019), bmjqs-2018.
[i.81] Samer Ellahham, Nour Ellahham, and Mecit Can Emre Simsekler: "Application of Artificial
Intelligence in the Health Care Safety Context: Opportunities and Challenges". American Journal
of Medical Quality 35, 4 (2020), pp. 341-348.
[i.82] Ravi Manne and Sneha Kantheti: "Application of Artificial Intelligence in Healthcare: Chances
and Challenges". Current Journal of Applied Science and Technology 40 (05/2021), pp. 78-89.
[i.83] Jessica Morley and Luciano Floridi: "An Ethically Mindful Approach to AI for Health Care". The
Lancet 395 (01/2020), pp. 254-255.
[i.84] Díaz-Rodríguez, N., Del Ser, J., Coeckelbergh, M., López de Prado, M., Herrera-Viedma, E., &
Herrera, F. (2023): "Connecting the dots in trustworthy Artificial Intelligence: From AI principles,
ethics, and key requirements to responsible AI systems and regulation".
[i.85] Article 22 EU GDPR: "Automated individual decision-making, including profiling".
[i.86] "FUTURE-AI: international consensus guideline for trustworthy and deployable artificial
intelligence in healthcare".
[i.87] Annemarie Hamlin, Chris Rubio, Michele DeSilva: "Technical Writing".
[i.88] Regulation (EU) 2023/1230 of the European Parliament and of the Council of 14 June 2023 on
machinery and repealing Directive 2006/42/EC of the European Parliament and of the Council and
Council Directive 73/361/EEC.
[i.89] ISO/IEC AWI 42102: "Information technology — Artificial intelligence — Taxonomy of AI
system methods and capabilities" [Draft]. Retrieved June 20, 2025.
[i.90] Schmid, T. (2023): "A Systematic and Efficient Approach to the Design of Modular Hybrid AI
Systems". In AAAI Spring Symposium: MAKE.
ETSI
12 ETSI TR 104 119 V1.1.1 (2025-09)

[i.91] Holoyad, T., Schmid, T., & Hildesheim, W.: "Managing and understanding artificial intelligence:
From classical to generative AI - A practice guide for decision‑makers, developers and regulators
in the age of the EU AI Act". Springer.
3 Definition of terms, symbols and abbreviations
3.1 Terms
For the purposes of the present document, the following terms apply:
affected person: individuals with limited technical knowledge who may be impacted by AI systems
NOTE: They require protection from arbitrary decisions and risks, and may need to take legal measures if they
feel unfairly treated. They can be represented by NGOs who possess greater capacities, knowledge, and
power. See also: AI subject.
AI customer: organization or entity that uses an AI product or service either directly or by its provision to AI users
NOTE: Aligned with ISO/IEC 22989 [i.4]: AI customer.
AI partner: organization or entity that provides services in the context of AI
NOTE 1: AI partners can perform technical development of AI products or services, conduct testing and validation
of AI products and services, audit AI usage, evaluate AI products or services and perform other tasks.
NOTE 2: This includes roles like AI system integrators, who incorporate AI components into broader systems, data
providers, AI evaluators, and AI auditors.
NOTE 3: Aligned with ISO/IEC 22989 [i.4]: AI partner.
AI producer: organization or entity that designs, develops, tests and deploys products or services that use one or more
AI system
NOTE 1: This includes AI developers, who focus on creating AI models, implementing computational processes,
and verifying both the computation and model performance.
NOTE 2: According to the EU AI Act [i.2] an AI producer is also included in the term Deployer, as "a natural or
legal person, public authority, agency or other body using an AI system under its authority except where
the AI system is used in the course of a personal non-professional activity".
NOTE 3: Aligned with ISO/IEC 22989 [i.4]: AI producer.
AI provider: organization or entity that offers products or services utilizing one or more AI systems
NOTE 1: AI providers include AI platform providers, who enable other stakeholders to produce AI services or
products, and AI service or product providers, who deliver AI solutions directly to customers.
NOTE 2: The EU AI Act [i.2] defines Provider as "a natural or legal person, public authority, agency or other body
that develops an AI system or a general-purpose AI model or that has an AI system or a general-purpose
AI model developed and places it on the market or puts the AI system into service under its own name or
trademark, whether for payment or free of charge".
NOTE 3: Aligned with ISO/IEC 22989 [i.4]: AI provider.
AI subject: organization or entity that is impacted by an AI system, service or product
NOTE 1: This can also include individuals or communities affected by AI applications, such as users of social
networks or drivers of AI-automated vehicles.
NOTE 2: The EU AI Act [i.2] uses the term affected person equivalently.
NOTE 3: Aligned with ISO/IEC 22989 [i.4]: AI subject.
ETSI
13 ETSI TR 104 119 V1.1.1 (2025-09)

AI user: organization or entity that uses AI products or services
NOTE 1: AI user is a sub-role of AI customer.
NOTE 2: Aligned with ISO/IEC 22989 [i.4]: AI users.
auditor: professionals with deep technical knowledge and understanding of standards and regulations
NOTE 1: They identify compliance issues and ensure AI systems meet ethical and operational benchmarks,
facilitating successful certification and deployment.
NOTE 2: Aligned with ISO/IEC 22989 [i.4]: AI auditor.
bias: systematic difference in treatment of certain objects, people, or groups in comparison to others
NOTE: Aligned with ISO/IEC 22989 [i.4]: bias.
deployer: entities utilizing AI-based products provided by others, requiring sufficient information to effectively
incorporate these systems into their own products or services
NOTE: The EU AI Act [i.2] uses the term 'deployer' as "a natural or legal person, public authority, agency or
other body using an AI system under its authority except where the AI system is used in the course of a
personal non-professional activity". Se
...

Questions, Comments and Discussion

Ask us and Technical Secretary will try to provide an answer. You can facilitate discussion about the standard in here.

Loading comments...