ISO 5060:2024

Translation services — Evaluation of translation output — General guidance

This document gives guidance on the evaluation of human translation output, post-edited machine translation output, and unedited machine translation output. It also provides guidance on the qualifications and competences of evaluators. The role of sampling is also discussed in this document. This document focuses on an analytic translation evaluation approach using error types and penalty points configured to produce an error score and a quality rating. A further focus is the human evaluation of translation output only. This document follows an approach designed to reflect minimum complexity. The rationale behind this approach is to keep this document applicable for as many users as possible in the translation sector. The guidance provided in this document can also support the evaluation of source texts intended for translation. This document is applicable to translation service providers (TSPs), including individual translators, translation companies or in-house translation services, their clients and other interested parties in the translation sector, such as translator education and training institutions. This document does not apply to related elements such as the processes of assuring the quality of translation output and corrective actions. This document does not apply to interpreting.

Services de traduction — Évaluation des résultats de traduction — Recommandations générales

Le présent document fournit des recommandations relatives à l’évaluation du résultat d’une traduction humaine, d’une traduction automatique post-éditée et d’une traduction automatique non éditée. Il donne également des recommandations relatives aux qualifications et aux compétences des évaluateurs. Le rôle de l’échantillonnage y est également abordé. Le présent document se concentre sur une approche analytique d’évaluation de la traduction utilisant des types d’erreurs et des points de pénalité configurés pour obtenir un score d’erreur et une note de qualité. Il met également l’accent uniquement sur l’évaluation humaine du résultat de traduction. Le présent document suit une approche conçue pour présenter le moins de complexité possible. Le but de cette approche est de faire en sorte que le présent document soit applicable par le plus grand nombre d’utilisateurs possible dans le secteur de la traduction. Les recommandations fournies dans le présent document peuvent également servir à l’évaluation des textes sources destinés à être traduits. Le présent document s’applique aux prestataires de services de traduction (PST), y compris les traducteurs indépendants, les sociétés de traduction ou les services internes de traduction, à leurs clients et aux autres parties intéressées du secteur de la traduction, telles que les établissements d’enseignement et de formation des traducteurs. Le présent document ne s’applique pas aux éléments connexes tels que les processus d’assurance de la qualité du résultat de traduction et les actions correctives. Le présent document ne s’applique pas à l’interprétation.

Prevajalske storitve - Vrednotenje rezultatov prevajanja - Splošna navodila

General Information

• Status: Published
• Publication Date: 12-Feb-2024
• ICS: 01.020 - Terminology (principles and coordination)
• Technical Committee: ISO/TC 37/SC 5 - Translation, interpreting and related technology
• Drafting Committee: ISO/TC 37/SC 5/WG 1 - Translation
• Current Stage: 6060 - International Standard published
• Start Date: 13-Feb-2024
• Due Date: 11-Feb-2024
• Completion Date: 13-Feb-2024
• Ref Project: oSIST ISO/DIS 5060:2022 - Translation services — Evaluation of translation output — General guidance

Standards Content (Sample)

SLOVENSKI STANDARD
oSIST ISO/DIS 5060:2022
01-december-2022
Prevajalske storitve - Vrednotenje rezultatov prevajanja - Splošna navodila
Translation services — Evaluation of translation output — General guidance
Services de traduction — Évaluation des résultats de traduction — Recommandations
générales
Ta slovenski standard je istoveten z: ISO/DIS 5060:2022
ICS:
01.020 Terminologija (načela in Terminology (principles and
koordinacija) coordination)
03.080.99 Druge storitve Other services
oSIST ISO/DIS 5060:2022 en,fr,de
2003-01.Slovenski inštitut za standardizacijo. Razmnoževanje celote ali delov tega standarda ni dovoljeno.

---------------------- Page: 1 ----------------------
oSIST ISO/DIS 5060:2022

---------------------- Page: 2 ----------------------
oSIST ISO/DIS 5060:2022
DRAFT INTERNATIONAL STANDARD
ISO/DIS 5060
ISO/TC 37/SC 5 Secretariat: DIN
Voting begins on: Voting terminates on:
2022-07-20 2022-10-12
Translation services — Evaluation of translation output —
General guidance
Services de traduction — Évaluation d'un texte résultant d'une traduction — Recommandations générales
ICS: 01.020
THIS DOCUMENT IS A DRAFT CIRCULATED
FOR COMMENT AND APPROVAL. IT IS
THEREFORE SUBJECT TO CHANGE AND MAY
This document is circulated as received from the committee secretariat.
NOT BE REFERRED TO AS AN INTERNATIONAL
STANDARD UNTIL PUBLISHED AS SUCH.
IN ADDITION TO THEIR EVALUATION AS
BEING ACCEPTABLE FOR INDUSTRIAL,
TECHNOLOGICAL, COMMERCIAL AND
USER PURPOSES, DRAFT INTERNATIONAL
STANDARDS MAY ON OCCASION HAVE TO
BE CONSIDERED IN THE LIGHT OF THEIR
POTENTIAL TO BECOME STANDARDS TO
WHICH REFERENCE MAY BE MADE IN
Reference number
NATIONAL REGULATIONS.
ISO/DIS 5060:2022(E)
RECIPIENTS OF THIS DRAFT ARE INVITED
TO SUBMIT, WITH THEIR COMMENTS,
NOTIFICATION OF ANY RELEVANT PATENT
RIGHTS OF WHICH THEY ARE AWARE AND TO
PROVIDE SUPPORTING DOCUMENTATION. © ISO 2022

---------------------- Page: 3 ----------------------
oSIST ISO/DIS 5060:2022
ISO/DIS 5060:2022(E)
DRAFT INTERNATIONAL STANDARD
ISO/DIS 5060
ISO/TC 37/SC 5 Secretariat: DIN
Voting begins on: Voting terminates on:

Translation services — Evaluation of translation output —
General guidance
Services de traduction — Évaluation d'un texte résultant d'une traduction — Recommandations générales
ICS: 01.020
COPYRIGHT PROTECTED DOCUMENT
THIS DOCUMENT IS A DRAFT CIRCULATED
FOR COMMENT AND APPROVAL. IT IS
© ISO 2022
THEREFORE SUBJECT TO CHANGE AND MAY
This document is circulated as received from the committee secretariat.
All rights reserved. Unless otherwise specified, or required in the context of its implementation, no part of this publication may
NOT BE REFERRED TO AS AN INTERNATIONAL
be reproduced or utilized otherwise in any form or by any means, electronic or mechanical, including photocopying, or posting on STANDARD UNTIL PUBLISHED AS SUCH.
the internet or an intranet, without prior written permission. Permission can be requested from either ISO at the address below
IN ADDITION TO THEIR EVALUATION AS
or ISO’s member body in the country of the requester. BEING ACCEPTABLE FOR INDUSTRIAL,
TECHNOLOGICAL, COMMERCIAL AND
ISO copyright office
USER PURPOSES, DRAFT INTERNATIONAL
CP 401 • Ch. de Blandonnet 8
STANDARDS MAY ON OCCASION HAVE TO
BE CONSIDERED IN THE LIGHT OF THEIR
CH-1214 Vernier, Geneva
POTENTIAL TO BECOME STANDARDS TO
Phone: [phone]
WHICH REFERENCE MAY BE MADE IN
Reference number
Email: [e-mail]
NATIONAL REGULATIONS.
Website: www.iso.org ISO/DIS 5060:2022(E)
RECIPIENTS OF THIS DRAFT ARE INVITED
Published in Switzerland
TO SUBMIT, WITH THEIR COMMENTS,
NOTIFICATION OF ANY RELEVANT PATENT
RIGHTS OF WHICH THEY ARE AWARE AND TO
ii
  © ISO 2022 – All rights reserved
PROVIDE SUPPORTING DOCUMENTATION. © ISO 2022

---------------------- Page: 4 ----------------------
oSIST ISO/DIS 5060:2022
ISO/DIS 5060:2022(E)
Contents Page
Foreword .iv
Introduction .v
1 Scope . 1
2 Normative references . 1
3 Terms and definitions .
...

FINAL
INTERNATIONAL ISO/FDIS
DRAFT
STANDARD 5060
ISO/TC 37/SC 5
Translation services — Evaluation
Secretariat: DIN
of translation output — General
Voting begins on:
2023-10-20 guidance
Voting terminates on:
Services de traduction — Évaluation des résultats de traduction —
2023-12-15
Recommandations générales
RECIPIENTS OF THIS DRAFT ARE INVITED TO
SUBMIT, WITH THEIR COMMENTS, NOTIFICATION
OF ANY RELEVANT PATENT RIGHTS OF WHICH
THEY ARE AWARE AND TO PROVIDE SUPPOR TING
DOCUMENTATION.
IN ADDITION TO THEIR EVALUATION AS
Reference number
BEING ACCEPTABLE FOR INDUSTRIAL, TECHNO-
ISO/FDIS 5060:2023(E)
LOGICAL, COMMERCIAL AND USER PURPOSES,
DRAFT INTERNATIONAL STANDARDS MAY ON
OCCASION HAVE TO BE CONSIDERED IN THE
LIGHT OF THEIR POTENTIAL TO BECOME STAN-
DARDS TO WHICH REFERENCE MAY BE MADE IN
NATIONAL REGULATIONS. © ISO 2023

---------------------- Page: 1 ----------------------
ISO/FDIS 5060:2023(E)
FINAL
INTERNATIONAL ISO/FDIS
DRAFT
STANDARD 5060
ISO/TC 37/SC 5
Translation services — Evaluation
Secretariat: DIN
of translation output — General
Voting begins on:
guidance
Voting terminates on:
Services de traduction — Évaluation des résultats de traduction —
Recommandations générales
COPYRIGHT PROTECTED DOCUMENT
© ISO 2023
All rights reserved. Unless otherwise specified, or required in the context of its implementation, no part of this publication may
be reproduced or utilized otherwise in any form or by any means, electronic or mechanical, including photocopying, or posting on
the internet or an intranet, without prior written permission. Permission can be requested from either ISO at the address below
or ISO’s member body in the country of the requester.
RECIPIENTS OF THIS DRAFT ARE INVITED TO
ISO copyright office
SUBMIT, WITH THEIR COMMENTS, NOTIFICATION
OF ANY RELEVANT PATENT RIGHTS OF WHICH
CP 401 • Ch. de Blandonnet 8
THEY ARE AWARE AND TO PROVIDE SUPPOR TING
CH-1214 Vernier, Geneva
DOCUMENTATION.
Phone: [phone]
IN ADDITION TO THEIR EVALUATION AS
Reference number
Email: [e-mail]
BEING ACCEPTABLE FOR INDUSTRIAL, TECHNO­
ISO/FDIS 5060:2023(E)
Website: www.iso.org
LOGICAL, COMMERCIAL AND USER PURPOSES,
DRAFT INTERNATIONAL STANDARDS MAY ON
Published in Switzerland
OCCASION HAVE TO BE CONSIDERED IN THE
LIGHT OF THEIR POTENTIAL TO BECOME STAN­
DARDS TO WHICH REFERENCE MAY BE MADE IN
ii
  © ISO 2023 – All rights reserved
NATIONAL REGULATIONS. © ISO 2023

---------------------- Page: 2 ----------------------
ISO/FDIS 5060:2023(E)
Contents Page
Foreword .iv
Introduction .v
1 Scope . 1
2 Normative references . 1
3 Terms and definitions . 1
3.1 General concepts . 1
3.2 Concepts related to the people involved in the evaluation process . 3
3.3 Concepts related to the evaluation process . 3
3.4 Concepts related to errors . 4
3.5 Concepts related to penalty points. 5
4 Human resources . 6
4.1 General . 6
4.2 Professional compete
...

© ISO 2022 – All rights reserved
ISO/DIS FDIS 5060:2022(E)
Date: 2023-05-03
ISO/TC 37/SC 5/WG 1
Secretariat: DIN
Date: 2023-10-03
Translation services — Evaluation of translation output —
General guidance

DISServices de traduction — Évaluation des résultats de traduction — Recommandations
générales
FDIS stage

---------------------- Page: 1 ----------------------
ISO/DIS FDIS 5060:20222023(E)
© ISO 2022 2023
All rights reserved. Unless otherwise specified, or required in the context of its implementation, no part of this
publication may be reproduced or utilized otherwise in any form or by any means, electronic or mechanical,
including photocopying, or posting on the internet or an intranet, without prior written permission. Permission can
be requested from either ISO at the address below or ISO’s member body in the country of the requester.
ISO Copyright Office copyright office
CP 401 • Ch. de Blandonnet 8
CH-1214 Vernier, Geneva
Phone: + 41 22 749 01 11
Email: [e-mail]
E-mail: [e-mail]
Website: www.iso.orgwww.iso.org
Published in Switzerland.
ii © ISO 2022 – All rights reserved
ii © ISO 2023 – All rights reserved

---------------------- Page: 2 ----------------------
ISO/DIS FDIS 5060:20222023(E)
Contents
Foreword . vi
Introduction . vii
1 Scope . 1
2 Normative references . 1
3 Terms and definitions . 1
3.1 General concepts . 2
3.2 Concepts related to the people involved in the evaluation process. 3
3.3 Concepts related to the evaluation process . 4
3.4 Concepts related to errors . 6
3.5 Concepts related to penalty points . 7
4 Human resources . 8
4.1 General . 8
4.2 Professional competences of evaluators . 8
4.3 Qualifications of evaluators . 8
5 Pre-evaluation phase . 9
5.1 Evaluation approaches . 9
5.2 Implementing the evaluation of translation output . 9
5.3 Specifications . 9
5.4 Error typology . 10
5.5 Error type weights . 11
5.6 Severity levels .
...