ASTM F3516-22

Standard Guide for Testing Interpreting Performance

SIGNIFICANCE AND USE
4.1 Intended Use:  
4.1.1 This guide is intended to assist in the design or evaluation of screening and interpreting tests, or both.  
4.1.2 This guide also satisfies the need for testing interpreting performance identified in other relevant ASTM standards (see Practice F2889 and Practice F2089).  
4.2 Compliance with the Guide:  
4.2.1 Compliance requires the user to identify which sections of this guide apply to their specific use and circumstances. The decision to not adhere to any sections should be fully explained.
SCOPE
1.1 Purpose:  
1.1.1 This guide describes factors to be considered for the development and use of language interpreting performance tests, referencing the Interagency Language Roundtable (ILR) scale. It is intended to help people commission, develop, or select assessment tools for the evaluation of interpreting skills.  
1.1.2 The purpose of any test developed following this guide is to rate a candidate's interpreting skills according to the Interagency Language Roundtable Skill Level Descriptions for Interpreting Performance (ILR SLDs for Interpreting). Any pass/fail rating assigned should reference the specific ILR level at which the candidate has tested.  
1.1.3 The objectives for all tests should be clearly defined and convincing evidence presented to justify any claims, inferences, and decisions.  
1.1.4 This guide focuses on two types of assessment; one is for screening candidates, and the other is for evaluating actual interpreting skills. It also outlines the appropriate characteristics and uses of each.  
1.1.5 When evaluating actual interpreting skills, it should be noted that according to ILR, it is at the Professional Performance Level 3 that all necessary skills align to enable a reasonably accurate, reliable, and trustworthy interpretation.  
1.2 Limitations:  
1.2.1 This guide is not intended to address test development for use in the following areas:
1.2.1.1 Translation,
1.2.1.2 Audio Translation,
1.2.1.3 Transcription/Translation,
1.2.1.4 Diagnostic Assessments,
1.2.1.5 Less-commonly tested languages, and
1.2.1.6 Other job-specific language performance tests.  
1.2.2 This guide also does not purport to prescribe definitive descriptions of every possible approach for testing interpreting performance, nor does it prescribe the exact parameters that must be used in a valid and reliable test of interpreting skills. It does, however, suggest approaches to help test designers and users determine whether the use of a test is appropriate and justifiable.  
1.2.3 This guide is not intended to address ancillary processes and procedures governing how organizations provide interpreting services.  
1.3 This international standard was developed in accordance with internationally recognized principles on standardization established in the Decision on Principles for the Development of International Standards, Guides and Recommendations issued by the World Trade Organization Technical Barriers to Trade (TBT) Committee.

General Information

• Status: Published
• Publication Date: 31-Mar-2022
• ICS: 01.020 - Terminology (principles and coordination)
• Technical Committee: F43 - Language Services and Products
• Drafting Committee: F43.04 - Language Testing

Relations

• Refers: ASTM F2889-11(2020) - Standard Practice for Assessing Language Proficiency
• Effective Date: 01-Apr-2020

Standards Content (Sample)

This international standard was developed in accordance with internationally recognized principles on standardization established in the Decision on Principles for the
Development of International Standards, Guides and Recommendations issued by the World Trade Organization Technical Barriers to Trade (TBT) Committee.
Designation: F3516 − 22
Standard Guide for
1
Testing Interpreting Performance
This standard is issued under the fixed designation F3516; the number immediately following the designation indicates the year of
original adoption or, in the case of revision, the year of last revision. A number in parentheses indicates the year of last reapproval. A
superscript epsilon (´) indicates an editorial change since the last revision or reapproval.
1. Scope It does, however, suggest approaches to help test designers and
users determine whether the use of a test is appropriate and
1.1 Purpose:
justifiable.
1.1.1 This guide describes factors to be considered for the
1.2.3 This guide is not intended to address ancillary pro-
development and use of language interpreting performance
cesses and procedures governing how organizations provide
tests, referencing the Interagency Language Roundtable (ILR)
interpreting services.
scale. It is intended to help people commission, develop, or
1.3 This international standard was developed in accor-
select assessment tools for the evaluation of interpreting skills.
dance with internationally recognized principles on standard-
1.1.2 The purpose of any test developed following this
ization established in the Decision on Principles for the
guide is to rate a candidate’s interpreting skills according to the
Development of International Standards, Guides and Recom-
Interagency Language Roundtable Skill Level Descriptions for
mendations issued by the World Trade Organization Technical
Interpreting Performance (ILR SLDs for Interpreting). Any
Barriers to Trade (TBT) Committee.
pass/fail rating assigned should reference the specific ILR level
at which the candidate has tested.
2. Referenced Documents
1.1.3 The objectives for all tests should be clearly defined
2
2.1 ASTM Standards:
and convincing evidence presented to justify any claims,
F2089 Practice for Language Interpreting
inferences, and decisions.
F2889 Practice for Assessing Language Proficiency
1.1.4 This guide focuses on two types of assessment; one is
for screening candidates, and the other is for evaluating actual
3. Terminology
interpreting skills. It also outlines the appropriate characteris-
3.1 Definitions:
tics and uses of each.
3.1.1 adaptive tests, n—tests in which the selection of the
1.1.5 Whenevaluatingactualinterpretingskills,itshouldbe
next item depends upon the rating assigned to previously taken
noted that according to ILR, it is at the Professional Perfor-
items.
mance Level 3 that all necessary skills align to enable a
3.1.1.1 Discussion—In computer-adaptive tests, for
reasonably accurate, reliable, and trustworthy interpretation.
example,candidateswhodonotshowmasteryatonelevelmay
1.2 Limitations:
not be asked to respond to higher-level prompts, but may be
1.2.1 This guide is not intended to address test development
given lower ones to determine their ability. In human-delivered
for use in the following areas:
adaptive tests (such as Oral Proficiency interviews), testers
1.2.1.1 Translation,
select the next prompt based upon how well or badly they
1.2.1.2 Audio Translation,
believe the candidate handles a previous prompt.
1.2.1.3 Transcription/Translation,
3.1.2 analytic scoring, n—results in the assignment of
1.2.1.4 Diagnostic Assessments,
particular values to each individual element of the candidate’s
1.2.1.5 Less-commonly tested languages, and
performance, which may or may not result in a final overall
1.2.1.6 Other job-specific language performance tests.
rating; analytic rating breaks down performance into discrete
1.2.2 This guide also does not purport to prescribe definitive
features and assigns separate ratings or values to each.
descriptions of every possible approach for testing interpreting
3.1.3 decision-tree guidelines, n—describe the paths a can-
performance, nor does it prescribe the exact parameters that
must be used in a valid and reliable test of interpreting skills. didate may take through an adaptive test; they suggest which
items should be delivered next, based on measurements of
current performance.
1
This guide is under the jurisdiction of ASTM Committee F43 on Language
2
Services and Products and is the direct responsibility of Subcommittee F43.04 on For referenced ASTM standards, visit the ASTM website, www.astm.org, or
Language Testing. contact ASTM Customer Service at [e-mail]. For Annual Book of ASTM
Current edition approved April 1, 2022. Published April 2022. DOI: 10.1520/ Standards volume information, refer to the standard’s Document Summary page on
F3516-22. the ASTM website.
Copyright © ASTM International, 100 Barr Harbor Drive, PO Box C700, West Conshohocken, PA 19428-295
...