ASTM E691-23
(Practice)Standard Practice for Conducting an Interlaboratory Study to Determine the Precision of a Test Method
Standard Practice for Conducting an Interlaboratory Study to Determine the Precision of a Test Method
ABSTRACT
This practice describes the techniques for planning, conducting, analyzing, and treating the results of an interlaboratory study (ILS) of a test method. The statistical techniques described in this practice provide adequate information for formulating the precision statement of a test method. This practice is also concerned exclusively with test methods which yield a single numerical figure as the test result, although the single figure may be the outcome of a calculation from a set of measurements. ASTM regulations require precision statements in all test methods in terms of repeatability and reproducibility and knowledge of the test method precision is useful in commerce and in technical work when comparing test results against standard values or between data sources.
SIGNIFICANCE AND USE
4.1 ASTM regulations require precision statements in all test methods in terms of repeatability and reproducibility. This practice may be used in obtaining the needed information as simply as possible. This information may then be used to prepare a precision statement in accordance with Practice E177. Knowledge of the test method precision is useful in commerce and in technical work when comparing test results against standard values (such as specification limits) or between data sources (different laboratories, instruments, etc.).
4.1.1 When a test method is applied to a large number of portions of a material that are as nearly alike as possible, the test results obtained will not all have the same value. A measure of the degree of agreement among these test results describes the precision of the test method for that material. Numerical measures of the variability between such test results provide inverse measures of the precision of the test method. Greater variability implies smaller (that is, poorer) precision and larger imprecision.
4.1.2 Precision is reported as a standard deviation, coefficient of variation (relative standard deviation), variance, or a precision limit (a data range indicating no statistically significant difference between test results).
4.1.3 This practice is designed only to estimate the precision of a test method. However, when accepted reference values are available for the property levels, the test result data obtained according to this practice may be used in estimating the bias of the test method. For a discussion of bias estimation and the relationships between precision, bias, and accuracy, see Practice E177.
4.2 The procedures presented in this practice consist of three basic steps: planning the interlaboratory study, guiding the testing phase of the study, and analyzing the test result data.
4.2.1 The planning phase includes forming the ILS task group, the study design, selection, and number of participating laborato...
SCOPE
1.1 This practice describes the techniques for planning, conducting, analyzing, and treating the results of an interlaboratory study (ILS) of a test method. The statistical techniques described in this practice provide adequate information for formulating the precision statement of a test method.
1.2 This practice does not concern itself with the development of test methods but rather with gathering the information needed for a test method precision statement after the development stage has been successfully completed. The data obtained in the interlaboratory study may indicate, however, that further effort is needed to improve the test method.
1.3 Since the primary purpose of this practice is the development of the information needed for a precision statement, the experimental design in this practice may not be optimum for evaluating materials, apparatus, or individual laboratories.
1.4 Field of Application—This practice is concerned exclusively with test methods which yield a single numerical figure as the test result, although the single figure may be the outcome of a calculation from a set of measurements.
1.4.1 This practice ...
General Information
Buy Standard
Standards Content (Sample)
This international standard was developed in accordance with internationally recognized principles on standardization established in the Decision on Principles for the
Development of International Standards, Guides and Recommendations issued by the World Trade Organization Technical Barriers to Trade (TBT) Committee.
Designation: E691 − 23 An American National Standard
Standard Practice for
Conducting an Interlaboratory Study to Determine the
1
Precision of a Test Method
This standard is issued under the fixed designation E691; the number immediately following the designation indicates the year of
original adoption or, in the case of revision, the year of last revision. A number in parentheses indicates the year of last reapproval. A
superscript epsilon (´) indicates an editorial change since the last revision or reapproval.
This standard has been approved for use by agencies of the U.S. Department of Defense.
1. Scope 1.6 This international standard was developed in accor-
dance with internationally recognized principles on standard-
1.1 This practice describes the techniques for planning,
ization established in the Decision on Principles for the
conducting, analyzing, and treating the results of an interlabo-
Development of International Standards, Guides and Recom-
ratory study (ILS) of a test method. The statistical techniques
mendations issued by the World Trade Organization Technical
described in this practice provide adequate information for
Barriers to Trade (TBT) Committee.
formulating the precision statement of a test method.
1.2 This practice does not concern itself with the develop- 2. Referenced Documents
ment of test methods but rather with gathering the information 2
2.1 ASTM Standards:
needed for a test method precision statement after the devel-
E29 Practice for Using Significant Digits in Test Data to
opment stage has been successfully completed. The data
Determine Conformance with Specifications
obtained in the interlaboratory study may indicate, however,
E177 Practice for Use of the Terms Precision and Bias in
that further effort is needed to improve the test method.
ASTM Test Methods
E456 Terminology Relating to Quality and Statistics
1.3 Since the primary purpose of this practice is the devel-
opment of the information needed for a precision statement, the E1169 Practice for Conducting Ruggedness Tests
E1402 Guide for Sampling Design
experimental design in this practice may not be optimum for
evaluating materials, apparatus, or individual laboratories. E2282 Guide for Defining the Test Result of a Test Method
1.4 Field of Application—This practice is concerned exclu-
3. Terminology
sively with test methods which yield a single numerical figure
3.1 Definitions—Unless otherwise noted in this standard, all
as the test result, although the single figure may be the outcome
terms relating to quality and statistics are defined in E456.
of a calculation from a set of measurements.
3.1.1 accuracy, n—the closeness of agreement between a
1.4.1 This practice does not cover methods in which the
test result and an accepted reference value. E177
measurement is a categorization; however, for many practical
3.1.2 bias, n—the difference between the expectation of the
purposes categorical outcomes can be scored, such as zero-one
test results and an accepted reference value. E177
scoring for binary measurements or as integers, ranks for
example, for well-ordered categories and then the test result
3.1.3 interlaboratory study, (ILS) in ASTM, n—a designed
can be defined as an average, or other summary statistic, of
procedure for obtaining a precision statement for a test method,
several individual scores.
involving multiple laboratories, each generating replicate test
results on one or more materials.
1.5 This standard may involve hazardous materials,
operations, and equipment. This standard does not purport to
3.1.4 observation, n—the process of obtaining information
address all of the safety concerns, if any, associated with its
regarding the presence or absence of an attribute of a test
use. It is the responsibility of the user of this standard to
specimen, or of making a reading on a characteristic or
establish appropriate safety, health, and environmental prac-
dimension of a test specimen. E2282
tices and determine the applicability of regulatory limitations
3.1.5 precision, n—the closeness of agreements between
prior to use.
independent test results obtained under stipulated conditions.
E177
1
This practice is under the jurisdiction of ASTM Committee E11 on Quality and
Statistics and is the direct responsibility of Subcommittee E11.20 on Test Method
2
Evaluation and Quality Control. For referenced ASTM standards, visit the ASTM website, www.astm.org, or
Current edition approved April 1, 2023. Published April 2023. Originally contact ASTM Customer Service at service@astm.org. For Annual Book of ASTM
approved in 1979. Last previous edition approved in 2022 as E691 – 22. DOI: Standards volume information, refer
...
This document is not an ASTM standard and is intended only to provide the user of an ASTM standard an indication of what changes have been made to the previous version. Because
it may not be technically possible to adequately depict all changes accurately, ASTM recommends that users consult prior editions as appropriate. In all cases only the current version
of the standard as published by ASTM is to be considered the official document.
Designation: E691 − 22 E691 − 23 An American National Standard
Standard Practice for
Conducting an Interlaboratory Study to Determine the
1
Precision of a Test Method
This standard is issued under the fixed designation E691; the number immediately following the designation indicates the year of
original adoption or, in the case of revision, the year of last revision. A number in parentheses indicates the year of last reapproval. A
superscript epsilon (´) indicates an editorial change since the last revision or reapproval.
This standard has been approved for use by agencies of the U.S. Department of Defense.
1. Scope
1.1 This practice describes the techniques for planning, conducting, analyzing, and treating the results of an interlaboratory study
(ILS) of a test method. The statistical techniques described in this practice provide adequate information for formulating the
precision statement of a test method.
1.2 This practice does not concern itself with the development of test methods but rather with gathering the information needed
for a test method precision statement after the development stage has been successfully completed. The data obtained in the
interlaboratory study may indicate, however, that further effort is needed to improve the test method.
1.3 Since the primary purpose of this practice is the development of the information needed for a precision statement, the
experimental design in this practice may not be optimum for evaluating materials, apparatus, or individual laboratories.
1.4 Field of Application—This practice is concerned exclusively with test methods which yield a single numerical figure as the
test result, although the single figure may be the outcome of a calculation from a set of measurements.
1.4.1 This practice does not cover methods in which the measurement is a categorization; however, for many practical purposes
categorical outcomes can be scored, such as zero-one scoring for binary measurements or as integers, ranks for example, for
well-ordered categories and then the test result can be defined as an average, or other summary statistic, of several individual
scores.
1.5 This standard may involve hazardous materials, operations, and equipment. This standard does not purport to address all
of the safety concerns, if any, associated with its use. It is the responsibility of the user of this standard to establish appropriate
safety, health, and environmental practices and determine the applicability of regulatory limitations prior to use.
1.6 This international standard was developed in accordance with internationally recognized principles on standardization
established in the Decision on Principles for the Development of International Standards, Guides and Recommendations issued
by the World Trade Organization Technical Barriers to Trade (TBT) Committee.
2. Referenced Documents
2
2.1 ASTM Standards:
1
This practice is under the jurisdiction of ASTM Committee E11 on Quality and Statistics and is the direct responsibility of Subcommittee E11.20 on Test Method
Evaluation and Quality Control.
Current edition approved May 15, 2022April 1, 2023. Published June 2022April 2023. Originally approved in 1979. Last previous edition approved in 20212022 as
E691 – 21.E691 – 22. DOI: 10.1520/E0691-22.10.1520/E0691-23.
2
For referenced ASTM standards, visit the ASTM website, www.astm.org, or contact ASTM Customer Service at service@astm.org. For Annual Book of ASTM Standards
volume information, refer to the standard’s Document Summary page on the ASTM website.
Copyright © ASTM International, 100 Barr Harbor Drive, PO Box C700, West Conshohocken, PA 19428-2959. United States
1
---------------------- Page: 1 ----------------------
E691 − 23
E29 Practice for Using Significant Digits in Test Data to Determine Conformance with Specifications
E177 Practice for Use of the Terms Precision and Bias in ASTM Test Methods
E456 Terminology Relating to Quality and Statistics
E1169 Practice for Conducting Ruggedness Tests
E1402 Guide for Sampling Design
E2282 Guide for Defining the Test Result of a Test Method
3. Terminology
3.1 Definitions—Terminology—Unless E456 provides a more extensive list of terms in E11 standards.otherwise noted in this
standard, all terms relating to quality and statistics are defined in E456.
3.1.1 accuracy, n—the closeness of agreement between a test result and an accepted reference value. E177
3.1.2 bias, n—the difference between the expectation of the test results and an accepted reference value. E177
3.1.3 interlaboratory study, (ILS) in ASTM, n—a
...
Questions, Comments and Discussion
Ask us and Technical Secretary will try to provide an answer. You can facilitate discussion about the standard in here.