ASTM E691-19e1
(Practice)Standard Practice for Conducting an Interlaboratory Study to Determine the Precision of a Test Method
Standard Practice for Conducting an Interlaboratory Study to Determine the Precision of a Test Method
ABSTRACT
This practice describes the techniques for planning, conducting, analyzing, and treating the results of an interlaboratory study (ILS) of a test method. The statistical techniques described in this practice provide adequate information for formulating the precision statement of a test method. This practice is also concerned exclusively with test methods which yield a single numerical figure as the test result, although the single figure may be the outcome of a calculation from a set of measurements. ASTM regulations require precision statements in all test methods in terms of repeatability and reproducibility and knowledge of the test method precision is useful in commerce and in technical work when comparing test results against standard values or between data sources.
The procedures presented in this practice consist of three basic steps: planning the interlaboratory study, guiding the testing phase of the study, and analyzing the test result data.
SIGNIFICANCE AND USE
4.1 ASTM regulations require precision statements in all test methods in terms of repeatability and reproducibility. This practice may be used in obtaining the needed information as simply as possible. This information may then be used to prepare a precision statement in accordance with Practice E177. Knowledge of the test method precision is useful in commerce and in technical work when comparing test results against standard values (such as specification limits) or between data sources (different laboratories, instruments, etc.).
4.1.1 When a test method is applied to a large number of portions of a material that are as nearly alike as possible, the test results obtained will not all have the same value. A measure of the degree of agreement among these test results describes the precision of the test method for that material. Numerical measures of the variability between such test results provide inverse measures of the precision of the test method. Greater variability implies smaller (that is, poorer) precision and larger imprecision.
4.1.2 Precision is reported as a standard deviation, coefficient of variation (relative standard deviation), variance, or a precision limit (a data range indicating no statistically significant difference between test results).
4.1.3 This practice is designed only to estimate the precision of a test method. However, when accepted reference values are available for the property levels, the test result data obtained according to this practice may be used in estimating the bias of the test method. For a discussion of bias estimation and the relationships between precision, bias, and accuracy, see Practice E177.
4.2 The procedures presented in this practice consist of three basic steps: planning the interlaboratory study, guiding the testing phase of the study, and analyzing the test result data.
4.2.1 The planning phase includes forming the ILS task group, the study design, selection and number of participating laborator...
SCOPE
1.1 This practice describes the techniques for planning, conducting, analyzing, and treating the results of an interlaboratory study (ILS) of a test method. The statistical techniques described in this practice provide adequate information for formulating the precision statement of a test method.
1.2 This practice does not concern itself with the development of test methods but rather with gathering the information needed for a test method precision statement after the development stage has been successfully completed. The data obtained in the interlaboratory study may indicate, however, that further effort is needed to improve the test method.
1.3 Since the primary purpose of this practice is the development of the information needed for a precision statement, the experimental design in this practice may not be optimum for evaluating materials, apparatus, or individual laboratories.
1.4 Field of Application—This practice is concerned exclusively with ...
General Information
Buy Standard
Standards Content (Sample)
NOTICE: This standard has either been superseded and replaced by a new version or withdrawn.
Contact ASTM International (www.astm.org) for the latest information
´1
Designation: E691 − 19 An American National Standard
Standard Practice for
Conducting an Interlaboratory Study to Determine the
1
Precision of a Test Method
This standard is issued under the fixed designation E691; the number immediately following the designation indicates the year of
original adoption or, in the case of revision, the year of last revision.Anumber in parentheses indicates the year of last reapproval.A
superscript epsilon (´) indicates an editorial change since the last revision or reapproval.
This standard has been approved for use by agencies of the U.S. Department of Defense.
1
ε NOTE—Sections 3.1.6 and 3.1.10 were corrected editorially in April 2020.
1. Scope establish appropriate safety, health, and environmental prac-
tices and determine the applicability of regulatory limitations
1.1 This practice describes the techniques for planning,
prior to use.
conducting, analyzing, and treating the results of an interlabo-
1.6 This international standard was developed in accor-
ratory study (ILS) of a test method. The statistical techniques
dance with internationally recognized principles on standard-
described in this practice provide adequate information for
ization established in the Decision on Principles for the
formulating the precision statement of a test method.
Development of International Standards, Guides and Recom-
1.2 This practice does not concern itself with the develop-
mendations issued by the World Trade Organization Technical
ment of test methods but rather with gathering the information
Barriers to Trade (TBT) Committee.
needed for a test method precision statement after the devel-
opment stage has been successfully completed. The data
2. Referenced Documents
obtained in the interlaboratory study may indicate, however, 2
2.1 ASTM Standards:
that further effort is needed to improve the test method.
E29Practice for Using Significant Digits in Test Data to
1.3 Since the primary purpose of this practice is the devel-
Determine Conformance with Specifications
opmentoftheinformationneededforaprecisionstatement,the
E177Practice for Use of the Terms Precision and Bias in
experimental design in this practice may not be optimum for ASTM Test Methods
evaluating materials, apparatus, or individual laboratories.
E456Terminology Relating to Quality and Statistics
E1169Practice for Conducting Ruggedness Tests
1.4 Field of Application—This practice is concerned exclu-
E1402Guide for Sampling Design
sively with test methods which yield a single numerical figure
E2282Guide for Defining the Test Result of a Test Method
asthetestresult,althoughthesinglefiguremaybetheoutcome
of a calculation from a set of measurements.
3. Terminology
1.4.1 This practice does not cover methods in which the
3.1 Definitions—Terminology E456 provides a more exten-
measurement is a categorization; however, for many practical
sive list of terms in E11 standards.
purposescategoricaloutcomescanbescored,suchaszero-one
3.1.1 accuracy, n—the closeness of agreement between a
scoring for binary measurements or as integers, ranks for
test result and an accepted reference value. E177
example, for well-ordered categories and then the test result
can be defined as an average, or other summary statistic, of
3.1.2 bias, n—the difference between the expectation of the
several individual scores.
test results and an accepted reference value. E177
1.5 This standard may involve hazardous materials,
3.1.3 interlaboratory study, (ILS) in ASTM, n—a designed
operations, and equipment. This standard does not purport to
procedureforobtainingaprecisionstatementforatestmethod,
address all of the safety concerns, if any, associated with its
involving multiple laboratories, each generating replicate test
use. It is the responsibility of the user of this standard to
results on one or more materials.
3.1.4 observation, n—the process of obtaining information
regarding the presence or absence of an attribute of a test
1
ThispracticeisunderthejurisdictionofASTMCommitteeE11onQualityand
Statistics and is the direct responsibility of Subcommittee E11.20 on Test Method
2
Evaluation and Quality Control. For referenced ASTM standards, visit the ASTM website, www.astm.org, or
Current edition approved Sept. 1, 2019. Published October 2019. Originally contact ASTM Customer Service at service@astm.org. For Annual Book of ASTM
approved in 1979. Last previous edition approved in 2018 as E691–18. DOI: Standards volume information, refer to the standard’s Document Summary page on
10.1520/E0691-19E01. the ASTM website.
Copyright © ASTM International, 100 Barr Harbor Drive, PO Box C700, West Conshohocken, PA 19428-2959. United States
1
---------------------- Page: 1 ----------------------
ϵ1
E691 − 19
specimen, or of making a reading on a characteristic or 3.2.2 between-laboratory consistency statistic, h,
...
This document is not an ASTM standard and is intended only to provide the user of an ASTM standard an indication of what changes have been made to the previous version. Because
it may not be technically possible to adequately depict all changes accurately, ASTM recommends that users consult prior editions as appropriate. In all cases only the current version
of the standard as published by ASTM is to be considered the official document.
´1
Designation: E691 − 19 E691 − 19 An American National Standard
Standard Practice for
Conducting an Interlaboratory Study to Determine the
1
Precision of a Test Method
This standard is issued under the fixed designation E691; the number immediately following the designation indicates the year of
original adoption or, in the case of revision, the year of last revision. A number in parentheses indicates the year of last reapproval. A
superscript epsilon (´) indicates an editorial change since the last revision or reapproval.
This standard has been approved for use by agencies of the U.S. Department of Defense.
1
ε NOTE—Sections 3.1.6 and 3.1.10 were corrected editorially in April 2020.
1. Scope
1.1 This practice describes the techniques for planning, conducting, analyzing, and treating the results of an interlaboratory
study (ILS) of a test method. The statistical techniques described in this practice provide adequate information for formulating the
precision statement of a test method.
1.2 This practice does not concern itself with the development of test methods but rather with gathering the information needed
for a test method precision statement after the development stage has been successfully completed. The data obtained in the
interlaboratory study may indicate, however, that further effort is needed to improve the test method.
1.3 Since the primary purpose of this practice is the development of the information needed for a precision statement, the
experimental design in this practice may not be optimum for evaluating materials, apparatus, or individual laboratories.
1.4 Field of Application—This practice is concerned exclusively with test methods which yield a single numerical figure as the
test result, although the single figure may be the outcome of a calculation from a set of measurements.
1.4.1 This practice does not cover methods in which the measurement is a categorization; however, for many practical purposes
categorical outcomes can be scored, such as zero-one scoring for binary measurements or as integers, ranks for example, for
well-ordered categories and then the test result can be defined as an average, or other summary statistic, of several individual
scores.
1.5 This standard may involve hazardous materials, operations, and equipment. This standard does not purport to address all
of the safety concerns, if any, associated with its use. It is the responsibility of the user of this standard to establish appropriate
safety, health, and environmental practices and determine the applicability of regulatory limitations prior to use.
1.6 This international standard was developed in accordance with internationally recognized principles on standardization
established in the Decision on Principles for the Development of International Standards, Guides and Recommendations issued
by the World Trade Organization Technical Barriers to Trade (TBT) Committee.
2. Referenced Documents
2
2.1 ASTM Standards:
E29 Practice for Using Significant Digits in Test Data to Determine Conformance with Specifications
E177 Practice for Use of the Terms Precision and Bias in ASTM Test Methods
E456 Terminology Relating to Quality and Statistics
E1169 Practice for Conducting Ruggedness Tests
E1402 Guide for Sampling Design
E2282 Guide for Defining the Test Result of a Test Method
3. Terminology
3.1 Definitions—Terminology E456 provides a more extensive list of terms in E11 standards.
3.1.1 accuracy, n—the closeness of agreement between a test result and an accepted reference value. E177
1
This practice is under the jurisdiction of ASTM Committee E11 on Quality and Statistics and is the direct responsibility of Subcommittee E11.20 on Test Method
Evaluation and Quality Control.
Current edition approved Sept. 1, 2019. Published October 2019. Originally approved in 1979. Last previous edition approved in 2018 as E691 – 18. DOI:
10.1520/E0691-19.10.1520/E0691-19E01.
2
For referenced ASTM standards, visit the ASTM website, www.astm.org, or contact ASTM Customer Service at service@astm.org. For Annual Book of ASTM Standards
volume information, refer to the standard’s Document Summary page on the ASTM website.
Copyright © ASTM International, 100 Barr Harbor Drive, PO Box C700, West Conshohocken, PA 19428-2959. United States
1
---------------------- Page: 1 ----------------------
´1
E691 − 19
3.1.2 bias, n—the difference between the expectation of the test results and an accepted reference value. E177
3.1.3 interlaboratory study, (ILS) in ASTM, n—a designed procedure for obtaining a precision statem
...
Questions, Comments and Discussion
Ask us and Technical Secretary will try to provide an answer. You can facilitate discussion about the standard in here.