ASTM E2655-14(2020)

Standard Guide for Reporting Uncertainty of Test Results and Use of the Term Measurement Uncertainty in ASTM Test Methods

ABSTRACT
This guide provides concepts necessary for understanding the term “uncertainty” when applied to a quantitative test result. Several measures of uncertainty can be applied to a given measurement result; the interpretation of some of the common forms is described. This guide describes methods for expressing test result uncertainty and relates these to standard statistical methodology. Relationships between uncertainty and concepts of precision and bias are described. This guide also presents concepts needed for a laboratory to identify and characterize components of method performance. Elements that an ASTM method can include to provide guidance to the user on estimating uncertainty for the method are described. This guide describes some of the types of data that the laboratory can use as the basis for reporting uncertainty.
SIGNIFICANCE AND USE
4.1 Part A of the “Blue Book,” Form and Style for ASTM Standards, introduces the statement of measurement uncertainty as an optional part of the report given for the result of applying a particular test method to a particular material.  
4.2 Preparation of uncertainty estimates is a requirement for laboratory accreditation under ISO/IEC 17025. This guide describes some of the types of data that the laboratory can use as the basis for reporting uncertainty.
SCOPE
1.1 This guide provides concepts necessary for understanding the term “uncertainty” when applied to a quantitative test result. Several measures of uncertainty can be applied to a given measurement result; the interpretation of some of the common forms is described.  
1.2 This guide describes methods for expressing test result uncertainty and relates these to standard statistical methodology. Relationships between uncertainty and concepts of precision and bias are described.  
1.3 This guide also presents concepts needed for a laboratory to identify and characterize components of method performance. Elements that an ASTM method can include to provide guidance to the user on estimating uncertainty for the method are described.  
1.4 The system of units for this guide is not specified. Dimensional quantities in the guide are presented only as illustrations of calculation methods and are not binding on products or test methods treated.  
1.5 This standard does not purport to address all of the safety concerns, if any, associated with its use. It is the responsibility of the user of this standard to establish appropriate safety, health, and environmental practices and determine the applicability of regulatory limitations prior to use.  
1.6 This international standard was developed in accordance with internationally recognized principles on standardization established in the Decision on Principles for the Development of International Standards, Guides and Recommendations issued by the World Trade Organization Technical Barriers to Trade (TBT) Committee.

General Information

• Status: Published
• Publication Date: 31-Dec-2019
• ICS: 17.020 - Metrology and measurement in general
• Technical Committee: E11 - Quality and Statistics
• Drafting Committee: E11.50 - Metrology

Relations

• Replaces: ASTM E2655-14 - Standard Guide for Reporting Uncertainty of Test Results and Use of the Term Measurement Uncertainty in ASTM Test Methods
• Effective Date: 01-Jan-2020
• Refers: ASTM E1402-13(2023) - Standard Guide for Sampling Design
• Effective Date: 01-Nov-2023
• Refers: ASTM E456-13a(2022)e1 - Standard Terminology Relating to Quality and Statistics
• Effective Date: 01-Apr-2022
• Refers: ASTM E2586-19e1 - Standard Practice for Calculating and Using Basic Statistics
• Effective Date: 01-Apr-2019
• Refers: ASTM E1402-13(2018) - Standard Guide for Sampling Design
• Effective Date: 01-Nov-2018
• Refers: ASTM E2554-18 - Standard Practice for Estimating and Monitoring the Uncertainty of Test Results of a Test Method Using Control Chart Techniques
• Effective Date: 01-Apr-2018
• Refers: ASTM E2554-18e1 - Standard Practice for Estimating and Monitoring the Uncertainty of Test Results of a Test Method Using Control Chart Techniques
• Effective Date: 01-Apr-2018
• Refers: ASTM E456-13A(2017)e1 - Standard Terminology Relating to Quality and Statistics
• Effective Date: 01-Oct-2017
• Refers: ASTM E456-13A(2017)e3 - Standard Terminology Relating to Quality and Statistics
• Effective Date: 01-Oct-2017
• Refers: ASTM E2586-14 - Standard Practice for Calculating and Using Basic Statistics
• Effective Date: 01-Jun-2014
• Refers: ASTM E177-14 - Standard Practice for Use of the Terms Precision and Bias in ASTM Test Methods
• Effective Date: 01-May-2014
• Refers: ASTM E456-13ae3 - Standard Terminology Relating to Quality and Statistics
• Effective Date: 15-Nov-2013
• Refers: ASTM E456-13ae1 - Standard Terminology Relating to Quality and Statistics
• Effective Date: 15-Nov-2013
• Refers: ASTM E456-13a - Standard Terminology Relating to Quality and Statistics
• Effective Date: 15-Nov-2013
• Refers: ASTM E456-13ae2 - Standard Terminology Relating to Quality and Statistics
• Effective Date: 15-Nov-2013

Overview

ASTM E2655-14(2020), Standard Guide for Reporting Uncertainty of Test Results and Use of the Term Measurement Uncertainty in ASTM Test Methods, provides essential guidance on identifying, estimating, and reporting measurement uncertainty in laboratory test results. Developed by ASTM Committee E11 on Quality and Statistics, this guide outlines concepts and methods critical for laboratories seeking to align with international best practices and accreditation requirements such as ISO/IEC 17025.

Measurement uncertainty quantifies the doubt associated with test results, reflecting the possible magnitude of error caused by systematic and random factors. This standard helps clarify the relationship between uncertainty, precision, and bias, and offers practical frameworks for reporting uncertainty alongside laboratory results.

Key Topics

• Measurement Uncertainty: Explanation of uncertainty as an estimate of possible error, encompassing both random and systematic components, and its importance for accurate interpretation of test results.
• Precision and Bias: Differentiating uncertainty from precision (repeatability/reproducibility) and bias, emphasizing that uncertainty provides context for a particular test result, while precision and bias characterize method performance.
• Types of Uncertainty Estimates: Introduction to Type A (statistical analysis of repeated measurements) and Type B (estimates from scientific judgment and other data) approaches for calculating uncertainty.
• Methods for Expressing Uncertainty: Guidance on expressing uncertainty in standard deviation terms (standard uncertainty), as multiples of standard uncertainty (expanded uncertainty), or as relative standard uncertainty.
• Uncertainty Budgets: Use of tabular formats to combine sources of uncertainty, applying the law of propagation of errors to determine the combined uncertainty associated with a test result.
• Components of Method Performance: Steps for laboratories to identify, characterize, and document performance elements impacting uncertainty, such as instrument calibration, sample handling, and environmental conditions.
• Reporting Practices: Recommending formats for reporting uncertainty with test results, including how to address bias and instances where full compliance or noncompliance with specifications is indeterminate due to uncertainty intervals.

Applications

The ASTM E2655-14(2020) standard is widely applicable across sectors where laboratory testing precision and reliability are critical. Key applications include:

• Laboratory Accreditation: Provides a foundation for laboratories pursuing accreditation under ISO/IEC 17025, where uncertainty estimation is a core requirement.
• Test Method Development: Guides developers in providing clear uncertainty estimation procedures for new ASTM test methods.
• Quality Assurance: Supports quality control departments in accurately communicating the measurement capability and limitations of laboratory results.
• Interlaboratory Studies: Assists in understanding and interpreting results from interlaboratory comparisons and proficiency testing.
• Regulatory Compliance: Offers clarity for industries where regulatory bodies require uncertainty estimates as part of product or process validation.

Laboratories utilize the guide’s best practices to enhance confidence in test results, ensure comparability between results from different institutions, and satisfy customer and regulator demands for transparency and traceability.

Related Standards

ASTM E2655-14(2020) references and complements several key standards for measurement statistics and laboratory quality, including:

• ISO/IEC 17025 – General requirements for the competence of testing and calibration laboratories
• ASTM E29 – Practice for Using Significant Digits in Test Data to Determine Conformance with Specifications
• ASTM E122 – Practice for Calculating Sample Size to Estimate Average Characteristics with Specified Precision
• ASTM E177 – Practice for Use of the Terms Precision and Bias in ASTM Test Methods
• ASTM E456 – Terminology Relating to Quality and Statistics
• ASTM E691 – Practice for Conducting an Interlaboratory Study to Determine the Precision of a Test Method
• ASTM E2554 – Practice for Estimating and Monitoring the Uncertainty of Test Results Using Control Chart Techniques
• ASTM E2586 – Practice for Calculating and Using Basic Statistics

Adhering to ASTM E2655-14(2020) enables laboratories and test method developers to meet international requirements for measurement uncertainty, improving overall data quality and user trust in reported results.

---

Keywords: measurement uncertainty, test result uncertainty, ASTM E2655, laboratory accreditation, ISO/IEC 17025, uncertainty budget, statistical methodology, precision, bias, quality assurance, reporting uncertainty

Standards Content (Sample)

This international standard was developed in accordance with internationally recognized principles on standardization established in the Decision on Principles for the
Development of International Standards, Guides and Recommendations issued by the World Trade Organization Technical Barriers to Trade (TBT) Committee.
Designation: E2655 − 14 (Reapproved 2020) An American National Standard
Standard Guide for
Reporting Uncertainty of Test Results and Use of the Term
Measurement Uncertainty in ASTM Test Methods
This standard is issued under the fixed designation E2655; the number immediately following the designation indicates the year of
original adoption or, in the case of revision, the year of last revision.Anumber in parentheses indicates the year of last reapproval.A
superscript epsilon (´) indicates an editorial change since the last revision or reapproval.
1. Scope 2. Referenced Documents
2.1 ASTM Standards:
1.1 This guide provides concepts necessary for understand-
E29Practice for Using Significant Digits in Test Data to
ing the term “uncertainty” when applied to a quantitative test
Determine Conformance with Specifications
result. Several measures of uncertainty can be applied to a
E122PracticeforCalculatingSampleSizetoEstimate,With
given measurement result; the interpretation of some of the
Specified Precision, the Average for a Characteristic of a
common forms is described.
Lot or Process
1.2 This guide describes methods for expressing test result
E177Practice for Use of the Terms Precision and Bias in
uncertainty and relates these to standard statistical methodol-
ASTM Test Methods
ogy. Relationships between uncertainty and concepts of preci-
E456Terminology Relating to Quality and Statistics
sion and bias are described.
E691Practice for Conducting an Interlaboratory Study to
Determine the Precision of a Test Method
1.3 This guide also presents concepts needed for a labora-
E1402Guide for Sampling Design
tory to identify and characterize components of method per-
E2554Practice for Estimating and Monitoring the Uncer-
formance. Elements that an ASTM method can include to
tainty of Test Results of a Test Method Using Control
provide guidance to the user on estimating uncertainty for the
Chart Techniques
method are described.
E2586Practice for Calculating and Using Basic Statistics
1.4 The system of units for this guide is not specified.
2.2 Other Standard:
Dimensional quantities in the guide are presented only as
ISO/IEC 17025General Requirements for the Competence
illustrations of calculation methods and are not binding on
of Testing and Calibration Laboratories
products or test methods treated.
3. Terminology
1.5 This standard does not purport to address all of the
3.1 Definitions:
safety concerns, if any, associated with its use. It is the
3.1.1 AdditionalstatisticaltermsaredefinedinTerminology
responsibility of the user of this standard to establish appro-
E456.
priate safety, health, and environmental practices and deter-
3.1.2 accepted reference value, n—a value that serves as an
mine the applicability of regulatory limitations prior to use.
agreed-upon reference for comparison, and which is derived
1.6 This international standard was developed in accor-
as: (1) a theoretical or established value, based on scientific
dance with internationally recognized principles on standard-
principles, (2) an assigned or certified value, based on experi-
ization established in the Decision on Principles for the
mental work of some national or international organization, or
Development of International Standards, Guides and Recom-
(3) a consensus or certified value, based on collaborative
mendations issued by the World Trade Organization Technical
experimental work under the auspices of a scientific or
Barriers to Trade (TBT) Committee.
engineering group. E177
For referenced ASTM standards, visit the ASTM website, www.astm.org, or
This guide is under the jurisdiction of ASTM Committee E11 on Quality and contact ASTM Customer Service at [e-mail]. For Annual Book of ASTM
Statistics and is the direct responsibility of Subcommittee E11.50 on Metrology. Standards volume information, refer to the standard’s Document Summary page on
Current edition approved Jan. 1, 2020. Published February 2020. Originally the ASTM website.
approved in 2008. Last previous edition approved in 2014 as E2655 – 14. DOI: Available fromAmerican National Standards Institute (ANSI), 25 W. 43rd St.,
10.1520/E2655-14R20. 4th Floor, New York, NY 10036, http://www.ansi.org.
Copyright ©ASTM International, 100 Barr Harbor Drive, PO Box C700, West Conshohocken, PA19428-2959. United States
E2655 − 14 (2020)
3.1.3 error of result, n—a test result minus the accepted estimate the approximate magnitude of all these sources of
reference value of the characteristic. error.Incommoncasesthemeasurementwillbereportedinthe
form x 6 u, in which x represents the test result and u
3.1.4 expanded uncertainty, U, n—uncertainty reported as a
represents the uncertainty associated with x.
multiple of the standard uncertainty.
5.2 Practice E177 describes precision and bias. Uncertainty
3.1.5 random error of result, n—a component of the error
is a closely related but not identical concept. The primary
that, in the course of a number of test results for the same
difference between concepts of precision and of uncertainty is
characteristic, varies in an unpredictable way.
the object that they address. Precision (repeatability and
3.1.5.1 Discussion—Uncertaintyduetorandomerrorcanbe
reproducibility)andbiasareattributesofthetestmethod.They
reduced by averaging multiple test results.
are estimates of statistical variability of test results for a test
3.1.6 sensitivity coeffıcient, n—differential effect of the
method applied to a given material. Repeatability and interme-
change in a factor on the test result.
diate precision measure variation within a laboratory. Repro-
3.1.7 standard uncertainty, u, n—uncertaintyreportedasthe
ducibility refers to interlaboratory variation. Uncertainty is an
standard deviation of the estimated value of the quantity
attribute of the particular test result for a test material. It is an
subject to measurement.
estimate of the quality of that particular test result.
3.1.8 systematic error of result, n—acomponentoftheerror
5.3 In the case of a quantity with a definition that does not
that, in the course of a number of test results for the same
depend on the measurement or test method (for example,
characteristic, remains constant or varies in a predictable way.
concentration, pH, modulus, heat content), uncertainty mea-
3.1.8.1 Discussion—Systematic errors and their causes may
sures how close it is believed the measured value comes to the
be known or unknown. When causes are known, systematic
quantity. For results of test methods where the target is only
error can sometimes be reduced by incorporating corrections
definable relative to the test method (for example, flash points,
into the calculation of the test result.
extractable components, sieve analysis), uncertainty of a test
3.1.9 uncertainty, n—anindicationofthemagnitudeoferror
result must be interpreted as a measure of how closely an
associated with a value that takes into account both systematic
independent, equally competent test result would agree with
errors and random errors associated with the measurement or
that being reported.
test process.
5.4 In the simplest cases, uncertainty of a test result is
3.1.10 uncertainty budget, n—a tabular listing of uncer-
numerically equivalent to test method precision. That is, if an
tainty components for a given measurement process giving the
unknownsampleistested,andthetestprecisionisknowntobe
magnitudes of contributions to uncertainty of the result from
sigma, then uncertainty of the result of test is sigma. The term
those sources.
uncertainty, however, is correct to apply where variation of
3.1.11 uncertainty component, n—a source of error in a test repeated test results is not relevant, as in the following
examples.
result to which is attached a standard uncertainty.
5.4.1 Example—The Newtonian constant of gravitation, G,
-11 -11 3 -1 -2
4. Significance and Use
is 6.6742 × 10 6 0.0010 × 10 m kg s based on 2002
4 -11 3 -1 -2
CODATArecommended values (1). 0.0010 × 10 m kg s
4.1 Part A of the “Blue Book,” Form and Style for ASTM
is the standard uncertainty. The value and the uncertainty
Standards, introduces the statement of measurement uncer-
together represent the state of knowledge of this fundamental
tainty as an optional part of the report given for the result of
physical constant. It is not naturally thought of in terms of
applying a particular test method to a particular material.
variationofrepeatedmeasurements.Both Ganditsuncertainty
4.2 Preparationofuncertaintyestimatesisarequirementfor
are derived from the analysis and comparison of a variety of
laboratory accreditation under ISO/IEC 17025. This guide
measurement data using methods that are an elaboration of
describes some of the types of data that the laboratory can use
those presented in this guide.
as the basis for reporting uncertainty.
5.4.2 Example—A length is measured but the result only
reported to the nearest inch (for example, a measuring rod
5. Concepts for Reporting Uncertainty of Test Results
graduated in inches was used to obtain the measurement).
5.1 Uncertainty is part of the relationship of a test result to
Precision of the reported value, in the sense of variation of
the property of interest for the material tested. When a test
repeated measurements, is zero when all reported lengths are
procedure is applied to a material, the test result is a value for
the same. In this case it is not possible to detect random
a characteristic of the material. The test result obtained will
variation in the series of repeated measurements. Uncertainty
usually differ from the actual value for that material. Multiple
of the length is primarily composed of the systematic error of
causes can contribute to the error of result. Errors of sampling
60.5 inch due to the resolution of the measurement apparatus.
andeffectsofsamplehandlingmaketheportionactuallytested
5.5 Thegoalinreportinguncertaintyistotakeaccountofall
not identical to the material as a whole. Imperfections in the
potential causes of error in the test result. In many cases,
test apparatus and its calibration, environmental, and human
uncertainty can be related to components of variability due to
factors also affect the result of testing. Nonetheless, after
testinghasbeencompleted,theresultobtainedwillbeusedfor
further purposes as if it were the actual value. Reporting
Theboldfacenumbersinparenthesesrefertothelistofreferencesattheendof
measurement uncertainty for a test result is an attempt to this standard.
E2655 − 14 (2020)
sampling and to testing. Both of these should be taken into 5.8.4 Confidence Intervals—A confidence interval for a
account for the uncertainty of the measurement when the parameter (the actual value of the material property subject to
purposeoftheresultistoestimatethepropertyfortheentirelot measurement) consists of upper and lower limits generated
of material from which the sample was taken. Uncertainty of from sample data by a method that ensures the limits bracket
the lot property value based on a single determination is then theparametervaluewithastatedprobability1-α,referredtoas
2 2 2
the confidence coefficient.
=s 1s 1u , where s is an estimate of the sampling standard
1 2 3 1
deviation, s is an estimate of the standard deviation of the test 5.8.4.1 From statistical theory, a 95% confidence interval
method,and u isstandarduncertaintyduetofactorsthataffect for the mean of a normal distribution, given n independent
all measurements under consideration. observations x , x ,…, x drawn from the distribution, is xH
1 2 n
6ts/=n wherex¯ isthesamplemean, sisthestandarddeviation
5.6 A commonly cited definition (2, 3) defines uncertainty
of the observations, and t is the 0.975 percentile of the
as“aparameter,associatedwiththemeasurementresult,ortest
Student’s t distribution with n-1 degrees of freedom. Because
result, that characterizes the dispersion of values that could
Student’s t distribution approaches the Normal as n increases,
reasonablybeattributedtothequantitysubjecttomeasurement
the value of t approaches 1.96 as n increases. This is the basis
or characteristic subject to test.” This definition emphasizes
for using the factor 2 for expanded uncertainty.
uncertaintyasanattributeoftheparticularresult,asopposedto
statistical variation of test results.The uncertainty parameter is
5.8.4.2 Practice E2586 defines confidence intervals and
a measure of spread (for example, the standard deviation) of a
provides additional detail on their interpretation.
probability distribution used to represent the likelihood of
5.8.5 Measurement Uncertainty—Measurement uncertainty
values of the property.
is uncertainty reported for a test result without taking into
5.7 The methodology for uncertainty estimates has been
account sampling variation or heterogeneity of the material of
classified as Type A and Type B as discussed in (4). Type A
interest. The report of measurement uncertainty then refers
estimates of uncertainty include standard error estimates based
specifically to the particular sample presented for analysis.
on knowledge of the statistical character of observations, and
5.8.6 Reporting Uncertainty with a Bias Component—Good
basedonstatisticalanalysisofreplicatemeasurements.TypeB
measurementpracticerequiresthatbiasesduetoenvironmental
estimates of uncertainty include approximate values derived
and other factors should be corrected in the reported result
fromexperiencewithmeasurementprocessessimilartotheone
when there is a sound basis for correction and the error in the
being considered, and estimates of standard uncertainty de-
correction terms themselves is not greater than the bias. Such
rived from the range of possible measurement values for a
corrections are part of the calculation of the result within the
given material and an assumed distribution of values within
testmethod.Thesymmetricalformofreportingameasurement
that range. See Practice E122 for examples (for example,
withstandarduncertainty, x 6 u,isadequateformeasurements
rectangular, triangular, normal) where a standard deviation is
where bias is absent or corrected. If the measurement process
derived from a range without data from samples being avail-
has a bias for which there is an estimate of magnitude and it is
able. Complex estimates of test result uncertainty are calcu-
notcorrectedinthereportedvalue x,aformofreportingshould
lated by combining Type A and Type B component standard
be used making clear both bias and random components. A
uncertainties for factors contributing to error (see Section 8).
typical form to highlight the asymmetry caused by bias is
x–u/+ u , where u = bias – standard uncertainty and u = bias
5.8 Forms of Uncertainty Expression:
l h l h
+ standard uncertainty.
5.8.1 Standard Uncertainty—The uncertainty is reported as
the standard deviation of the reported value. The report x 6 u
5.8.7 Bias estimates are often subjective or based on weak
implies that the value should be between x– u and x+ u with information.Whenbiasispresent,butmagnitudeanddirection
approximate probability two-thirds, where x is the test result.
areunknown,theuncertaintyofthebiasisanimportantpartof
5.8.2 Relative Standard Uncertainty—The uncertainty is uncertainty as a whole and should be combined with random
reported as a fraction of the reported value. For a measured
components. The overall root mean square uncertainty is then
2 2
value and a standard uncertainty, x 6 u, the relative standard
u5=u 1σ .
bias
uncertainty is u/x. This method of expressing uncertainty may
5.9 The repeatability and reproducibility values published
beusefulwhenstandarduncertaintyisproportionaltothevalue
foranASTMmethodarederivedfromaninterlaboratorystudy
over a wide range. However, for a particular result, reporting
following Practice E691 or a similar procedure. Repeatability
the value and standard uncertainty is preferred.
and reproducibility values given for ASTM test methods are
5.8.3 Expanded Uncertainty—Theuncertaintyisreportedas
intendedtoestimatethevariabilityoftestresultsforcompetent
x 6 U, where the value of U is a multiple of the standard
laboratories (see Practice E177). Reproducibility measures
uncertainty u. The most common multiple used is 2, which is
variability of test results on identical samples derived indepen-
approximately equal to the 1.96 factor for a 95% two-sided
dently by different laboratories. This reproducibility is a good
confidence interval for the mean of a normal distribution (see
guide to the uncertainty level that it is possible to achieve for
5.8.4).
measuredvaluesobtainedusingthemethod.Itmaybeusefulto
a user of test results from the method in the absence of a more
definiteuncertaintyestimate.However,alaboratorygenerating
A probability distribution representing the likelihood of property values given
test results using the test method should derive the value to
dataisknowninstatisticaltheoryastheBayesposteriordistributionoftheproperty
value. quote for its test results based on its own methodology and
E2655 − 14 (2020)
experience, which are not necessarily equivalent to the labo- thesharedcomponentsandunshared(independentfordifferent
ratories that participated in the original interlaboratory study. measurements)components,theuncertaintyoftheaverageof n
This is particularly true when the laboratory uses a highly
σ
such correlated measurements is σ 1 .
Œ
refined measurement method that no other or very few other
n
laboratories can replicate.
6.3 Uncertainty for Measurements by Difference or Ratio:
5.9.1 Variabilityofsamples,whenthequantityisaproperty
6.3.1 Measurements carried out using comparison to an
of a heterogeneous material
...