ASTM E178-21
(Practice)Standard Practice for Dealing With Outlying Observations
Standard Practice for Dealing With Outlying Observations
ABSTRACT
This practice covers outlying observations in samples and how to test the statistical significance of outliers. The procedures in this practice were developed primarily to apply to the simplest kind of experimental data, that is, replicate measurements of some property of a given material or observations in a supposedly random sample.
SCOPE
1.1 This practice covers outlying observations in samples and how to test the statistical significance of outliers.
1.2 The system of units for this standard is not specified. Dimensional quantities in the standard are presented only as illustrations of calculation methods. The examples are not binding on products or test methods treated.
1.3 This standard does not purport to address all of the safety concerns, if any, associated with its use. It is the responsibility of the user of this standard to establish appropriate safety, health, and environmental practices and determine the applicability of regulatory limitations prior to use.
1.4 This international standard was developed in accordance with internationally recognized principles on standardization established in the Decision on Principles for the Development of International Standards, Guides and Recommendations issued by the World Trade Organization Technical Barriers to Trade (TBT) Committee.
General Information
Buy Standard
Standards Content (Sample)
This international standard was developed in accordance with internationally recognized principles on standardization established in the Decision on Principles for the
Development of International Standards, Guides and Recommendations issued by the World Trade Organization Technical Barriers to Trade (TBT) Committee.
Designation: E178 − 21 An American National Standard
Standard Practice for
1
Dealing With Outlying Observations
This standard is issued under the fixed designation E178; the number immediately following the designation indicates the year of
original adoption or, in the case of revision, the year of last revision.Anumber in parentheses indicates the year of last reapproval.A
superscript epsilon (´) indicates an editorial change since the last revision or reapproval.
1. Scope 3.1.2.1 Discussion—In this practice, x is used to denote
k
order statistics in place of x , to simplify the notation.
(k)
1.1 This practice covers outlying observations in samples
3.1.3 outlier—see outlying observation.
and how to test the statistical significance of outliers.
3.1.4 outlying observation, n—an extreme observation in
1.2 The system of units for this standard is not specified.
either direction that appears to deviate markedly in value from
Dimensional quantities in the standard are presented only as
other members of the sample in which it appears.
illustrations of calculation methods. The examples are not
binding on products or test methods treated.
3.1.4.1 Discussion—The identification of a value as
1.3 This standard does not purport to address all of the
outlying, and therefore a doubtful observation, is a judgement
safety concerns, if any, associated with its use. It is the
of the analyst and can be made before any statistical test.
responsibility of the user of this standard to establish appro-
4. Significance and Use
priate safety, health, and environmental practices and deter-
mine the applicability of regulatory limitations prior to use. 4.1 An outlying observation, or “outlier,” is an extreme one
in either direction that appears to deviate markedly from other
1.4 This international standard was developed in accor-
dance with internationally recognized principles on standard- members of the sample in which it occurs.
ization established in the Decision on Principles for the
4.2 Statistical rules test the null hypothesis of no outliers
Development of International Standards, Guides and Recom-
against the alternative of one or more actual outliers. The
mendations issued by the World Trade Organization Technical
procedures covered were developed primarily to apply to the
Barriers to Trade (TBT) Committee.
simplest kind of experimental data, that is, replicate measure-
ments of some property of a given material or observations in
2. Referenced Documents
a supposedly random sample.
2
2.1 ASTM Standards:
4.3 Astatistical test may be used to support a judgment that
E456Terminology Relating to Quality and Statistics
a physical reason does actually exist for an outlier, or the
E2586Practice for Calculating and Using Basic Statistics
statistical criterion may be used routinely as a basis to initiate
3. Terminology action to find a physical cause.
3.1 Definitions—Unlessotherwisenotedinthisstandard,all
5. Procedure
terms relating to quality and statistics are defined in Terminol-
5.1 In dealing with an outlier, the following alternatives
ogy E456.
should be considered:
3.1.1 null hypothesis, H ,n—astatementaboutaparameter
0
5.1.1 An outlying observation might be the result of gross
of a probability distribution or about the type of probability
deviation from prescribed experimental procedure or an error
distribution, tentatively regarded as true until rejected using a
in calculating or recording the numerical value. When the
statistical hypothesis test. E2586
experimenter is clearly aware that a deviation from prescribed
3.1.2 order statistic x ,n—value of the kth observed value
(k)
experimental procedure has taken place, the resultant observa-
in a sample after sorting by order of magnitude. E2586
tion should be discarded, whether or not it agrees with the rest
of the data and without recourse to statistical tests for outliers.
1
ThispracticeisunderthejurisdictionofASTMCommitteeE11onQualityand
If a reliable correction procedure is available, the observation
Statistics and is the direct responsibility of Subcommittee E11.10 on Sampling /
may sometimes be corrected and retained.
Statistics.
5.1.2 An outlying observation might be merely an extreme
Current edition approved June 1, 2021. Published June 2021. Originally
manifestation of the random variability inherent in the data. If
approved in 1961. Last previous edition approved in 2016 as E178–16a. DOI:
10.1520/E0178-21.
this is true, the value should be retained and processed in the
2
For referenced ASTM standards, visit the ASTM website, www.astm.org, or
same manner as the other observations in the sample. Trans-
contact ASTM Customer Service at service@astm.org. For Annu
...
This document is not an ASTM standard and is intended only to provide the user of an ASTM standard an indication of what changes have been made to the previous version. Because
it may not be technically possible to adequately depict all changes accurately, ASTM recommends that users consult prior editions as appropriate. In all cases only the current version
of the standard as published by ASTM is to be considered the official document.
Designation: E178 − 16a E178 − 21 An American National Standard
Standard Practice for
1
Dealing With Outlying Observations
This standard is issued under the fixed designation E178; the number immediately following the designation indicates the year of
original adoption or, in the case of revision, the year of last revision. A number in parentheses indicates the year of last reapproval. A
superscript epsilon (´) indicates an editorial change since the last revision or reapproval.
Note—Corrections were made to Table 2 and the year date was changed on Sept. 7, 2016.
1. Scope
1.1 This practice covers outlying observations in samples and how to test the statistical significance of outliers.
1.2 The system of units for this standard is not specified. Dimensional quantities in the standard are presented only as illustrations
of calculation methods. The examples are not binding on products or test methods treated.
1.3 This standard does not purport to address all of the safety concerns, if any, associated with its use. It is the responsibility
of the user of this standard to establish appropriate safety safety, health, and healthenvironmental practices and determine the
applicability of regulatory requirementslimitations prior to use.
1.4 This international standard was developed in accordance with internationally recognized principles on standardization
established in the Decision on Principles for the Development of International Standards, Guides and Recommendations issued
by the World Trade Organization Technical Barriers to Trade (TBT) Committee.
2. Referenced Documents
2
2.1 ASTM Standards:
E456 Terminology Relating to Quality and Statistics
E2586 Practice for Calculating and Using Basic Statistics
3. Terminology
3.1 Definitions—The terminology defined in Terminology—Unless otherwise noted in this E456 applies to this standard unless
modified herein.standard, all terms relating to quality and statistics are defined in Terminology E456.
3.1.1 null hypothesis, H , n—a statement about a parameter of a probability distribution or about the type of probability
0
distribution, tentatively regarded as true until rejected using a statistical hypothesis test. E2586
3.1.2 order statistic x , n—value of the kth observed value in a sample after sorting by order of magnitude. E2586
(k)
3.1.2.1 Discussion—
In this practice, x is used to denote order statistics in place of x , to simplify the notation.
k (k)
3.1.3 outlier—see outlying observation.
1
This practice is under the jurisdiction of ASTM Committee E11 on Quality and Statistics and is the direct responsibility of Subcommittee E11.10 on Sampling / Statistics.
Current edition approved Sept. 7, 2016June 1, 2021. Published September 2016June 2021. Originally approved in 1961. Last previous edition approved in 2016 as
E178 – 16.E178 – 16a. DOI: 10.1520/E0178-16A.10.1520/E0178-21.
2
For referenced ASTM standards, visit the ASTM website, www.astm.org, or contact ASTM Customer Service at service@astm.org. For Annual Book of ASTM Standards
volume information, refer to the standard’s Document Summary page on the ASTM website.
Copyright © ASTM International, 100 Barr Harbor Drive, PO Box C700, West Conshohocken, PA 19428-2959. United States
1
---------------------- Page: 1 ----------------------
E178 − 21
3.1.4 outlying observation, n—an extreme observation in either direction that appears to deviate markedly in value from other
members of the sample in which it appears.
3.1.4.1 Discussion—
The identification of a value as outlying, and therefore a doubtful observation, is a judgement of the analyst and can be made before
any statistical test.
4. Significance and Use
4.1 An outlying observation, or “outlier,” is an extreme one in either direction that appears to deviate markedly from other
members of the sample in which it occurs.
4.2 Statistical rules test the null hypothesis of no outliers against the alternative of one or more actual outliers. The procedures
covered were developed primarily to apply to the simplest kind of experimental data, that is, replicate measurements of some
property of a given material or observations in a supposedly random sample.
4.3 A statistical test may be used to support a judgment that a physical reason does actually exist for an outlier, or the statistical
criterion may be used routinely as a basis to initiate action to find a physical cause.
5. Procedure
5.1 In dealing with an outlier, the following alternatives should be considered:
5.1.1 An outlying observation might be the result of gross deviation from prescri
...
Questions, Comments and Discussion
Ask us and Technical Secretary will try to provide an answer. You can facilitate discussion about the standard in here.