Standard Practice for Dealing With Outlying Observations

ABSTRACT
This practice covers outlying observations in samples and how to test the statistical significance of outliers. The procedures in this practice were developed primarily to apply to the simplest kind of experimental data, that is, replicate measurements of some property of a given material or observations in a supposedly random sample.
This practice covers alternatives that should be considered in dealing with an outlier. An outlying observation might be the result of gross deviation from prescribed experimental procedure or an error in calculating or recording the numerical value.
SCOPE
1.1 This practice covers outlying observations in samples and how to test the statistical significance of outliers.  
1.2 The system of units for this standard is not specified. Dimensional quantities in the standard are presented only as illustrations of calculation methods. The examples are not binding on products or test methods treated.  
1.3 This standard does not purport to address all of the safety concerns, if any, associated with its use. It is the responsibility of the user of this standard to establish appropriate safety and health practices and determine the applicability of regulatory requirements prior to use.

General Information

Status
Historical
Publication Date
06-Sep-2016
Technical Committee
Current Stage
Ref Project

Buy Standard

Standard
ASTM E178-16a - Standard Practice for Dealing With Outlying Observations
English language
11 pages
sale 15% off
Preview
sale 15% off
Preview
Standard
REDLINE ASTM E178-16a - Standard Practice for Dealing With Outlying Observations
English language
11 pages
sale 15% off
Preview
sale 15% off
Preview

Standards Content (Sample)

NOTICE: This standard has either been superseded and replaced by a new version or withdrawn.
Contact ASTM International (www.astm.org) for the latest information
Designation: E178 − 16a An American National Standard
Standard Practice for
1
Dealing With Outlying Observations
This standard is issued under the fixed designation E178; the number immediately following the designation indicates the year of
original adoption or, in the case of revision, the year of last revision.Anumber in parentheses indicates the year of last reapproval.A
superscript epsilon (´) indicates an editorial change since the last revision or reapproval.
Note—Corrections were made to Table 2 and the year date was changed on Sept. 7, 2016.
1. Scope 4. Significance and Use
4.1 An outlying observation, or “outlier,” is an extreme one
1.1 This practice covers outlying observations in samples
in either direction that appears to deviate markedly from other
and how to test the statistical significance of outliers.
members of the sample in which it occurs.
1.2 The system of units for this standard is not specified.
4.2 Statistical rules test the null hypothesis of no outliers
Dimensional quantities in the standard are presented only as
against the alternative of one or more actual outliers. The
illustrations of calculation methods. The examples are not
procedures covered were developed primarily to apply to the
binding on products or test methods treated.
simplest kind of experimental data, that is, replicate measure-
1.3 This standard does not purport to address all of the
ments of some property of a given material or observations in
safety concerns, if any, associated with its use. It is the
a supposedly random sample.
responsibility of the user of this standard to establish appro-
4.3 Astatistical test may be used to support a judgment that
priate safety and health practices and determine the applica-
a physical reason does actually exist for an outlier, or the
bility of regulatory requirements prior to use.
statistical criterion may be used routinely as a basis to initiate
action to find a physical cause.
2. Referenced Documents
2
2.1 ASTM Standards:
5. Procedure
E456Terminology Relating to Quality and Statistics
5.1 In dealing with an outlier, the following alternatives
E2586Practice for Calculating and Using Basic Statistics
should be considered:
5.1.1 An outlying observation might be the result of gross
3. Terminology
deviation from prescribed experimental procedure or an error
3.1 Definitions—The terminology defined in Terminology
in calculating or recording the numerical value. When the
E456 applies to this standard unless modified herein.
experimenter is clearly aware that a deviation from prescribed
3.1.1 order statistic x ,n—value of the kth observed value experimental procedure has taken place, the resultant observa-
(k)
in a sample after sorting by order of magnitude. E2586 tion should be discarded, whether or not it agrees with the rest
of the data and without recourse to statistical tests for outliers.
3.1.1.1 Discussion—In this practice, x is used to denote
k
If a reliable correction procedure is available, the observation
order statistics in place of x , to simplify the notation.
(k)
may sometimes be corrected and retained.
3.1.2 outlier—see outlying observation.
5.1.2 An outlying observation might be merely an extreme
3.1.3 outlying observation, n—an extreme observation in
manifestation of the random variability inherent in the data. If
either direction that appears to deviate markedly in value from
this is true, the value should be retained and processed in the
other members of the sample in which it appears.
same manner as the other observations in the sample. Trans-
formation of data or using methods of data analysis designed
for a non-normal distribution might be appropriate.
5.1.3 Test units that give outlying observations might be of
1
ThispracticeisunderthejurisdictionofASTMCommitteeE11onQualityand
special interest. If this is true, once identified they should be
Statistics and is the direct responsibility of Subcommittee E11.10 on Sampling /
Statistics.
segregated for more detailed study.
Current edition approved Sept. 7, 2016. Published September 2016. Originally
5.2 In many cases, evidence for deviation from prescribed
approved in 1961. Last previous edition approved in 2016 as E178–16. DOI:
10.1520/E0178-16A.
procedure will consist primarily of the discordant value itself.
2
For referenced ASTM standards, visit the ASTM website, www.astm.org, or
Insuchcasesitisadvisabletoadoptacautiousattitude.Useof
contact ASTM Customer Service at service@astm.org. For Annual Book of ASTM
one of the criteria discussed below will sometimes permit a
Standards volume information, refer to the standard’s Document Summary page on
the ASTM website. clearcut decision to be made.
Copyright © ASTM International, 100 Barr Harbor Drive, PO Box C700, West Conshohocken, PA 19428-2959. United States
1

---------------------- Page: 1 -----------------
...

This document is not an ASTM standard and is intended only to provide the user of an ASTM standard an indication of what changes have been made to the previous version. Because
it may not be technically possible to adequately depict all changes accurately, ASTM recommends that users consult prior editions as appropriate. In all cases only the current version
of the standard as published by ASTM is to be considered the official document.
Designation: E178 − 16 E178 − 16a An American National Standard
Standard Practice for
1
Dealing With Outlying Observations
This standard is issued under the fixed designation E178; the number immediately following the designation indicates the year of
original adoption or, in the case of revision, the year of last revision. A number in parentheses indicates the year of last reapproval. A
superscript epsilon (´) indicates an editorial change since the last revision or reapproval.
Note—Corrections were made to Table 2 and the year date was changed on Sept. 7, 2016.
1. Scope
1.1 This practice covers outlying observations in samples and how to test the statistical significance of outliers.
1.2 The system of units for this standard is not specified. Dimensional quantities in the standard are presented only as
illustrations of calculation methods. The examples are not binding on products or test methods treated.
1.3 This standard does not purport to address all of the safety concerns, if any, associated with its use. It is the responsibility
of the user of this standard to establish appropriate safety and health practices and determine the applicability of regulatory
requirements prior to use.
2. Referenced Documents
2
2.1 ASTM Standards:
E456 Terminology Relating to Quality and Statistics
E2586 Practice for Calculating and Using Basic Statistics
3. Terminology
3.1 Definitions:Definitions The —The terminology defined in Terminology E456 applies to this standard unless modified herein.
3.1.1 order statistic x , n—value of the kth observed value in a sample after sorting by order of magnitude. (Practice E2586.)
(k)
E2586
1
This practice is under the jurisdiction of ASTM Committee E11 on Quality and Statistics and is the direct responsibility of Subcommittee E11.10 on Sampling / Statistics.
Current edition approved June 1, 2016Sept. 7, 2016. Published June 2016September 2016. Originally approved in 1961. Last previous edition approved in 20082016 as
E178 – 08.E178 – 16. DOI: 10.1520/E0178-16.10.1520/E0178-16A.
2
For referenced ASTM standards, visit the ASTM website, www.astm.org, or contact ASTM Customer Service at service@astm.org. For Annual Book of ASTM Standards
volume information, refer to the standard’sstandard’s Document Summary page on the ASTM website.
3.1.1.1 Discussion—
In this Practice,practice, x is used to denote order statistics in place of x , to simplify the notation.
k (k)
3.1.2 outlier—see outlying observation.
3.1.3 outlying observation, n—an extreme observation in either direction that appears to deviate markedly in value from other
members of the sample in which it appears.
4. Significance and Use
4.1 An outlying observation, or “outlier,” is an extreme one in either direction that appears to deviate markedly from other
members of the sample in which it occurs.
4.2 Statistical rules test the null hypothesis of no outliers against the alternative of one or more actual outliers. The procedures
covered were developed primarily to apply to the simplest kind of experimental data, that is, replicate measurements of some
property of a given material or observations in a supposedly random sample.
4.3 A statistical test may be used to support a judgment that a physical reason does actually exist for an outlier, or the statistical
criterion may be used routinely as a basis to initiate action to find a physical cause.
5. Procedure
5.1 In dealing with an outlier, the following alternatives should be considered:
Copyright © ASTM International, 100 Barr Harbor Drive, PO Box C700, West Conshohocken, PA 19428-2959. United States
1

---------------------- Page: 1 ----------------------
E178 − 16a
5.1.1 An outlying observation might be the result of gross deviation from prescribed experimental procedure or an error in
calculating or recording the numerical value. When the experimenter is clearly aware that a deviation from prescribed experimental
procedure has taken place, the resultant observation should be discarded, whether or not it agrees with the rest of the data and
without recourse to statistical tests for outliers. If a reliable correction procedure is available, the observation may sometimes be
corrected and retained.
5.1.2 An outlying observation might be merely an extreme manifestation of the random variability inherent in the data. If this
is true, the value should be retained and processed in the same manner as the other observations in the sample. Transformation
of data or using methods of data analysis designed for a non-normal distribution might be appropriate.
5.1.3
...

Questions, Comments and Discussion

Ask us and Technical Secretary will try to provide an answer. You can facilitate discussion about the standard in here.