ASTM E3023-21

Standard Practice for Probability of Detection Analysis for <emph type="bdit"><?Pub _font FamName="Times New Roman"?>â<?Pub /_font?></emph> Versus <emph type="bdit">a</emph> Data

SIGNIFICANCE AND USE
5.1 The POD analysis method described herein is based on well-known and well-established statistical methods. It shall be used to quantify the demonstrated POD for a specific set of examination parameters and known range of discontinuity sizes under the following conditions.  
5.1.1 The initial response from a nondestructive evaluation inspection system is measurable and can be classified as a continuous variable.  
5.1.2 Discontinuity size is the predictor variable and can be accurately quantified.  
5.1.3 The relationship between discontinuity size (a) and measured signal response (â) exists and is best described by a linear regression model with an error structure that is normally distributed with mean zero and constant variance, σ2. (Note that in linear regression, “linear” means linear with respect to the model coefficients. Though a quadratic model  does not have a linear shape when plotted, for example, it is classified as a linear model in regression analysis since it is linear with respect to the model coefficients.)  
5.2 This practice does not limit the use of a linear regression model with more than one predictor variable or other statistical models if justified as more appropriate for the â versus a data.  
5.3 This practice is not appropriate for data resulting from a POD examination on nondestructive evaluation systems that generate an initial response that is binary in nature (for example, hit/miss). Practice E2862 is appropriate for systems that generate a hit/miss-type response (for example, fluorescent penetrant).  
5.4 Prior to performing the analysis, it is assumed that the discontinuity of interest is clearly defined; the number and distribution of induced discontinuity sizes in the POD specimen set is known and well documented; the POD examination administration procedure (including data collection method) is well designed, well defined, under control, and unbiased (see X1.2.2 for more detail); the initial inspection system response is m...
SCOPE
1.1 This practice defines the procedure for performing a statistical analysis on Nondestructive Testing (NDT) â versus a data to determine the demonstrated probability of detection (POD) for a specific set of examination parameters. Topics covered include the standard â versus a regression methodology, POD curve formulation, validation techniques, and correct interpretation of results.  
1.2 Units—The values stated in inch-pound units are to be regarded as standard. The values given in parentheses are mathematical conversions to SI units that are provided for information only and are not considered standard.  
1.3 This standard does not purport to address all of the safety concerns, if any, associated with its use. It is the responsibility of the user of this standard to establish appropriate safety, health, and environmental practices and determine the applicability of regulatory limitations prior to use.  
1.4 This international standard was developed in accordance with internationally recognized principles on standardization established in the Decision on Principles for the Development of International Standards, Guides and Recommendations issued by the World Trade Organization Technical Barriers to Trade (TBT) Committee.

General Information

• Status: Published
• Publication Date: 14-Feb-2021
• ICS: 19.100 - Non-destructive testing
• Technical Committee: E07 - Nondestructive Testing
• Drafting Committee: E07.10 - Specialized NDT Methods

Standards Content (Sample)

This international standard was developed in accordance with internationally recognized principles on standardization established in the Decision on Principles for the
Development of International Standards, Guides and Recommendations issued by the World Trade Organization Technical Barriers to Trade (TBT) Committee.
Designation: E3023 − 21
Standard Practice for
1
Probability of Detection Analysis for â Versus a Data
This standard is issued under the fixed designation E3023; the number immediately following the designation indicates the year of
original adoption or, in the case of revision, the year of last revision. A number in parentheses indicates the year of last reapproval. A
superscript epsilon (´) indicates an editorial change since the last revision or reapproval.
1. Scope E3080 Practice for Regression Analysis with a Single Pre-
dictor Variable
1.1 This practice defines the procedure for performing a
3
2.2 Department of Defense Document:
statisticalanalysisonNondestructiveTesting(NDT) âversus a
MIL-HDBK-1823A Nondestructive Evaluation System Re-
data to determine the demonstrated probability of detection
liability Assessment
(POD) for a specific set of examination parameters. Topics
covered include the standard â versus a regression
3. Terminology
methodology, POD curve formulation, validation techniques,
and correct interpretation of results.
3.1 Definitions of Terms Specific to This Standard:
3.1.1 analyst, n—the person responsible for performing a
1.2 Units—The values stated in inch-pound units are to be
POD analysis on â versus a data resulting from a POD
regarded as standard. The values given in parentheses are
examination.
mathematical conversions to SI units that are provided for
information only and are not considered standard.
3.1.2 decision threshold, â ,n—the value of â above
dec
which the signal is interpreted as a find and below which the
1.3 This standard does not purport to address all of the
signal is interpreted as a miss.
safety concerns, if any, associated with its use. It is the
responsibility of the user of this standard to establish appro-
3.1.2.1 Discussion—A decision threshold is required to
priate safety, health, and environmental practices and deter-
create a POD curve. The decision threshold is always greater
mine the applicability of regulatory limitations prior to use.
than or equal to the noise threshold and is the value of â that
1.4 This international standard was developed in accor-
corresponds with the flaw size that can be detected with 50 %
dance with internationally recognized principles on standard-
POD.
ization established in the Decision on Principles for the
3.1.3 demonstrated probability of detection, n—the calcu-
Development of International Standards, Guides and Recom-
lated POD value resulting from the statistical analysis of the â
mendations issued by the World Trade Organization Technical
versus a data.
Barriers to Trade (TBT) Committee.
3.1.4 false call, n—the perceived detection of a discontinu-
ity that is identified as a find during a POD examination when
2. Referenced Documents
2 no discontinuity actually exists at the inspection site.
2.1 ASTM Standards:
3.1.4.1 Discussion—A synonym for “false call” is “false
E178 Practice for Dealing With Outlying Observations
positive.”
E456 Terminology Relating to Quality and Statistics
3.1.5 noise, n—signal response containing no useful target
E1316 Terminology for Nondestructive Examinations
characterization information.
E1325 Terminology Relating to Design of Experiments
E2586 Practice for Calculating and Using Basic Statistics
3.1.6 noise threshold, â ,n—the value of â below which
noise
E2782 Guide for Measurement Systems Analysis (MSA)
the signal is indistinguishable from noise.
E2862 Practice for Probability of Detection Analysis for
3.1.6.1 Discussion—The noise threshold is always less than
Hit/Miss Data
or equal to the decision threshold. The noise threshold is used
to determine left censored data.
1
This practice is under the jurisdiction of ASTM Committee E07 on Nonde-
3.1.7 probability of detection (POD), n—the fraction of
structive Testing and is the direct responsibility of Subcommittee E07.10 on
nominal discontinuity sizes expected to be found given their
Specialized NDT Methods.
Current edition approved Feb. 15, 2021. Published March 2021. Originally existence.
approved in 2015. Last previous edition approved in 2015 as E3023 – 15. DOI:
10.1520/E3023-21.
2
For referenced ASTM standards, visit the ASTM website, www.astm.org, or
3
contact ASTM Customer Service at [e-mail]. For Annual Book of ASTM Available from Standardization Documents Order Desk, DODSSP, Bldg. 4,
Standards volume information, refer to the standard’s Document Summary page on Section D, 700 Robbins Ave., Philadelphia, PA 19111-5098, http://
the ASTM website. dodssp.daps.dla.mil.
Copyright © ASTM International, 100 Barr Harbor Drive, PO Box C700, West Conshohocken, PA 19428-2959. United States
1

---------------------- Page: 1 --
...

This document is not an ASTM standard and is intended only to provide the user of an ASTM standard an indication of what changes have been made to the previous version. Because
it may not be technically possible to adequately depict all changes accurately, ASTM recommends that users consult prior editions as appropriate. In all cases only the current version
of the standard as published by ASTM is to be considered the official document.
Designation: E3023 − 15 E3023 − 21
Standard Practice for
1
Probability of Detection Analysis for â Versus a Data
This standard is issued under the fixed designation E3023; the number immediately following the designation indicates the year of
original adoption or, in the case of revision, the year of last revision. A number in parentheses indicates the year of last reapproval. A
superscript epsilon (´) indicates an editorial change since the last revision or reapproval.
1. Scope
1.1 This practice defines the procedure for performing a statistical analysis on Nondestructive Testing (NDT) â versus a data to
determine the demonstrated probability of detection (POD) for a specific set of examination parameters. Topics covered include
the standard â versus a regression methodology, POD curve formulation, validation techniques, and correct interpretation of
results.
1.2 Units—The values stated in inch-pound units are to be regarded as standard. The values given in parentheses are mathematical
conversions to SI units that are provided for information only and are not considered standard.
1.3 This standard does not purport to address all of the safety concerns, if any, associated with its use. It is the responsibility
of the user of this standard to establish appropriate safety safety, health, and healthenvironmental practices and determine the
applicability of regulatory limitations prior to use.
1.4 This international standard was developed in accordance with internationally recognized principles on standardization
established in the Decision on Principles for the Development of International Standards, Guides and Recommendations issued
by the World Trade Organization Technical Barriers to Trade (TBT) Committee.
2. Referenced Documents
2
2.1 ASTM Standards:
E178 Practice for Dealing With Outlying Observations
E456 Terminology Relating to Quality and Statistics
E1316 Terminology for Nondestructive Examinations
E1325 Terminology Relating to Design of Experiments
E2586 Practice for Calculating and Using Basic Statistics
E2782 Guide for Measurement Systems Analysis (MSA)
E2862 Practice for Probability of Detection Analysis for Hit/Miss Data
E3080 Practice for Regression Analysis with a Single Predictor Variable
3
2.2 Department of Defense Document:
MIL-HDBK-1823A Nondestructive Evaluation System Reliability Assessment
3. Terminology
3.1 Definitions of Terms Specific to This Standard:
1
This test method practice is under the jurisdiction of ASTM Committee E07 on Nondestructive Testing and is the direct responsibility of Subcommittee E07.10 on
Specialized NDT Methods.
Current edition approved June 15, 2015Feb. 15, 2021. Published August 2015March 2021. Originally approved in 2015. Last previous edition approved in 2015 as
E3023 – 15. DOI: 10.1520/E3023–15.10.1520/E3023-21.
2
For referenced ASTM standards, visit the ASTM website, www.astm.org, or contact ASTM Customer Service at [e-mail]. For Annual Book of ASTM Standards
volume information, refer to the standard’s Document Summary page on the ASTM website.
3
Available from Standardization Documents Order Desk, DODSSP, Bldg. 4, Section D, 700 Robbins Ave., Philadelphia, PA 19111-5098, http://dodssp.daps.dla.mil.
Copyright © ASTM International, 100 Barr Harbor Drive, PO Box C700, West Conshohocken, PA 19428-2959. United States
1

---------------------- Page: 1 ----------------------
E3023 − 21
3.1.1 analyst, n—the person responsible for performing a POD analysis on â versus a data resulting from a POD examination.
3.1.2 decision threshold, â , n—the value of â above which the signal is interpreted as a find and below which the signal is
dec
interpreted as a miss.
3.1.2.1 Discussion—
A decision threshold is required to create a POD curve. The decision threshold is always greater than or equal to the noise threshold
and is the value of â that corresponds with the flaw size that can be detected with 50%50 % POD.
3.1.3 demonstrated probability of detection, n—the calculated POD value resulting from the statistical analysis of the â versus a
data.
3.1.4 false call, n—– the perceived detection of a discontinuity that is identified as a find during a POD examination when no
discontinuity actually exists at the inspection site.
3.1.4.1 Discussion—
A synonym for “false call” is “false positive.”
3.1.5 noise, n—signal response containing no useful target characterization information.
3.1.6 noise threshold, â , n—the value of â below which the signal is indistinguishable from noise.
noise
3.1.6.1 Discussion—
The noise threshold is always less tha
...