Standard Practice for Conducting Equivalence Tests for Comparing Testing Processes

ABSTRACT
This practice provides statistical methodology for conducting equivalence testing on numerical data from two sources to determine if their true means or variances differ by no more than predetermined limits. This standard provides guidance on experiments and statistical methods needed to demonstrate that the test results from a modified testing process are equivalent to those from the current testing process, where equivalence is defined as agreement within a prescribed limit, termed an equivalence limit.
SIGNIFICANCE AND USE
4.1 Laboratories conducting routine testing have a continuing need to make improvements in their testing processes. In these situations it must be demonstrated that any changes will neither cause an undesirable shift in the test results from the current testing process nor substantially affect a performance characteristic of the test method. This standard provides guidance on experiments and statistical methods needed to demonstrate that the test results from a modified testing process are equivalent to those from the current testing process, where equivalence is defined as agreement within a prescribed limit, termed an equivalence limit.  
4.1.1 The equivalence limit, which represents a worst-case difference or ratio, is determined prior to the equivalence test and its value is usually set by consensus among subject-matter experts.  
4.1.2 Examples of modifications to the testing process include, but are not limited, to the following:  
(1) Changes to operating levels in the steps of the test method procedure,
(2) Installation of new instruments, apparatus, or sources of reagents and test materials,
(3) Evaluation of new personnel performing the testing, and
(4) Transfer of testing to a new location.  
4.1.3 Examples of performance characteristics directly applicable to the test method include bias, precision, sensitivity, specificity, linearity, and range. Additional characteristics are test cost and elapsed time needed to conduct the test procedure.  
4.2 Equivalence testing is performed by a designed experiment that generates test results from the modified and current testing procedures on the same types of materials that are routinely tested. The design of the experiment depends on the type of equivalence needed as discussed below. Experiment design and execution for various objectives is discussed in Section 5.  
4.2.1 Means equivalence is concerned with a potential shift in the mean test result in either direction due to a modification in the tes...
SCOPE
1.1 This practice provides statistical methodology for conducting equivalence testing on numerical data from two sources of test results to determine if their true means, variances, or other parameters differ by no more than predetermined limits.  
1.2 Applications include (1) equivalence testing for bias against an accepted reference value, (2) determining means equivalence of two test methods, test apparatus, instruments, reagent sources, or operators within a laboratory or equivalence of two laboratories in a method transfer, and (3) determining non-inferiority of a modified test procedure versus a current test procedure with respect to a performance characteristic.  
1.3 The guidance in this standard applies to experiments conducted either on a single material at a given level of the test result or on multiple materials covering a selected range of test results.  
1.4 Guidance is given for determining the amount of data required for an equivalence trial. The control of risks associated with the equivalence decision is discussed.  
1.5 The values stated in SI units are to be regarded as standard. No other units of measurement are included in this standard.  
1.6 This standard does not purport to address all of the safety concerns, if any, associated with its use. It is the responsibility of the user of this standard to establish appropriate safety, health, and environmental practices and determine t...

General Information

Status
Historical
Publication Date
30-Jun-2020
Current Stage
Ref Project

Buy Standard

Standard
ASTM E2935-20e1 - Standard Practice for Conducting Equivalence Tests for Comparing Testing Processes
English language
23 pages
sale 15% off
Preview
sale 15% off
Preview
Standard
REDLINE ASTM E2935-20e1 - Standard Practice for Conducting Equivalence Tests for Comparing Testing Processes
English language
23 pages
sale 15% off
Preview
sale 15% off
Preview

Standards Content (Sample)

NOTICE: This standard has either been superseded and replaced by a new version or withdrawn.
Contact ASTM International (www.astm.org) for the latest information
´1
Designation: E2935 − 20 An American National Standard
Standard Practice for
Conducting Equivalence Tests for Comparing Testing
1
Processes
This standard is issued under the fixed designation E2935; the number immediately following the designation indicates the year of
original adoption or, in the case of revision, the year of last revision.Anumber in parentheses indicates the year of last reapproval.A
superscript epsilon (´) indicates an editorial change since the last revision or reapproval.
1
ε NOTE—Terms were corrected editorially in May 2021.
1. Scope mendations issued by the World Trade Organization Technical
Barriers to Trade (TBT) Committee.
1.1 This practice provides statistical methodology for con-
ducting equivalence testing on numerical data from two
2. Referenced Documents
sources of test results to determine if their true means,
2
2.1 ASTM Standards:
variances, or other parameters differ by no more than prede-
E122PracticeforCalculatingSampleSizetoEstimate,With
termined limits.
Specified Precision, the Average for a Characteristic of a
1.2 Applications include (1) equivalence testing for bias
Lot or Process
against an accepted reference value, (2) determining means
E177Practice for Use of the Terms Precision and Bias in
equivalence of two test methods, test apparatus, instruments,
ASTM Test Methods
reagent sources, or operators within a laboratory or equiva-
E456Terminology Relating to Quality and Statistics
lence of two laboratories in a method transfer, and (3)
E2282Guide for Defining the Test Result of a Test Method
determiningnon-inferiorityofamodifiedtestprocedureversus
E2586Practice for Calculating and Using Basic Statistics
a current test procedure with respect to a performance charac-
E3080Practice for Regression Analysis with a Single Pre-
teristic.
dictor Variable
3
1.3 The guidance in this standard applies to experiments
2.2 USP Standard:
conductedeitheronasinglematerialatagivenlevelofthetest
USP <1223> Validation of Alternative Microbiological
resultoronmultiplematerialscoveringaselectedrangeoftest
Methods
results.
3. Terminology
1.4 Guidance is given for determining the amount of data
3.1 Definitions—See Terminology E456 for a more exten-
required for an equivalence trial. The control of risks associ-
sive listing of statistical terms.
ated with the equivalence decision is discussed.
3.1.1 accepted reference value, n—a value that serves as an
1.5 The values stated in SI units are to be regarded as
agreed-upon reference for comparison, and which is derived
standard. No other units of measurement are included in this
as: (1) a theoretical or established value, based on scientific
standard.
principles, (2) an assigned or certified value, based on experi-
1.6 This standard does not purport to address all of the
mental work of some national or international organization, or
safety concerns, if any, associated with its use. It is the
(3) a consensus or certified value, based on collaborative
responsibility of the user of this standard to establish appro-
experimental work under the auspices of a scientific or
priate safety, health, and environmental practices and deter-
engineering group. E177
mine the applicability of regulatory limitations prior to use.
3.1.2 bias, n—the difference between the expectation of the
1.7 This international standard was developed in accor-
test results and an accepted reference value. E177
dance with internationally recognized principles on standard-
3.1.3 confidence interval, n—an interval estimate [L, U]
ization established in the Decision on Principles for the
with the statistics L and U as limits for the parameter θ and
Development of International Standards, Guides and Recom-
1 2
This test method is under the jurisdiction ofASTM Committee E11 on Quality For referenced ASTM standards, visit the ASTM website, www.astm.org, or
and Statistics and is the direct responsibility of Subcommittee E11.20 on Test contact ASTM Customer Service at service@astm.org. For Annual Book of ASTM
Method Evaluation and Quality Control. Standards volume information, refer to the standard’s Document Summary page on
Current edition approved July 1, 2020. Published August 2020. Originally the ASTM website.
3
approved in 2013. Last previous edition approved in 2017 as E2935 – 17. DOI: Available from U.S. Pharmacopeial Convention (USP), 12601 Twinbrook
10.1520/E2935-20E01. Pkwy., Rockville, MD 20852-1790, http://www.usp.org.
Copyright © ASTM International, 100 Barr Harbor Drive, PO Box C700, West Conshohocken, PA 19428-2959. United States
1

---------------------- Page: 1 ----------------------
´1
E2935 − 20
with confidence level 1 – α, where Pr(L ≤ θ ≤ U) ≥1– α. 3.1.17 repeatability standard deviation (s ), n—the standard
r
E2586 deviation of test results obtained under repeatability
conditions. E177
3.1.3.1 Discussion—Thecon
...

This document is not an ASTM standard and is intended only to provide the user of an ASTM standard an indication of what changes have been made to the previous version. Because
it may not be technically possible to adequately depict all changes accurately, ASTM recommends that users consult prior editions as appropriate. In all cases only the current version
of the standard as published by ASTM is to be considered the official document.
´1
Designation: E2935 − 20 E2935 − 20 An American National Standard
Standard Practice for
Conducting Equivalence Tests for Comparing Testing
1
Processes
This standard is issued under the fixed designation E2935; the number immediately following the designation indicates the year of
original adoption or, in the case of revision, the year of last revision. A number in parentheses indicates the year of last reapproval. A
superscript epsilon (´) indicates an editorial change since the last revision or reapproval.
1
ε NOTE—Terms were corrected editorially in May 2021.
1. Scope
1.1 This practice provides statistical methodology for conducting equivalence testing on numerical data from two sources of test
results to determine if their true means, variances, or other parameters differ by no more than predetermined limits.
1.2 Applications include (1) equivalence testing for bias against an accepted reference value, (2) determining means equivalence
of two test methods, test apparatus, instruments, reagent sources, or operators within a laboratory or equivalence of two
laboratories in a method transfer, and (3) determining non-inferiority of a modified test procedure versus a current test procedure
with respect to a performance characteristic.
1.3 The guidance in this standard applies to experiments conducted either on a single material at a given level of the test result
or on multiple materials covering a selected range of test results.
1.4 Guidance is given for determining the amount of data required for an equivalence trial. The control of risks associated with
the equivalence decision is discussed.
1.5 The values stated in SI units are to be regarded as standard. No other units of measurement are included in this standard.
1.6 This standard does not purport to address all of the safety concerns, if any, associated with its use. It is the responsibility
of the user of this standard to establish appropriate safety, health, and environmental practices and determine the applicability of
regulatory limitations prior to use.
1.7 This international standard was developed in accordance with internationally recognized principles on standardization
established in the Decision on Principles for the Development of International Standards, Guides and Recommendations issued
by the World Trade Organization Technical Barriers to Trade (TBT) Committee.
2. Referenced Documents
2
2.1 ASTM Standards:
E122 Practice for Calculating Sample Size to Estimate, With Specified Precision, the Average for a Characteristic of a Lot or
Process
1
This test method is under the jurisdiction of ASTM Committee E11 on Quality and Statistics and is the direct responsibility of Subcommittee E11.20 on Test Method
Evaluation and Quality Control.
Current edition approved July 1, 2020. Published August 2020. Originally approved in 2013. Last previous edition approved in 2017 as E2935 – 17. DOI:
10.1520/E2935-20.10.1520/E2935-20E01.
2
For referenced ASTM standards, visit the ASTM website, www.astm.org, or contact ASTM Customer Service at service@astm.org. For Annual Book of ASTM Standards
volume information, refer to the standard’sstandard’s Document Summary page on the ASTM website.
Copyright © ASTM International, 100 Barr Harbor Drive, PO Box C700, West Conshohocken, PA 19428-2959. United States
1

---------------------- Page: 1 ----------------------
´1
E2935 − 20
E177 Practice for Use of the Terms Precision and Bias in ASTM Test Methods
E456 Terminology Relating to Quality and Statistics
E2282 Guide for Defining the Test Result of a Test Method
E2586 Practice for Calculating and Using Basic Statistics
E3080 Practice for Regression Analysis with a Single Predictor Variable
3
2.2 USP Standard:
USP <1223> Validation of Alternative Microbiological Methods
3. Terminology
3.1 Definitions—See Terminology E456 for a more extensive listing of statistical terms.
3.1.1 accepted reference value, n—a value that serves as an agreed-upon reference for comparison, and which is derived as: (1)
a theoretical or established value, based on scientific principles, (2) an assigned or certified value, based on experimental work of
some national or international organization, or (3) a consensus or certified value, based on collaborative experimental work under
the auspices of a scientific or engineering group. E177
3.1.2 bias, n—the difference between the expectation of the test results and an accepted reference value. E177
3.1.3 confidence interval, n—an interval estimate [L, U] with the statistics L and U as limits for the parameter θ and with
co
...

Questions, Comments and Discussion

Ask us and Technical Secretary will try to provide an answer. You can facilitate discussion about the standard in here.