ASTM E1169-02

Standard Guide for Conducting Ruggedness Tests

SCOPE
1.1 In studying a test method, it is necessary to consider the effect of environmental factors on the results obtained using the test method. If this effect is not considered, the results from the original developmental work on the test method may not be as accurate as expected.The purpose of a ruggedness test is to find the variables (experimental factors) that strongly influence the measurements provided by the test method, and to determine how closely these variables need to be controlled. Ruggedness tests do not determine the optimum conditions for the test method.
1.2 The experimental designs most often used in ruggedness testing are the so called "Plackett-Burman" designs  (1). Other experimental designs also can be used. This guide, however, will restrict itself to Plackett-Burman designs with two levels per variable because these designs are particularly easy to use and are efficient in developing the information needed for improving test methods. The designs require the simultaneous change of the levels of all of the variables, and allow the determination of the separated effects of each of the variables on the measured results. In ruggedness tests the two levels for each variable are set so as not to be greatly different. For such situations, the calculated effect for any given variable is generally not greatly affected by changes in the level of any of the other variables. A detailed example involving glass electrode measurements of the pH of dilute acid solutions is used to illustrate ruggedness test procedures. A method is presented for evaluating the experimental uncertainties.
1.3 The information in this guide is arranged as follows:SectionScope1Referenced Documents2Terminology3Summary of Guide4Significance and Use5Plackett-Burman Designs Applied to Ruggedness Tests6Plackett-Burman Design Calculations7Plackett-Burman Design Considerations8Interpretation of Results9Example10Testing Effects from Repeated (pH) Experiments11Controllable versus Uncontrollable Factors12Additional Information13TablesFiguresAppendixesAdditional Plackett-BurmanAppendix X1. DesignsShort-Cut CalculationsReferencesX1.3.
1.4 This standard does not purport to address all of the safety concerns, if any, associated with its use. It is the responsibility of the user of this standard to establish appropriate safety and health practices and determine the applicability of regulatory limitations prior to use.

General Information

• Status: Historical
• Publication Date: 09-Oct-2002
• ICS: 19.020 - Test conditions and procedures in general
• Technical Committee: E11 - Quality and Statistics
• Drafting Committee: E11.20 - Test Method Evaluation and Quality Control

Relations

• Replaces: ASTM E1169-89(1996) - Standard Guide for Conducting Ruggedness Tests
• Effective Date: 10-Oct-2002
• Replaced By: ASTM E1169-07 - Standard Practice for Conducting Ruggedness Tests
• Effective Date: 01-Aug-2007
• Referred By: ASTM D8272-19 - Standard Guide for Development and Optimization of D19 Chemical Analysis Methods Intended for EPA Compliance Reporting
• Effective Date: 10-Oct-2002
• Referred By: ASTM D3670-91(2022) - Standard Guide for Determination of Precision and Bias of Methods of Committee D22
• Effective Date: 10-Oct-2002
• Referred By: ASTM E1488-12(2023) - Standard Guide for Statistical Procedures to Use in Developing and Applying Test Methods
• Effective Date: 10-Oct-2002
• Referred By: ASTM E1323-15(2020) - Standard Guide for Evaluating Laboratory Measurement Practices and the Statistical Analysis of the Resulting Data
• Effective Date: 10-Oct-2002
• Referred By: ASTM D7778-15(2022)e1 - Standard Guide for Conducting an Interlaboratory Study to Determine the Precision of a Test Method
• Effective Date: 10-Oct-2002
• Referred By: ASTM D2777-21 - Standard Practice for Determination of Precision and Bias of Applicable Test Methods of Committee D19 on Water
• Effective Date: 10-Oct-2002
• Referred By: ASTM E1601-19 - Standard Practice for Conducting an Interlaboratory Study to Evaluate the Performance of an Analytical Method
• Effective Date: 10-Oct-2002
• Referred By: ASTM E691-23 - Standard Practice for Conducting an Interlaboratory Study to Determine the Precision of a Test Method
• Effective Date: 10-Oct-2002
• Referred By: ASTM E2653-23 - Standard Practice for Conducting an Interlaboratory Study to Determine Precision Estimates for a Test Method with Fewer Than Six Participating Laboratories
• Effective Date: 10-Oct-2002
• Referred By: ASTM C1067-20 - Standard Practice for Conducting a Ruggedness Evaluation or Screening Program for Test Methods for Construction Materials
• Effective Date: 10-Oct-2002
• Referred By: ASTM E456-13a(2022) - Standard Terminology Relating to Quality and Statistics
• Effective Date: 10-Oct-2002
• Referred By: ASTM F2394-07(2022) - Standard Guide for Measuring Securement of Balloon-Expandable Vascular Stent Mounted on Delivery System
• Effective Date: 10-Oct-2002
• Referred By: ASTM E3098-17 - Standard Test Method for Mechanical Uniaxial Pre-strain and Thermal Free Recovery of Shape Memory Alloys
• Effective Date: 10-Oct-2002

Standards Content (Sample)

NOTICE: This standard has either been superseded and replaced by a new version or withdrawn.
Contact ASTM International (www.astm.org) for the latest information
An American National Standard
Designation:E1169–02
Standard Guide for
1
Conducting Ruggedness Tests
This standard is issued under the fixed designation E1169; the number immediately following the designation indicates the year of
original adoption or, in the case of revision, the year of last revision.Anumber in parentheses indicates the year of last reapproval.A
superscript epsilon (e) indicates an editorial change since the last revision or reapproval.
1. Scope
Interpretation of Results 9
Example 10
1.1 In studying a test method, it is necessary to consider the
Testing Effects from Repeated (pH) Experiments 11
effectofenvironmentalfactorsontheresultsobtainedusingthe
Controllable versus Uncontrollable Factors 12
Additional Information 13
testmethod.Ifthiseffectisnotconsidered,theresultsfromthe
Tables
original developmental work on the test method may not be as
Figures
accurateasexpected.Thepurposeofaruggednesstestistofind
Appendixes
Additional Plackett-Burman Designs Appendix X1.
the variables (experimental factors) that strongly influence the
Short-Cut Calculations X1.3.
measurements provided by the test method, and to determine
References
how closely these variables need to be controlled. Ruggedness
1.4 This standard does not purport to address all of the
tests do not determine the optimum conditions for the test
safety concerns, if any, associated with its use. It is the
method.
responsibility of the user of this standard to establish appro-
1.2 Theexperimentaldesignsmostoftenusedinruggedness
2 priate safety and health practices and determine the applica-
testingarethesocalled“Plackett-Burman”designs (1). Other
bility of regulatory limitations prior to use.
experimental designs also can be used. This guide, however,
will restrict itself to Plackett-Burman designs with two levels
2. Referenced Documents
per variable because these designs are particularly easy to use
2.1 ASTM Standards:
and are efficient in developing the information needed for
3
E456 Terminology Relating to Quality and Statistics
improving test methods. The designs require the simultaneous
3
E1325 Terminology Relating to Design of Experiments
change of the levels of all of the variables, and allow the
determination of the separated effects of each of the variables
3. Terminology
on the measured results. In ruggedness tests the two levels for
3.1 The terminology defined in Terminology E456 applies
each variable are set so as not to be greatly different. For such
to this standard unless modified herein.
situations, the calculated effect for any given variable is
3.1.1 ruggedness, n—insensitivity of a test method to de-
generally not greatly affected by changes in the level of any of
partures from specified test or environmental conditions.
the other variables. A detailed example involving glass elec-
3.1.1.1 Discussion—Anevaluationof“ruggedness”ofatest
trode measurements of the pH of dilute acid solutions is used
method or an empirical model derived from an experiment is
to illustrate ruggedness test procedures.Amethod is presented
useful in determining whether the results or decisions will be
for evaluating the experimental uncertainties.
relativelyinvariantoversomerangeofenvironmentalvariabil-
1.3 The information in this guide is arranged as follows:
ity under which the test method or the model is likely to be
Section
applied.
Scope 1
Referenced Documents 2 3.1.2 ruggedness test, n—a planned experiment in which
Terminology 3
environmental factors or test conditions are deliberately varied
Summary of Guide 4
in order to evaluate the effects of such variation.
Significance and Use 5
Plackett-Burman Designs Applied to Ruggedness Tests 6 3.1.2.1 Discussion—Since there usually are many environ-
Plackett-Burman Design Calculations 7
mental factors that might be considered in a ruggedness test, it
Plackett-Burman Design Considerations 8
is customary to use a “screening” type of experiment design
(see screening design) which concentrates on examining many
first order effects and generally assume that second order
1
This guide is under the jurisdiction of ASTM Committee E11 on Statistical
effects such as interactions and curvature are relatively negli-
Methods and is the direct responsibility of Subcommittee E11.20 on Test Method
gible. Often in evaluating the ruggedness of a test method, if
Evaluation and Quality Control.
Current edition approved Oct. 10, 2002. Published December 2002. Originally thereisanindicationthattheresultsofatestmethodarehighly
published as E1168–87. Last previous edition E1168–89(1996).
2
Theboldfacenumbersinparenthesesrefertothelistofreferencesattheendof
this guide.
3
† Editorially corrected. Annual Book of ASTM Standards, Vol 14.02.
Copyright © ASTM International, 100 Barr Harbor Drive, PO Box C700, West Conshohocken, PA 19428-2959, United States.
1

--------------
...