ASTM E2617-09
(Practice)Standard Practice for Validation of Empirically Derived Multivariate Calibrations
Standard Practice for Validation of Empirically Derived Multivariate Calibrations
SIGNIFICANCE AND USE
This practice outlines a universally applicable procedure to validate the performance of a quantitative or qualitative, empirically derived, multivariate calibration relative to an accepted reference method.
This practice provides procedures for evaluating the capability of a calibration to provide reliable estimations relative to an accepted reference method.
This practice provides purchasers of a measurement system that incorporates an empirically derived multivariate calibration with options for specifying validation requirements to ensure that the system is capable of providing estimations with an appropriate degree of agreement with an accepted reference method.
This practice provides the user of a measurement system that incorporates an empirically derived multivariate calibration with procedures capable of providing information that may be useful for ongoing quality assurance of the performance of the measurement system.
Validation information obtained in the application of this practice is applicable only to the material type and property range of the materials used to perform the validation and only for the individual measurement system on which the practice is completely applied. It is the user's responsibility to select the property levels and the compositional characteristics of the validation samples such that they are suitable to the application. This practice allows the user to write a comprehensive validation statement for the analyzer system including specific limits for the validated range of application and specific restrictions to the permitted uses of the measurement system. Users are cautioned against extrapolation of validation results beyond the material type(s) and property range(s) used to obtain these results.
Users are cautioned that a validated empirically derived multivariate calibration is applicable only to samples that fall within the subset population represented in the validation set. The estimation from an empirically de...
SCOPE
1.1 This practice covers requirements for the validation of empirically derived calibrations (Note 1) such as calibrations derived by Multiple Linear Regression (MLR), Principal Component Regression (PCR), Partial Least Squares (PLS), Artificial Neural Networks (ANN), or any other empirical calibration technique whereby a relationship is postulated between a set of variables measured for a given sample under test and one or more physical, chemical, quality, or membership properties applicable to that sample.
Note 1—Empirically derived calibrations are sometimes referred to as “models” or “calibrations.” In the following text, for conciseness, the term “calibration” may be used instead of the full name of the procedure.
1.2 This practice does not cover procedures for establishing said postulated relationship.
1.3 This practice serves as an overview of techniques used to verify the applicability of an empirically derived multivariate calibration to the measurement of a sample under test and to verify equivalence between the properties calculated from the empirically derived multivariate calibration and the results of an accepted reference method of measurement to within control limits established for the prespecified statistical confidence level.
1.4 This standard does not purport to address all of the safety concerns, if any, associated with its use. It is the responsibility of the user of this standard to establish appropriate safety and health practices and determine the applicability of regulatory limitations prior to use.
General Information
Relations
Buy Standard
Standards Content (Sample)
NOTICE: This standard has either been superseded and replaced by a new version or withdrawn.
Contact ASTM International (www.astm.org) for the latest information
Designation:E2617–09
Standard Practice for
1
Validation of Empirically Derived Multivariate Calibrations
This standard is issued under the fixed designation E 2617; the number immediately following the designation indicates the year of
original adoption or, in the case of revision, the year of last revision. A number in parentheses indicates the year of last reapproval. A
superscript epsilon (´) indicates an editorial change since the last revision or reapproval.
1. Scope E 1790 Practice for Near Infrared Qualitative Analysis
1.1 This practice covers requirements for the validation of
3. Terminology
empirically derived calibrations (Note 1) such as calibrations
3.1 For terminology related to molecular spectroscopic
derived by Multiple Linear Regression (MLR), Principal Com-
methods, refer to Terminology E 131. For terminology related
ponent Regression (PCR), Partial Least Squares (PLS), Artifi-
to multivariate quantitative modeling refer to PracticesE 1655.
cial Neural Networks (ANN), or any other empirical calibra-
WhilePracticesE 1655iswritteninthecontextofmultivariate
tion technique whereby a relationship is postulated between a
spectroscopic methods, the terminology is also applicable to
setofvariablesmeasuredforagivensampleundertestandone
other multivariate technologies.
or more physical, chemical, quality, or membership properties
3.2 Definitions of Terms Specific to This Standard:
applicable to that sample.
3.2.1 accuracy—the closeness of agreement between a test
NOTE 1—Empirically derived calibrations are sometimes referred to as
result and an accepted reference value.
“models”or“calibrations.”Inthefollowingtext,forconciseness,theterm
3.2.2 bias—the arithmetic average difference between the
“calibration” may be used instead of the full name of the procedure.
reference values and the values produced by the analytical
1.2 This practice does not cover procedures for establishing
method under test, for a set of samples.
said postulated relationship.
3.2.3 detection limit—the lowest level of a property in a
1.3 This practice serves as an overview of techniques used
sample that can be detected, but not necessarily quantified, by
to verify the applicability of an empirically derived multivari-
the measurement system.
ate calibration to the measurement of a sample under test and
3.2.4 estimate—the constituent concentration, identifica-
to verify equivalence between the properties calculated from
tion, or other property of a sample as determined by the
the empirically derived multivariate calibration and the results
analytical method being validated.
of an accepted reference method of measurement to within
3.2.5 initial validation—validation that is performed when
control limits established for the prespecified statistical confi-
an analyzer system is initially installed or after major mainte-
dence level.
nance.
1.4 This standard does not purport to address all of the
3.2.6 Negative Fraction Identified—the fraction of samples
safety concerns, if any, associated with its use. It is the
not having a particular characteristic that is identified as not
responsibility of the user of this standard to establish appro-
having that characteristic.
priate safety and health practices and determine the applica-
3.2.6.1 Discussion—Negative Fraction Identified assumes
bility of regulatory limitations prior to use.
that the characteristic that the test measures either is or is not
present. It is not applicable to tests with multiple possible
2. Referenced Documents
outcomes.
2
2.1 ASTM Standards:
3.2.7 ongoing periodic revalidation—the quality assurance
E 131 Terminology Relating to Molecular Spectroscopy
process by which, in the case of quantitative calibrations, the
E 1655 Practices for Infrared Multivariate Quantitative
bias and precision or, in the case of qualitative calibrations, the
Analysis
Positive Fraction Identified and Negative Fraction Identified
performance determined during initial validation are shown to
be sustained.
1
This practice is under the jurisdiction of ASTM Committee E13 on Molecular
3.2.8 Positive Fraction Identified—the fraction of samples
Spectroscopy and Separation Science and is the direct responsibility of Subcom-
having a particular characteristic that is identified as having
mittee E13.11 on Multivariate Analysis.
that characteristic.
Current edition approved March 1, 2009. Published April 2009. Originally
e1
approved in 2008. Last previous edition approved in 2008 as E 2617 – 08a .
3.2.8.1 Discussion—Positive Fraction Identified assumes
2
For referenced ASTM standards, visit the ASTM website, www.astm.org, or
that the characteristic that the test measures either is or is not
contact ASTM Customer Service at service@astm.org. For Annual Book of ASTM
present. It is not applicable to tests with multiple possible
Standards volume information, refe
...
This document is not anASTM standard and is intended only to provide the user of anASTM standard an indication of what changes have been made to the previous version. Because
it may not be technically possible to adequately depict all changes accurately, ASTM recommends that users consult prior editions as appropriate. In all cases only the current version
of the standard as published by ASTM is to be considered the official document.
´1
Designation:E2617–08a Designation:E2617–09
Standard Practice for
1
Validation of Empirically Derived Multivariate Calibrations
This standard is issued under the fixed designation E 2617; the number immediately following the designation indicates the year of
original adoption or, in the case of revision, the year of last revision. A number in parentheses indicates the year of last reapproval. A
superscript epsilon (´) indicates an editorial change since the last revision or reapproval.
1
´ NOTE—Annex A1 was editorially corrected to be classified as Appendix X1 in February 2009.
1. Scope
1.1 Thispracticecoversrequirementsforthevalidationofempiricallyderivedcalibrations(Note1)suchascalibrationsderived
by Multiple Linear Regression (MLR), Principal Component Regression (PCR), Partial Least Squares (PLS), Artificial Neural
Networks (ANN), or any other empirical calibration technique whereby a relationship is postulated between a set of variables
measured for a given sample under test and one or more physical, chemical, quality, or membership properties applicable to that
sample.
NOTE 1—Empirically derived calibrations are sometimes referred to as “models” or “calibrations.” In the following text, for conciseness, the term
“calibration” may be used instead of the full name of the procedure.
1.2 This practice does not cover procedures for establishing said postulated relationship.
1.3 This practice serves as an overview of techniques used to verify the applicability of an empirically derived multivariate
calibration to the measurement of a sample under test and to verify equivalence between the properties calculated from the
empirically derived multivariate calibration and the results of an accepted reference method of measurement to within control
limits established for the prespecified statistical confidence level.
1.4 This standard does not purport to address all of the safety concerns, if any, associated with its use. It is the responsibility
of the user of this standard to establish appropriate safety and health practices and determine the applicability of regulatory
limitations prior to use.
2. Referenced Documents
2
2.1 ASTM Standards:
E 131 Terminology Relating to Molecular Spectroscopy
E 1655 Practices for Infrared Multivariate Quantitative Analysis
E 1790 Practice for Near Infrared Qualitative Analysis
3. Terminology
3.1 For terminology related to molecular spectroscopic methods, refer to Terminology E 131. For terminology related to
multivariate quantitative modeling refer to Practices E 1655. While Practices E 1655 is written in the context of multivariate
spectroscopic methods, the terminology is also applicable to other multivariate technologies.
3.2 Definitions of Terms Specific to This Standard:
3.2.1 accuracy—the closeness of agreement between a test result and an accepted reference value.
3.2.2 bias—the arithmetic average difference between the reference values and the values produced by the analytical method
under test, for a set of samples.
3.2.3 detection limit—the lowest level of a property in a sample that can be detected, but not necessarily quantified, by the
measurement system.
3.2.4 estimate—the constituent concentration, identification, or other property of a sample as determined by the analytical
method being validated.
3.2.5 initial validation—validation that is performed when an analyzer system is initially installed or after major maintenance.
3.2.6 Negative Fraction Identified—the fraction of samples not having a particular characteristic that is identified as not having
that characteristic.
1
This practice is under the jurisdiction of ASTM Committee E13 on Molecular Spectroscopy and Separation Science and is the direct responsibility of Subcommittee
E13.11 on Multivariate Analysis.
Current edition approved Oct.March 1, 2008.2009. Published October 2008.April 2009. Originally approved in 2008. Last previous edition approved in 2008 as
e1
E 2617 – 08a .
2
For referencedASTM standards, visit theASTM website, www.astm.org, or contactASTM Customer Service at service@astm.org. For Annual Book of ASTM Standards
volume information, refer to the standard’s Document Summary page on the ASTM website.
Copyright © ASTM International, 100 Barr Harbor Drive, PO Box C700, West Conshohocken, PA 19428-2959, United States.
1
---------------------- Page: 1 ----------------------
E2617–09
3.2.6.1 Discussion—NegativeFractionIdentifiedassumesthatthecharacteristicthatthetestmeasureseitherisorisnotpresent.
It is not applicable to tests with multiple possible outcomes.
3.2.7 ongo
...
Questions, Comments and Discussion
Ask us and Technical Secretary will try to provide an answer. You can facilitate discussion about the standard in here.