ASTM D6543-00(2012)e1
(Guide)Standard Guide to the Evaluation of Measurements Made by Online Coal Analyzers
Standard Guide to the Evaluation of Measurements Made by Online Coal Analyzers
SIGNIFICANCE AND USE
5.1 Online analyzers are used to provide quality data on lots of coal. The resulting quality data are used as a production tool or for some contractual application. This guide provides means of evaluating the system and data produced.
5.2 The user should become familiar with the document's terminology and layout. The section on test design and data collection will provide the means by which all the analysis data will be gathered. The test design should be carefully considered to assure meeting the user's requirements.
5.3 The procedures defined in this guide can be used to test the accuracy and precision of an online analyzer, for acceptance after its installation, to check precision and accuracy during routine use (quality control), when changes are made to the system, when the nature of the coal being tested changes, and to determine mathematical factors to be used for calibration of the online analyzer.
SCOPE
1.1 This guide provides techniques to be used for the evaluation of the measurement performance of online coal analyzers.
1.2 This standard does not purport to address all of the safety concerns, if any, associated with its use. It is the responsibility of the user of this standard to establish appropriate safety and health practices and determine the applicability of regulatory limitations prior to use.
General Information
Relations
Standards Content (Sample)
NOTICE: This standard has either been superseded and replaced by a new version or withdrawn.
Contact ASTM International (www.astm.org) for the latest information
´1
Designation: D6543 − 00(Reapproved 2012)
Standard Guide to
the Evaluation of Measurements Made by Online Coal
Analyzers
This standard is issued under the fixed designation D6543; the number immediately following the designation indicates the year of
original adoption or, in the case of revision, the year of last revision. A number in parentheses indicates the year of last reapproval. A
superscript epsilon (´) indicates an editorial change since the last revision or reapproval.
ε NOTE—Editorial changes were made throughout in March 2013.
1. Scope 3.1.2 calibration, n—mathematical modeling of analyzer
and comparative coal sampling and analysis data. Factors from
1.1 This guide provides techniques to be used for the
the model are used in the online analyzer control software.
evaluation of the measurement performance of online coal
3.1.3 Grubbs estimator, n—an estimate of the measurement
analyzers.
precision of an online analyzer (1-3).
1.2 This standard does not purport to address all of the
3.1.4 online analyzer, n—an analytical tool consisting of an
safety concerns, if any, associated with its use. It is the
instrumentandsystems,whichtogetherprovidemeasurements,
responsibility of the user of this standard to establish appro-
or estimates, or both, of coal quality parameters.
priate safety and health practices and determine the applica-
bility of regulatory limitations prior to use.
3.1.5 outlier, n—an extreme value that statistical tests indi-
cate to be far enough from other results in a population under
2. Referenced Documents
consideration to cause suspicion that the value is not a member
2.1 ASTM Standards:
of the population.
D121 Terminology of Coal and Coke
3.1.6 reference material, n—material of stable composition
D2013 Practice for Preparing Coal Samples for Analysis
that may be used to generate static analyzer measurements.
D2234/D2234M Practice for Collection of a Gross Sample
3.1.7 reference system, n—a measurement system used to
of Coal
measure the characteristics of a lot of coal that are also
D4702 Practice for Quality Management of Mechanical
3 measured by an online analyzer, and against which the online
Coal Sampling Systems (Withdrawn 2008)
analyzer measurements are compared.
D6518 Practice for Bias Testing a Mechanical Coal Sam-
3.1.8 standardization, n—calibration of an instrument to a
pling System (Withdrawn 2008)
reference material using static stability measurements.
E177 Practice for Use of the Terms Precision and Bias in
ASTM Test Methods
3.1.9 static stability, n—an estimate of the measurement
E178 Practice for Dealing With Outlying Observations
precision of an instrument obtained on material that is not
E456 Terminology Relating to Quality and Statistics
moving. The estimate normally is expressed as the standard
deviation and average of the measurements for a given period
3. Terminology
of time.
3.1 Definitions:
3.1.10 synchronization error, n—an error that occurs from
3.1.1 analyzer system, n—a coal quality measurement sys-
comparing measurements made by an online analyzer and a
tem which includes an online coal analyzer and which may
reference system that are not measuring exactly the same lot
include one or more stages of a coal-sampling system.
because of temporal and/or spatial offsets.
4. Summary of Guide
This guide is under the jurisdiction of ASTM Committee D05 on Coal and
Coke and is the direct responsibility of Subcommittee D05.23 on Sampling.
4.1 This guide outlines the evaluation of the measurement
Current edition approved Sept. 1, 2012. Published November 2012. Originally
performance of an online analyzer using comparative measure-
approved in 2000. Last previous edition approved in 2006 as D6543–00(2006).
ments. The comparative test uses a paired comparison of
DOI: 10.1520/D6543-00R12E01.
For referenced ASTM standards, visit the ASTM website, www.astm.org, or
analysis from a reference method using ASTM sampling,
contact ASTM Customer Service at service@astm.org. For Annual Book of ASTM
Standards volume information, refer to the standard’s Document Summary page on
the ASTM website.
3 4
The last approved version of this historical standard is referenced on The boldface numbers in parentheses refer to the list of references at the end of
www.astm.org. this standard.
Copyright © ASTM International, 100 Barr Harbor Drive, PO Box C700, West Conshohocken, PA 19428-2959. United States
´1
D6543 − 00 (2012)
sample preparation, and analysis methods for a lot of coal with 6.1.4.3 Laboratory services;
the analysis from the online analyzer for the same lot of coal. 6.1.4.4 Sampling technique;
The data resulting from the comparative test may be evaluated 6.1.4.5 Coal flow rates; and
using graphical and statistical techniques outlined below. 6.1.4.6 Power disturbances.
4.2 Varioustechniquesarerecommendedbyonlineanalyzer
6.2 Static Stability Measurements for Baseline
manufacturers for standardization or static testing. These Assessment—A reference material may be used to provide a
techniques are useful for establishing a benchmark before
baseline assessment of static measurement precision. The
conducting a comparative test. These techniques also may be reference material may be used to compare current mean and
used as diagnostic tests in accordance with methods recom-
standard deviation values with mean and standard deviation
mended by online analyzer manufacturers and graphical and values, previously collected in the same manner. The resulting
statistical techniques included in this guide. comparative data may be used to assess whether any change in
the mean or standard deviation of the static measurements may
5. Significance and Use
be attributed to a change in the operating characteristics of the
5.1 Online analyzers are used to provide quality data on lots
analyzer, in the absence of the influence of sampling and
of coal.The resulting quality data are used as a production tool
analysis.
or for some contractual application.This guide provides means
6.2.1 Reference materials may include actual coal in a
of evaluating the system and data produced.
sealed container, cast high-carbon solids, or other materials
which may be provided by the analyzer manufacturer. The
5.2 The user should become familiar with the document’s
primary characteristic of these materials is that they not be
terminology and layout. The section on test design and data
subject to changes in composition.
collectionwillprovidethemeansbywhichalltheanalysisdata
6.2.2 The results of this evaluation can indicate whether
will be gathered. The test design should be carefully consid-
analyzer performance has significantly degraded or whether a
ered to assure meeting the user’s requirements.
shift may have occurred. If so, it may be possible to adjust the
5.3 The procedures defined in this guide can be used to test
analyzer to restore initial performance. If the user wishes only
the accuracy and precision of an online analyzer, for accep-
to measure current static repeatability, any available coal may
tance after its installation, to check precision and accuracy
be used in the analysis zone of the analyzer. Note, however,
during routine use (quality control), when changes are made to
that the actual standard deviation in static repeatability tests
the system, when the nature of the coal being tested changes,
might be influenced by the composition of the coal being
and to determine mathematical factors to be used for calibra-
examined or analyzer factors, such as the strength of the
tion of the online analyzer.
radioactive sources used by the analyzer or condition of
analyzer electronic components.
6. Selection and Conduct of Performance Evaluations
6.2.3 It is essential that the length of the analysis period be
6.1 Introduction:
defined,(forexample,1,2,or5minutes)andbeconstantinthe
6.1.1 Several techniques can be used to evaluate the perfor-
static stability test.The static standard deviation resulting from
mance of an online analyzer. These techniques provide data
the static stability test decreases as the length of the analysis
that can be evaluated by using the graphical and statistical
period increases. Static stability testing may be conducted on
methods described in Section 7 of this guide.
the same day(s) as comparative tests. One type of static test
6.1.2 At the time of installation, all of the graphical and
involves a comparison of the analyzer to static coal over many
numerical methods outlined in this guide may prove useful. On
hours.
a routine basis, conducting any of the instrument stability
6.3 Comparison of Analyzer System to Reference System
checks and comparative evaluations that do not disrupt normal
Measurements:
operations may prove useful. Control charts may be applied to
6.3.1 Once an analyzer installation has been completed and
all the performance measures that are gathered on a routine
basis, including mean analysis value of reference material, calibration adjustments have been made, the analyzer owner
may require acceptance testing. Also, the analyzer owner may
RMSD, etc.
decide to relocate the analyzer. In these cases, comparison
6.1.3 In the event that there is a change to the operational
parametersortheequipmentassociatedwiththeanalyzerorthe tests–that is, to compare the analyzer system results to conven-
tional sampling and analysis techniques–will provide the user
reference system, comparative checks should be performed. In
addition to comparative checks, standardization or static calibration verification data and/or data that could be used for
recalibration of the analyzer.
checks, or both, as recommended by the online analyzer
manufacturer may be helpful. 6.3.2 Depending upon the comparative technique chosen,
6.1.4 Changes in the following may impact performance there may be need for more than one comparison. These
evaluations. Coal characteristics, such as particle size, source comparisonsmaybeconductedinabatchoverseveralhoursor
days or continuously throughout the operational life of the
of coal, mining techniques, degree of preparation, and so forth,
which if changed from previous test periods and are not in the analyzer system.
analyzer calibration database, may affect analyzer precision 6.3.3 If two independent conventional coal-sampling and
and accuracy: laboratory analysis measurements can be made from each of a
6.1.4.1 Analyzer components; series of batches of coal interrogated by the analyzer, methods
6.1.4.2 Coal-handling system; developed by Grubbs (1-3) can be used to provide unbiased
´1
D6543 − 00 (2012)
estimates of the measurement precision of the analyzer and of
the conventional sampling and analysis methods.
6.3.4 Any two series of measurements are independent if
their measurement errors are uncorrelated. Correlation of
measurement errors can be avoided and independence assured
by use of a true random selection of physical increments or
samples of material or by using different schemes and equip-
ment for collection, preparation, and laboratory analysis of the
samples, or both. A complete treatment of the subject of
independence of measurements and the various means of
FIG. 1 Key to Schematics
assuring independence is beyond the scope of this guide.
6.4 Sampling Considerations:
reliable mechanical technique is available and the alternative is
6.4.1 Selection of Appropriate Sampling and Sample Prepa-
a manual part stream cut.
ration Methods—The following increment collection methods
6.4.1.3 Part Stream Increments—This mode of sample col-
(see Test Methods D2234/D2234M) are listed in general order
lection may be required in the evaluation of analyzers not
of preference; this preference is not rigid. Often, practical
associated with mechanical sampling or in some tests in which
considerations may supercede increment selection decisions.
more than one comparison will be made. Since this type of
The method to be used for sample preparation should be
sample does not allow statistical inferences to be drawn in a
determined before the beginning of increment collection.
rigorous manner, its use is discouraged. Indeed, the only use of
Sample preparation techniques should remain consistent (see
this type of comparison might be for control charting purposes
Method D2013). Before installation of the analyzer, consider-
relative to an historical reference.
ation should be given to the ability to obtain representative
6.4.2 Selection of Reference Sample Point(s):
samples for comparison to analyzer measurements and the
6.4.2.1 Comparative tests can be used to evaluate the
regimen for sample handling and analysis. For the use of
performance of either the analyzer itself or the “analyzer
mechanical sampling systems, inspection (see Guide D4702)
system” (consisting of the analyzer and the sampling system
and bias testing (see Practice D6518) are good methods for
that feeds it). The comparative evaluations of the analyzer
evaluation of the system’s suitability for the test.
system can be used to determine the ability of the analyzer
6.4.1.1 Full Stream Cuts—Whenever possible, the full
system to measure the characteristics of the main coal stream.
stream cut method of increment collection should be used in
The selection of the reference system sample point(s) deter-
the evaluation of an online analyzer. This is imperative for
mines whether the comparative tests will assess the analyzer or
drawing inference using statistical techniques.
the analyzer system.
6.4.1.2 Stopped Belt Cut—Although using “stopped belt”
6.4.2.2 The most direct and practical two-instrument test,
increments allows drawing statistical inferences from the data,
when the analyzer is fed the secondary reject of a mechanical
the stopped belt increment has limited applicability in the
sampling system, uses the final save to compare directly to the
evaluation of online analyzers. This especially is true in
analyzer. A manual or mechanical sample collected from the
collection of a sample from the lot interrogated by an analyzer
analyzer discharge may provide an independent sample, which
operating in conjunction with a mechanical sampling system.
may be used to assess the performance of the analyzer (see
The stopped belt increment may have applicability in instances
Figs. 1-3).
in which the analyzer is used in conjunction with mechanical
6.4.2.3 There are instances when there is no save sample
sampling, and the discharge of the analyzer may be metered
(see Fig. 4) associated with the system feeding the analyzer. In
onto a belt that is subject to stopping without interference with
this case, it is possible to construct a test with several
the analyzer’s operation. The stopped belt increment may be
comparisons by collecting separate samples from the analyzer
...
Questions, Comments and Discussion
Ask us and Technical Secretary will try to provide an answer. You can facilitate discussion about the standard in here.