ASTM E2443-05(2010)e1
(Guide)Standard Guide for Verifying Computer-Generated Test Results Through The Use Of Standard Data Sets
Standard Guide for Verifying Computer-Generated Test Results Through The Use Of Standard Data Sets
SCOPE
1.1 This guide establishes a process for the verification of application software used to calculate the mechanical properties of materials.
1.2 This guide has two purposes: (1) it provides guidelines for creating standard data sets for verifying computer-generated test results, and (2) it describes how users can verify whether the calculations in their application software produce accurate, acceptable results. This does not ensure that the software will produce correct results in all cases. The verification is only for those conditions covered by the standard data sets. This guide uses the concept of standard “data sets,” which are made available by the ASTM groups responsible for each of the individual standards.
1.3 This guide defines the terminology, the format, and the process for the use of these data sets and how the data sets are to be used for verification. It does not define the specific data sets required to verify each of the application standards. Rather, such data sets would become a necessary part of the standard and would be classified as an adjunct in accord with the definition in section B29 of the “Form and Style for ASTM Standards.” This classifies an adjunct as any material that is required for use of the standard but is not practicable to publish as an integral part of the standard.
1.4 In Annex A1 there is an example of how such data sets would be made available for one example standard.
1.5 Because the verification data sets are contained in files supplied to the application software in the computer, this procedure only provides verification of post-test calculations performed by the computer system. It does not evaluate the data acquisition system, real-time calculations, or any other part of the software beyond the post-test calculations.
General Information
Relations
Standards Content (Sample)
NOTICE: This standard has either been superseded and replaced by a new version or withdrawn.
Contact ASTM International (www.astm.org) for the latest information
´1
Designation: E2443 − 05 (Reapproved 2010)
Standard Guide for
Verifying Computer-Generated Test Results Through The
Use Of Standard Data Sets
This standard is issued under the fixed designation E2443; the number immediately following the designation indicates the year of
original adoption or, in the case of revision, the year of last revision. A number in parentheses indicates the year of last reapproval. A
superscript epsilon (´) indicates an editorial change since the last revision or reapproval.
ε NOTE—3.1.2 and 3.1.4 were editorially updated in December 2011.
1. Scope 2. Referenced Documents
2.1 ASTM Standards:
1.1 This guide establishes a process for the verification of
application software used to calculate the mechanical proper- E1823 TerminologyRelatingtoFatigueandFractureTesting
E1942 Guide for Evaluating DataAcquisition Systems Used
ties of materials.
in Cyclic Fatigue and Fracture Mechanics Testing
1.2 This guide has two purposes: (1) it provides guidelines
E1856 Guide for Evaluating Computerized DataAcquisition
for creating standard data sets for verifying computer-
Systems Used to Acquire Data from Universal Testing
generated test results, and (2) it describes how users can verify
Machines
whether the calculations in their application software produce
accurate, acceptable results. This does not ensure that the
3. Terminology
software will produce correct results in all cases. The verifi-
3.1 Definitions of Terms Specific to This Standard:
cation is only for those conditions covered by the standard data
3.1.1 ASCII—American National Standard Code for Infor-
sets.This guide uses the concept of standard “data sets,” which
mation Interchange. Data supplied in this form is readable by
are made available by the ASTM groups responsible for each
any computer system and will be displayed on the screen in
of the individual standards.
human readable form.
1.3 This guide defines the terminology, the format, and the
3.1.2 raw data—the sampled values of a sensor output.
process for the use of these data sets and how the data sets are
3.1.3 data set—A self-contained set of data consisting of a
to be used for verification. It does not define the specific data
preamble, specimen information, and basic data.This may take
sets required to verify each of the application standards.
the form of a printed document or a computer data file.
Rather, such data sets would become a necessary part of the
standard and would be classified as an adjunct in accord with 3.1.4 derived data—data obtained through the processing of
the definition in section B29 of the “Form and Style forASTM
the raw data.
Standards.” This classifies an adjunct as any material that is
3.1.5 expected results—The results accompanying the data
requiredforuseofthestandardbutisnotpracticabletopublish
sets that are expected from the computer.
as an integral part of the standard.
3.1.6 item separator—A special character (delimiter) used
1.4 In AnnexA1 there is an example of how such data sets
to separate items that appear on one line of ASCII characters.
would be made available for one example standard.
3.1.7 keyword—A text word or combination of characters
1.5 Because the verification data sets are contained in files
that uniquely identify an item of information in the Specimen
supplied to the application software in the computer, this Information section. Such keywords are defined in a preamble
procedure only provides verification of post-test calculations
to the data set within the standard in which they are to be used.
performed by the computer system. It does not evaluate the
3.1.8 line terminator—Acharacterorsequenceofcharacters
data acquisition system, real-time calculations, or any other
used to signify the end of a line of ASCII characters.
part of the software beyond the post-test calculations.
3.1.9 preamble—A text section describing the data set,
which standard it applies to, any critical information and
restrictions for use of the data sets, and the expected values
This guide is under the jurisdiction of ASTM Committee E08 on Fatigue and
Fracture and is the direct responsibility of Subcommittee E08.03 on Advanced
Apparatus and Techniques. For referenced ASTM standards, visit the ASTM website, www.astm.org, or
Current edition approved Nov. 1, 2010. Published January 2011. Originally contact ASTM Customer Service at service@astm.org. For Annual Book of ASTM
approved in 2005. Last previous edition approved in 2005 as E2443-05. DOI: Standards volume information, refer to the standard’s Document Summary page on
10.1520/E2443-05R10E01. the ASTM website.
Copyright © ASTM International, 100 Barr Harbor Drive, PO Box C700, West Conshohocken, PA 19428-2959. United States
´1
E2443 − 05 (2010)
(derived data) to be found as a result of running the algorithm that may be used to verify that software designed to implement
using the basic data. This section of the data set would not be thecalculationsisperformingcorrectly.Theuserofthedataset
used by the computer, and would normally be stripped off of inputs such data into their computer either automatically,
the data set prior to its use with the computer. manually, or a combination of both.
4.3.1 For example, it may prove most convenient to input
3.1.10 segment marker—A column of data alongside the
thespecimeninformation(describedin4.7)manually,andthen
columns of basic data which indicate different control sections
have the computer read the basic data as a file. The user then
during the test, such as loading versus unloading sections,
starts the computation and compares the actual results with
which might be needed by the algorithm under evaluation.
expectedresultssuppliedalongwiththedataset.Ifsuchresults
3.1.11 specimen information—Information about a tested
agree with the expected results within the specified tolerance,
specimen, other than the basic data, such as specimen
the computer algorithms may be considered verified. If not, the
dimensions, speed of testing, and any other relevant informa-
user must explore the reason for the difference.
tion that are required in the analysis.
4.4 When supplied in the form of a computer-readable file,
3.1.12 status—The status of the standard data set indicates
the data set shall be in industry-standard ASCII format.
that it has either been approved by the appropriate ASTM
entity, or that it is unapproved. Unapproved data sets may be
4.5 Preamble Characteristics—The preamble to the data set
posted and made available to users for round robin testing or
is a section of text containing at least the following:
other purposes, but results from the use of an unapproved data
4.5.1 Unique ID of the form: ASTM standard number to
set would not meet the requirements of this standard guide.
which this data set applies, DSxx, where xx is the data set
number (revision year.) For example, E 1234-DS2(2005);
4. Description of the Use of Basic Data For Software
4.5.2 Title;
Verification.
4.5.3 Any parameters required by the algorithm, and the
4.1 In its most basic form, a mechanical testing system
units to be used;
consists of a test frame with grips which attach to a test
4.5.4 Short description of the content of the data file and
specimen, a method of applying forces to the specimen, and a
what test conditions this data set is verifying;
number of transducers that measure the forces and deforma-
4.5.5 Details of the segment markers on the data file, if any;
tions applied to the specimen. (See Fig. 1)
4.5.6 Expected results (in appropriate units), as well as the
4.2 The measurement system may be divided into three
allowable tolerance (in %); and
sections for the purpose of verification: the mechanical test
4.5.7 Contact information for ASTM International.
frame and its components, the electrical measurement system,
4.6 The preamble is initiated with the marker ,
and the computer processing of data. This guide is specifically
and terminated by the marker .
concerned only with the final section, namely the computer
processing of data once the basic data are acquired.
4.7 Specimen Information Characteristics:
4.3 The principle of using data sets is that a standard may 4.7.1 The specimen information section consists of a num-
publish as an adjunct a set of basic data and expected results ber of rows of information essential for use by the algorithm
FIG. 1 Schematic of a typical test system
´1
E2443 − 05 (2010)
under evaluation. Such information might, for example, in- make a test invalid, the data set and expected results must be
clude the gage length of an extensometer, the dimensions of a configured to test these validity checks.
specimen, or the test temperature. Each row has this format:
4.11 Expected Results:
keyword (text), item separator, value (numeric), units (text).
4.11.1 The expected results are supplied along with the
4.7.2 It is required for ease of use that the specimen
basic data set and provide the correct, calculated (derived)
information section contain only essential information for the
results that should be produced by the software.Also included
calculations to be performed by the computer. Such informa-
with the expected results is a tolerance band (+ or – a certain
tion would include the length of the basic data file. Other
%oftheresult)withinwhichthederiveddatamustfallinorder
information, such as specimen identification, relative humidity,
tobeconsideredacceptable.Ifthederiveddatafallsoutsidethe
and so forth which might normally be included in a test report
tolerance band, then it is presumed that the calculations, or
should not be included in the specimen information section of
calculation parameters, are incorrect or improperly selected.
the data set.
...
Questions, Comments and Discussion
Ask us and Technical Secretary will try to provide an answer. You can facilitate discussion about the standard in here.