ASTM E1499-97(2009)

Standard Guide for Selection, Evaluation, and Training of Observers

SIGNIFICANCE AND USE
The term appearance (see 3.2.1) implies the essential presence of human visual observations. The results of visual observation involve not only the step of observing, accomplished by the eye, but also the inseparable step of interpretation in the brain. Instrumental test methods currently cannot duplicate this second step, and therefore can now only approximate, but not fully measure, appearance. Such instrumental measures of appearance properties are useful only to the extent that they can be correlated to the results of visual observations by observers of the appearance phenomena being evaluated.
Almost invariably, too little attention has been paid to ensuring that the essential visual observations have been properly obtained to provide the basis for correlating visual and instrumental test results. (The only recent book devoted to visual measurements (1) has no index entry for observer.)
This guide provides the means for assessing observers, by outlining the requirements and tests for their selection, evaluation, and training. This guide should be useful to all experimenters designing or using visual test methods to provide either direct results in terms of the observation of appearance properties, or the experiments correlating such results with instrumental measures approximating the same appearance properties.
SCOPE
1.1 This guide describes criteria and tests for selecting, evaluating, and training human visual-sensory observers for tasks involving the perception and scaling of properties and phenomena relating to appearance.
1.2 Examples of tests requiring the use of trained observers include but are not limited to those described in the following ASTM standards: on color, Practice D1535 and Practice E1360; on color difference, Practice D1729 and Test Method D2616; on gloss, Test Method D4449; on metamerism, Practice D4086; and on setting tolerances, Practice D3134.
1.3 This standard does not purport to address all of the safety concerns, if any, associated with its use. It is the responsibility of the user of this standard to establish appropriate safety and health practices and determine the applicability of regulatory limitations prior to use.

General Information

• Status: Historical
• Publication Date: 30-Nov-2009
• ICS: 13.100 - Occupational safety. Industrial hygiene
• Technical Committee: E12 - Color and Appearance
• Drafting Committee: E12.11 - Visual Methods

Relations

• Replaces: ASTM E1499-97(2003) - Standard Guide for Selection, Evaluation, and Training of Observers
• Effective Date: 01-Dec-2009
• Referred By: ASTM D1729-22 - Standard Practice for Visual Appraisal of Colors and Color Differences of Diffusely-Illuminated Opaque Materials
• Effective Date: 01-Dec-2009
• Referred By: ASTM E313-20 - Standard Practice for Calculating Yellowness and Whiteness Indices from Instrumentally Measured Color Coordinates
• Effective Date: 01-Dec-2009
• Referred By: ASTM D3134-15(2019) - Standard Practice for Establishing Color and Gloss Tolerances
• Effective Date: 01-Dec-2009
• Referred By: ASTM E1808-96(2021) - Standard Guide for Designing and Conducting Visual Experiments
• Effective Date: 01-Dec-2009
• Referred By: ASTM D2616-19 - Standard Test Method for Evaluation of Visual Color Difference With a Gray Scale
• Effective Date: 01-Dec-2009
• Referred By: ASTM D7195-21 - Standard Guide for Setting Object Color Specifications
• Effective Date: 01-Dec-2009

Standards Content (Sample)

NOTICE: This standard has either been superseded and replaced by a new version or withdrawn.
Contact ASTM International (www.astm.org) for the latest information
Designation: E1499 − 97 (Reapproved2009)
Standard Guide for
1
Selection, Evaluation, and Training of Observers
This standard is issued under the fixed designation E1499; the number immediately following the designation indicates the year of
original adoption or, in the case of revision, the year of last revision. A number in parentheses indicates the year of last reapproval. A
superscript epsilon (´) indicates an editorial change since the last revision or reapproval.
1. Scope 3. Terminology
3.1 Definitions—Definitions of appearance terms in Termi-
1.1 This guide describes criteria and tests for selecting,
nology E284 are applicable to this guide.
evaluating, and training human visual-sensory observers for
tasks involving the perception and scaling of properties and
3.2 Definitions of Terms Specific to This Standard:
phenomena relating to appearance.
3.2.1 appearance, n—in psychophysical studies, perception
inwhichthespectralandgeometricaspectsofavisualstimulus
1.2 Examples of tests requiring the use of trained observers
are integrated with its illuminating and viewing environment.
include but are not limited to those described in the following
3.2.2 observer, n—one who judges visually, qualitatively or
ASTM standards: on color, Practice D1535 and Practice
quantitatively, the content of one or more appearance attributes
E1360; on color difference, Practice D1729 and Test Method
in each member of a set of objects or stimuli.
D2616; on gloss, Test Method D4449; on metamerism, Prac-
tice D4086; and on setting tolerances, Practice D3134.
3.2.3 scale, v—to assess the content of one or more appear-
ance attributes in the members of a set of stimuli.
1.3 This standard does not purport to address all of the
3.2.3.1 Discussion—Alternatively, scales may be deter-
safety concerns, if any, associated with its use. It is the
mined by assessing the difference in content of an attribute
responsibility of the user of this standard to establish appro-
with respect to the differences in that attribute among the
priate safety and health practices and determine the applica-
members of the set.
bility of regulatory limitations prior to use.
4. Summary of Guide
2. Referenced Documents
4.1 This guide provides descriptions of techniques and tests
2
2.1 ASTM Standards:
for the selection of candidates for observers for use in visual
D1535 Practice for Specifying Color by the Munsell System
testing, for the evaluation of their capabilities in this field, and
D1729 Practice for Visual Appraisal of Colors and Color
for their training to enhance these capabilities.
Differences of Diffusely-Illuminated Opaque Materials
4.2 Discussion is provided of precautions required for the
D2616 Test Method for Evaluation of Visual Color Differ-
efficientuseofobserversinvisualtests,includingavoidanceof
ence With a Gray Scale
overtaxing the observers and the control of test variables.
D3134 Practice for Establishing Color and Gloss Tolerances
D4086 Practice for Visual Evaluation of Metamerism
4.3 Other considerations of test design, including the num-
D4449 Test Method for Visual Evaluation of Gloss Differ-
bers of observers and observations required and the precision
ences Between Surfaces of Similar Appearance
of the visual results, are to be covered elsewhere.
E284 Terminology of Appearance
E1360 Practice for Specifying Color by Using the Optical 5. Significance and Use
Society of America Uniform Color Scales System
5.1 The term appearance (see 3.2.1) implies the essential
presence of human visual observations. The results of visual
observation involve not only the step of observing, accom-
1
This guide is under the jurisdiction of ASTM Committee E12 on Color and
plished by the eye, but also the inseparable step of interpreta-
Appearance and is the direct responsibility of Subcommittee E12.11 on Visual
tion in the brain. Instrumental test methods currently cannot
Methods.
duplicate this second step, and therefore can now only
Current edition approved Dec. 1, 2009. Published December 2009. Originally
approximate, but not fully measure, appearance. Such instru-
approved in 1992. Last previous edition approved in 2003 as E1499 – 97 (2003).
DOI: 10.1520/E1499-97R09.
mentalmeasuresofappearancepropertiesareusefulonlytothe
2
For referenced ASTM standards, visit the ASTM website, www.astm.org, or
extent that they can be correlated to the results of visual
contact ASTM Customer Service at [e-mail]. For Annual Book of ASTM
observations by observers of the appearance phenomena being
Standards volume information, refer to the standard’s Document Summary page on
the ASTM website. evaluated.
Copyright © ASTM International, 100 Barr Harbor Drive, PO Box C700, West Conshohocken, PA 19428-2959. United States
1

---------------------- Page: 1 ----------------------
E1499 − 97 (2009)
NOTE 1—An abnormal
...

This document is not anASTM standard and is intended only to provide the user of anASTM standard an indication of what changes have been made to the previous version. Because
it may not be technically possible to adequately depict all changes accurately, ASTM recommends that users consult prior editions as appropriate. In all cases only the current version
of the standard as published by ASTM is to be considered the official document.
Designation:E1499–97(Reapproved2003) Designation: E1499 – 97 (Reapproved 2009)
Standard Guide for
1
Selection, Evaluation, and Training of Observers
This standard is issued under the fixed designation E1499; the number immediately following the designation indicates the year of
original adoption or, in the case of revision, the year of last revision. A number in parentheses indicates the year of last reapproval. A
superscript epsilon (´) indicates an editorial change since the last revision or reapproval.
1. Scope
1.1 This guide describes criteria and tests for selecting, evaluating, and training human visual-sensory observers for tasks
involving the perception and scaling of properties and phenomena relating to appearance.
1.2 ExamplesoftestsrequiringtheuseoftrainedobserversincludebutarenotlimitedtothosedescribedinthefollowingASTM
standards: on color, Practice D1535 and Practice E1360; on color difference, Practice D1729 and Test Method D2616; on gloss,
Test Method D4449; on metamerism, Practice D4086; and on setting tolerances, Practice D3134.
1.3 This standard does not purport to address all of the safety concerns, if any, associated with its use. It is the responsibility
of the user of this standard to establish appropriate safety and health practices and determine the applicability of regulatory
limitations prior to use.
2. Referenced Documents
2
2.1 ASTM Standards:
D1535 Practice for Specifying Color by the Munsell System
D1729 Practice for Visual Appraisal of Colors and Color Differences of Diffusely-Illuminated Opaque Materials
D2616 Test Method for Evaluation of Visual Color Difference With a Gray Scale
D3134 Practice for Establishing Color and Gloss Tolerances
D4086 Practice for Visual Evaluation of Metamerism
D4449 Test Method for Visual Evaluation of Gloss Differences Between Surfaces of Similar Appearance
E284 Terminology of Appearance
E1360 Practice for Specifying Color by Using the Optical Society of America Uniform Color Scales System
3. Terminology
3.1 Definitions—Definitions of appearance terms in Terminology E284 are applicable to this guide.
3.2 Definitions of Terms Specific to This Standard:
3.2.1 appearance, n—in psychophysical studies, perception in which the spectral and geometric aspects of a visual stimulus are
integrated with its illuminating and viewing environment.
3.2.2 observer, n—one who judges visually, qualitatively or quantitatively, the content of one or more appearance attributes in
each member of a set of objects or stimuli.
3.2.3 scale, v—to assess the content of one or more appearance attributes in the members of a set of stimuli.
3.2.3.1 Discussion—Alternatively, scales may be determined by assessing the difference in content of an attribute with respect
to the differences in that attribute among the members of the set.
4. Summary of Guide
4.1 Thisguideprovidesdescriptionsoftechniquesandtestsfortheselectionofcandidatesforobserversforuseinvisualtesting,
for the evaluation of their capabilities in this field, and for their training to enhance these capabilities.
4.2 Discussion is provided of precautions required for the efficient use of observers in visual tests, including avoidance of
overtaxing the observers and the control of test variables.
4.3 Other considerations of test design, including the numbers of observers and observations required and the precision of the
visual results, are to be covered elsewhere.
1
This guide is under the jurisdiction of ASTM Committee E12 on Color and Appearance and is the direct responsibility of Subcommittee E12.11 on Visual Methods.
Current edition approved Dec. 1, 2003.2009. Published December 2003.2009. Originally approved in 1992. Last previous edition approved in 19972003 as
E1499 – 97 (2003). DOI: 10.1520/E1499-97R039.
2
For referencedASTM standards, visit theASTM website, www.astm.org, or contactASTM Customer Service at [e-mail]. For Annual Book of ASTM Standards
volume information, refer to the standard’s Document Summary page on the ASTM website.
Copyright © ASTM International, 100 Barr Harbor Drive, PO Box C700, West Conshohocken, PA 19428-2959, United States.
1

---------------------- Page: 1 ----------------------
E1499 – 97 (2009)
5. Significance and Use
5.1 The term appearance (see 3.2.1) implies the essential presence of human visual observations. The results of visual
observation involve not only the step of observing, accomplished by the eye, but also the inseparable step of interpretation in the
brain. Instrumental test methods currently cannot duplicate this second step, and the
...