ASTM E3313-22
(Guide)Standard Guide for Communication of Assessor and Panel Performance
Standard Guide for Communication of Assessor and Panel Performance
SIGNIFICANCE AND USE
4.1 The procedures recommended in this guide can be used by a panel leader to provide assessors and panels feedback: (1) on their data-based performance, (2) on any behavior changes that are needed to improve their performance, and (3) to motivate assessors to remain engaged with the panel tasks. The aim of all these types of feedback is to ensure the generation of repeatable and valid data.
4.2 This guide provides direction for how to achieve mutually beneficial feedback exchanges between assessors and panel leaders.
SCOPE
1.1 This guide provides guidance to sensory panel leaders on how to deliver performance feedback to trained sensory assessors and panels. This guide is not intended to be used by individual assessors or anyone unfamiliar with the panel.
1.2 This guide covers recommended feedback given throughout assessor training, panel development, and ongoing assessor and panel monitoring.
1.3 This guide examines aspects of feedback including: types, when to provide, effective delivery, and alignment to performance expectations for assessors.
1.4 Descriptive, discrimination, and quality panels are within the scope of this guide.
1.5 This guide does not cover consumer panels (qualitative or quantitative).
1.6 Units—The values stated in SI units are to be regarded as the standard. No other units of measurement are included in this standard.
1.7 This standard does not purport to address all of the safety concerns, if any, associated with its use. It is the responsibility of the user of this standard to establish appropriate safety, health, and environmental practices and determine the applicability of regulatory limitations prior to use.
1.8 This international standard was developed in accordance with internationally recognized principles on standardization established in the Decision on Principles for the Development of International Standards, Guides and Recommendations issued by the World Trade Organization Technical Barriers to Trade (TBT) Committee.
General Information
Standards Content (Sample)
NOTICE: This standard has either been superseded and replaced by a new version or withdrawn.
Contact ASTM International (www.astm.org) for the latest information
Designation: E3313 − 22
Standard Guide for
1
Communication of Assessor and Panel Performance
This standard is issued under the fixed designation E3313; the number immediately following the designation indicates the year of
original adoption or, in the case of revision, the year of last revision. A number in parentheses indicates the year of last reapproval. A
superscript epsilon (´) indicates an editorial change since the last revision or reapproval.
1. Scope E253 Terminology Relating to Sensory Evaluation of Mate-
rials and Products
1.1 This guide provides guidance to sensory panel leaders
E456 Terminology Relating to Quality and Statistics
on how to deliver performance feedback to trained sensory
E3000 Guide for Measuring and Tracking Performance of
assessors and panels. This guide is not intended to be used by
Assessors on a Descriptive Sensory Panel
individual assessors or anyone unfamiliar with the panel.
1.2 This guide covers recommended feedback given
3. Terminology
throughout assessor training, panel development, and ongoing
3.1 Definitions—For definitions of terms relating to sensory
assessor and panel monitoring.
analysis, see Terminology E253. For terms relating to statistics,
1.3 This guide examines aspects of feedback including:
see Terminology E456.
types, when to provide, effective delivery, and alignment to
performance expectations for assessors.
4. Significance and Use
1.4 Descriptive, discrimination, and quality panels are 4.1 The procedures recommended in this guide can be used
within the scope of this guide. by a panel leader to provide assessors and panels feedback: (1)
on their data-based performance, (2) on any behavior changes
1.5 This guide does not cover consumer panels (qualitative
that are needed to improve their performance, and (3) to
or quantitative).
motivate assessors to remain engaged with the panel tasks. The
1.6 Units—The values stated in SI units are to be regarded
aim of all these types of feedback is to ensure the generation of
as the standard. No other units of measurement are included in
repeatable and valid data.
this standard.
4.2 This guide provides direction for how to achieve mutu-
1.7 This standard does not purport to address all of the
ally beneficial feedback exchanges between assessors and
safety concerns, if any, associated with its use. It is the
panel leaders.
responsibility of the user of this standard to establish appro-
priate safety, health, and environmental practices and deter-
5. Introduction to Feedback
mine the applicability of regulatory limitations prior to use.
5.1 What Is Feedback?—Feedback is the process of inform-
1.8 This international standard was developed in accor-
ing a trained assessor of their performance to maintain or
dance with internationally recognized principles on standard-
improve repeatability and validity of their responses. For a
ization established in the Decision on Principles for the
sensory assessor or panel, feedback can be the act of a panel
Development of International Standards, Guides and Recom-
leader sharing or informing assessors of their own results or
mendations issued by the World Trade Organization Technical
those of the panel or both; it can be providing positive or
Barriers to Trade (TBT) Committee.
negative reinforcement to change or correct behaviors; or it can
be acting as a “cheerleader” to instill confidence and increase
2. Referenced Documents
motivation.
2
2.1 ASTM Standards:
5.2 Reasons to Provide Feedback:
5.2.1 Performance—Providing appropriate and timely feed-
back on an assessor’s or panel’s results contributes to stable
1
This guide is under the jurisdiction of ASTM Committee E18 on Sensory
performance, performance improvement, and delivery of reli-
Evaluation and is the direct responsibility of Subcommittee E18.05 on Sensory
able and robust results. It can help to make an assessor more
Applications--General.
skilled at giving the same response for the same task under the
Current edition approved July 15, 2022. Published September 2022. DOI:
10.1520/E3313-22.
same conditions.
2
For referenced ASTM standards, visit the ASTM website, www.astm.org, or
5.2.2 Correcting Behaviors—Feedback is a tool that can be
contact ASTM Customer Service at service@astm.org. For Annual Book of ASTM
used to address panel/assessor issues if behaviors or results are
Standards volume information, refer to the standard’s Document Summary page on
the ASTM website. not as expected. For example, if the assessor has scored an
Copyright © ASTM International, 100 Barr Harbor Drive, PO Box C700, West Conshohocken, PA 19428-2959. United States
1
---------------------- Page: 1 ----------------------
E3313 − 22
attribute much lower than the panel, resulting in a different 5.4.3.3 When giving negative feedback related to perfor-
sample rank order, then they will n
...
Questions, Comments and Discussion
Ask us and Technical Secretary will try to provide an answer. You can facilitate discussion about the standard in here.