ASTM E3313-24
(Guide)Standard Guide for Communication of Assessor and Panel Performance
Standard Guide for Communication of Assessor and Panel Performance
SIGNIFICANCE AND USE
4.1 The procedures recommended in this guide can be used by a panel leader to provide assessors and panels feedback: (1) on their data-based performance, (2) on any behavior changes that are needed to improve their performance, and (3) to motivate assessors to remain engaged with the panel tasks. The aim of all these types of feedback is to ensure the generation of repeatable and valid data.
4.2 This guide provides direction for how to achieve mutually beneficial feedback exchanges between assessors and panel leaders.
SCOPE
1.1 This guide provides guidance to sensory panel leaders on how to deliver performance feedback to trained sensory assessors and panels. This guide is not intended to be used by individual assessors or anyone unfamiliar with the panel.
1.2 This guide covers recommended feedback given throughout assessor training, panel development, and ongoing assessor and panel monitoring.
1.3 This guide examines aspects of feedback including: types, when to provide, effective delivery, and alignment to performance expectations for assessors.
1.4 Descriptive, discrimination, and quality panels are within the scope of this guide.
1.5 This guide does not cover consumer panels (qualitative or quantitative).
1.6 Units—The values stated in SI units are to be regarded as the standard. No other units of measurement are included in this standard.
1.7 This standard does not purport to address all of the safety concerns, if any, associated with its use. It is the responsibility of the user of this standard to establish appropriate safety, health, and environmental practices and determine the applicability of regulatory limitations prior to use.
1.8 This international standard was developed in accordance with internationally recognized principles on standardization established in the Decision on Principles for the Development of International Standards, Guides and Recommendations issued by the World Trade Organization Technical Barriers to Trade (TBT) Committee.
General Information
Relations
Buy Standard
Standards Content (Sample)
This international standard was developed in accordance with internationally recognized principles on standardization established in the Decision on Principles for the
Development of International Standards, Guides and Recommendations issued by the World Trade Organization Technical Barriers to Trade (TBT) Committee.
Designation: E3313 − 24
Standard Guide for
1
Communication of Assessor and Panel Performance
This standard is issued under the fixed designation E3313; the number immediately following the designation indicates the year of
original adoption or, in the case of revision, the year of last revision. A number in parentheses indicates the year of last reapproval. A
superscript epsilon (´) indicates an editorial change since the last revision or reapproval.
1. Scope E253 Terminology Relating to Sensory Evaluation of Mate-
rials and Products
1.1 This guide provides guidance to sensory panel leaders
E456 Terminology Relating to Quality and Statistics
on how to deliver performance feedback to trained sensory
E3000 Guide for Measuring and Tracking Performance of
assessors and panels. This guide is not intended to be used by
Assessors on a Descriptive Sensory Panel
individual assessors or anyone unfamiliar with the panel.
1.2 This guide covers recommended feedback given
3. Terminology
throughout assessor training, panel development, and ongoing
3.1 Definitions—For definitions of terms relating to sensory
assessor and panel monitoring.
analysis, see Terminology E253. For terms relating to statistics,
1.3 This guide examines aspects of feedback including:
see Terminology E456.
types, when to provide, effective delivery, and alignment to
performance expectations for assessors. 4. Significance and Use
1.4 Descriptive, discrimination, and quality panels are
4.1 The procedures recommended in this guide can be used
within the scope of this guide. by a panel leader to provide assessors and panels feedback: (1)
on their data-based performance, (2) on any behavior changes
1.5 This guide does not cover consumer panels (qualitative
that are needed to improve their performance, and (3) to
or quantitative).
motivate assessors to remain engaged with the panel tasks. The
1.6 Units—The values stated in SI units are to be regarded
aim of all these types of feedback is to ensure the generation of
as the standard. No other units of measurement are included in
repeatable and valid data.
this standard.
4.2 This guide provides direction for how to achieve mutu-
1.7 This standard does not purport to address all of the
ally beneficial feedback exchanges between assessors and
safety concerns, if any, associated with its use. It is the
panel leaders.
responsibility of the user of this standard to establish appro-
priate safety, health, and environmental practices and deter-
5. Introduction to Feedback
mine the applicability of regulatory limitations prior to use.
5.1 What Is Feedback?—Feedback is the process of inform-
1.8 This international standard was developed in accor-
ing a trained assessor of their performance to maintain or
dance with internationally recognized principles on standard-
improve repeatability and validity of their responses. For a
ization established in the Decision on Principles for the
sensory assessor or panel, feedback can be the act of a panel
Development of International Standards, Guides and Recom-
leader sharing or informing assessors of their own results or
mendations issued by the World Trade Organization Technical
those of the panel or both; it can be providing positive or
Barriers to Trade (TBT) Committee.
negative reinforcement to change or correct behaviors; or it can
be acting as a “cheerleader” to instill confidence and increase
2. Referenced Documents
motivation.
2
2.1 ASTM Standards:
5.2 Reasons to Provide Feedback:
5.2.1 Performance—Providing appropriate and timely feed-
1
This guide is under the jurisdiction of ASTM Committee E18 on Sensory
back on an assessor’s or panel’s results contributes to stable
Evaluation and is the direct responsibility of Subcommittee E18.05 on Method
performance, performance improvement, and delivery of reli-
Applications - Specific Uses or Assessors.
able and robust results. It can help to make an assessor more
Current edition approved Feb. 15, 2024. Published February 2024. Originally
skilled at giving the same response for the same task under the
approved in 2022. Last previous edition approved in 2023 as E3313 – 23a. DOI:
10.1520/E3313-24.
same conditions.
2
For referenced ASTM standards, visit the ASTM website, www.astm.org, or
5.2.2 Adjusting Behaviors—Feedback is a tool that can be
contact ASTM Customer Service at service@astm.org. For Annual Book of ASTM
used to address panel/assessor issues if behaviors or results are
Standards volume information, refer to the standard’s Document Summary page on
the ASTM website. not as expected. For example, if the assessor has scored an
Copyright © ASTM International, 100 Barr Harbor Drive, PO Box C700, West Conshohocken, PA
...
This document is not an ASTM standard and is intended only to provide the user of an ASTM standard an indication of what changes have been made to the previous version. Because
it may not be technically possible to adequately depict all changes accurately, ASTM recommends that users consult prior editions as appropriate. In all cases only the current version
of the standard as published by ASTM is to be considered the official document.
Designation: E3313 − 23a E3313 − 24
Standard Guide for
1
Communication of Assessor and Panel Performance
This standard is issued under the fixed designation E3313; the number immediately following the designation indicates the year of
original adoption or, in the case of revision, the year of last revision. A number in parentheses indicates the year of last reapproval. A
superscript epsilon (´) indicates an editorial change since the last revision or reapproval.
1. Scope
1.1 This guide provides guidance to sensory panel leaders on how to deliver performance feedback to trained sensory assessors
and panels. This guide is not intended to be used by individual assessors or anyone unfamiliar with the panel.
1.2 This guide covers recommended feedback given throughout assessor training, panel development, and ongoing assessor and
panel monitoring.
1.3 This guide examines aspects of feedback including: types, when to provide, effective delivery, and alignment to performance
expectations for assessors.
1.4 Descriptive, discrimination, and quality panels are within the scope of this guide.
1.5 This guide does not cover consumer panels (qualitative or quantitative).
1.6 Units—The values stated in SI units are to be regarded as the standard. No other units of measurement are included in this
standard.
1.7 This standard does not purport to address all of the safety concerns, if any, associated with its use. It is the responsibility
of the user of this standard to establish appropriate safety, health, and environmental practices and determine the applicability of
regulatory limitations prior to use.
1.8 This international standard was developed in accordance with internationally recognized principles on standardization
established in the Decision on Principles for the Development of International Standards, Guides and Recommendations issued
by the World Trade Organization Technical Barriers to Trade (TBT) Committee.
2. Referenced Documents
2
2.1 ASTM Standards:
E253 Terminology Relating to Sensory Evaluation of Materials and Products
E456 Terminology Relating to Quality and Statistics
E3000 Guide for Measuring and Tracking Performance of Assessors on a Descriptive Sensory Panel
1
This guide is under the jurisdiction of ASTM Committee E18 on Sensory Evaluation and is the direct responsibility of Subcommittee E18.05 on Sensory
Applications--GeneralMethod Applications - Specific Uses or Assessors.
Current edition approved Oct. 1, 2023Feb. 15, 2024. Published October 2023February 2024. Originally approved in 2022. Last previous edition approved in 2023 as
E3313 – 23.E3313 – 23a. DOI: 10.1520/E3313-23A.10.1520/E3313-24.
2
For referenced ASTM standards, visit the ASTM website, www.astm.org, or contact ASTM Customer Service at service@astm.org. For Annual Book of ASTM Standards
volume information, refer to the standard’s Document Summary page on the ASTM website.
Copyright © ASTM International, 100 Barr Harbor Drive, PO Box C700, West Conshohocken, PA 19428-2959. United States
1
---------------------- Page: 1 ----------------------
E3313 − 24
3. Terminology
3.1 Definitions—For definitions of terms relating to sensory analysis, see Terminology E253. For terms relating to statistics, see
Terminology E456.
4. Significance and Use
4.1 The procedures recommended in this guide can be used by a panel leader to provide assessors and panels feedback: (1) on
their data-based performance, (2) on any behavior changes that are needed to improve their performance, and (3) to motivate
assessors to remain engaged with the panel tasks. The aim of all these types of feedback is to ensure the generation of repeatable
and valid data.
4.2 This guide provides direction for how to achieve mutually beneficial feedback exchanges between assessors and panel leaders.
5. Introduction to Feedback
5.1 What Is Feedback?—Feedback is the process of informing a trained assessor of their performance to maintain or improve
repeatability and validity of their responses. For a sensory assessor or panel, feedback can be the act of a panel leader sharing or
informing assessors of their own results or those of the panel or both; it can be providing positive or negative reinforcement to
change or correct behaviors; or it can be acting as a “cheerleader” to instill confidence and increase motivation.
5.2 Reasons to Provide Feedback:
5.2.1 Performance—Providing appropriate and timely feedback on an assessor’s or panel’s results contributes to stable
performance, performance improvement, and delivery of reliable and robust results. It can h
...
Questions, Comments and Discussion
Ask us and Technical Secretary will try to provide an answer. You can facilitate discussion about the standard in here.