ASTM E2943-14
(Guide)Standard Guide for Two-Sample Acceptance and Preference Testing with Consumers
Standard Guide for Two-Sample Acceptance and Preference Testing with Consumers
SIGNIFICANCE AND USE
5.1 Acceptance and preference are the key measurements taken in consumer product testing as either a new product idea is developed into testable prototypes or existing products are evaluated for potential improvements, cost reductions, or other business reasons. Developing products that are preferred overall, or liked as well as, or better, on average, compared to a standard or a competitor, among a defined target consumer group, is usually the main goal of the product development process. Thus, it is necessary to test the consumer acceptability or the preference of a product or prototype compared to other prototypes or potential products, a standard product, or other products in the market. The researcher, with input from her/his stakeholders, has the responsibility to choose appropriate comparison products and scaling or test methods to evaluate them. In the case of a new-to-the-world product, there may or may not be a relevant product for comparison. In this case, a benchmark score or rating may be used to determine acceptability. A product or prototype that is acceptable to the target consumer is one that meets a minimum criterion for liking, and a product that is preferred over an existing product has the potential to be chosen more often than the less-preferred product by the consumer in the marketplace, when all other factors are equal.
5.2 The external validity (the extent to which the results of a study can be generalized) of both acceptance and preference measures to manage decision risk at all stages of the development cycle is dependent on the ability of the researcher to generalize the results from the respondent sample to the target population at large. This depends both upon the sample of respondents and the way the test is constructed. Within the context of a single test, acceptance measures tell the relative hedonic status of the two samples, quantitatively, as well as where on the hedonic continuum each of the samples falls, that is, “disliked,”...
SCOPE
1.1 This guide covers acceptance and preference measures when each is used in an unbranded, two-sample, product test. Each measure, acceptance, and preference, may be used alone or together in a single test or separated by time. This guide covers how to establish a product’s hedonic or choice status based on sensory attributes alone, rather than brand, positioning, imagery, packaging, pricing, emotional-cultural responses, or other nonsensory aspects of the product. The most commonly used measures of acceptance and preference will be covered, that is, product liking overall as measured by the nine-point hedonic scale and preference measured by choice, either two-alternative forced choice or two-alternative with a “no preference” option.
1.2 Three of the biggest challenges in measuring a product’s hedonic (overall liking or acceptability) or choice status (preference selection) are determining how many respondents and who to include in the respondent sample, setting up the questioning sequence, and interpreting the data to make product decisions.
1.3 This guide covers:
1.3.1 Definition of each type of measure,
1.3.2 Discussion of the advantages and disadvantages of each,
1.3.3 When to use each,
1.3.4 Practical considerations in test execution,
1.3.5 Risks associated with each,
1.3.6 Relationship between the two when administered in the same test, and
1.3.7 Recommended interpretations of results for product decisions.
1.4 The intended audience for this guide is the sensory consumer professional or marketing research professional (“the researcher”) who is designing, executing, and interpreting data from product tests with acceptance or choice measures, or both.
1.5 Only two-sample product tests will be covered in this guide. However, the issues and recommended practices raised in this guide often apply to multi-sample tests as well. Detailed coverage of execution tactics, optional types of s...
General Information
Standards Content (Sample)
NOTICE: This standard has either been superseded and replaced by a new version or withdrawn.
Contact ASTM International (www.astm.org) for the latest information
Designation: E2943 − 14
StandardGuide for
Two-Sample Acceptance and Preference Testing with
1
Consumers
This standard is issued under the fixed designation E2943; the number immediately following the designation indicates the year of
original adoption or, in the case of revision, the year of last revision. A number in parentheses indicates the year of last reapproval. A
superscript epsilon (´) indicates an editorial change since the last revision or reapproval.
INTRODUCTION
This guide is intended to be used by sensory consumer and marketing research professionals
(referredtoasthe“researcher”or“researchprofessional”)asanaidtounderstandingissuesassociated
with and to conducting two-sample acceptance and preference tests with consumers. This guide
includes a general summary of considerations and practices for conducting hedonic tests followed by
specific considerations and practices for both acceptance and preference testing, including pros and
cons of each method. Final sections consider the incorporation of both acceptance and preference
testing into the research plan and discuss potential lack of linkage in output/results between them. A
flowchart outlining summary of these methods and references for further reading are also included.
1. Scope 1.3.1 Definition of each type of measure,
1.3.2 Discussion of the advantages and disadvantages of
1.1 This guide covers acceptance and preference measures
each,
when each is used in an unbranded, two-sample, product test.
1.3.3 When to use each,
Each measure, acceptance, and preference, may be used alone
1.3.4 Practical considerations in test execution,
or together in a single test or separated by time. This guide
1.3.5 Risks associated with each,
covers how to establish a product’s hedonic or choice status
1.3.6 Relationship between the two when administered in
based on sensory attributes alone, rather than brand,
the same test, and
positioning, imagery, packaging, pricing, emotional-cultural
1.3.7 Recommended interpretations of results for product
responses, or other nonsensory aspects of the product. The
decisions.
most commonly used measures of acceptance and preference
will be covered, that is, product liking overall as measured by
1.4 The intended audience for this guide is the sensory
the nine-point hedonic scale and preference measured by consumerprofessionalormarketingresearchprofessional(“the
choice, either two-alternative forced choice or two-alternative
researcher”) who is designing, executing, and interpreting data
with a “no preference” option. fromproducttestswithacceptanceorchoicemeasures,orboth.
1.2 Threeofthebiggestchallengesinmeasuringaproduct’s
1.5 Only two-sample product tests will be covered in this
hedonic (overall liking or acceptability) or choice status guide. However, the issues and recommended practices raised
(preference selection) are determining how many respondents
in this guide often apply to multi-sample tests as well. Detailed
and who to include in the respondent sample, setting up the
coverage of execution tactics, optional types of scales, various
questioning sequence, and interpreting the data to make prod-
approaches to data analysis, and extensive discussions of the
uct decisions.
reliability and validity of these measures are all outside of the
scope of this guide.
1.3 This guide covers:
1.6 Units—The values stated in SI units are to be regarded
1
as the standard. No other units of measurement are included in
This guide is under the jurisdiction of ASTM Committee E18 on Sensory
Evaluation and is the direct responsibility of Subcommittee E18.04 on Fundamen- this standard.
tals of Sensory.
1.7 This standard does not purport to address all of the
Current edition approved Sept. 1, 2014. Published September 2014. DOI:
safety concerns, if any, associated with its use. It is the
10.1520/E2943-14.
Copyright © ASTM International, 100 Barr Harbor Drive, PO Box C700, West Conshohocken, PA 19428-2959. United States
1
---------------------- Page: 1 ----------------------
E2943 − 14
responsibility of the user of this standard to establish appro- (SD). The individual statements are either clearly favorable or
priate safety and health practices and determine the applica- clearly unfavorable (2 and 3).
bility of regulatory limitations prior to use.
3.2.6 P ,n—used in forced choice preference measures; a
max
test sensitivity parameter established before testing and used
2. Referenced Documents
along with the selected values of α and β to determine the
2
2.1 ASTM Standards: number of respondents needed in a study.
E253 Terminology Relating to Sensory Evaluation of Mate-
3.2.6.1 Discussion—P is the proportion of common re-
max
rials and Products sponses that the researcher wants the test to be able to detect
E456 Terminology Relating to Quality and Statistics
with a probability of 1 –β.
...








Questions, Comments and Discussion
Ask us and Technical Secretary will try to provide an answer. You can facilitate discussion about the standard in here.