ASTM E2263-12
(Test Method)Standard Test Method for Paired Preference Test
Standard Test Method for Paired Preference Test
SIGNIFICANCE AND USE
5.1 The paired preference test determines whether or not there is a preference for one product over another product among a specific target population. Knowledge of consumer segments, brand loyalties, the range of product offerings in the marketplace, and the decision risk must be understood when planning a paired preference test.
5.2 The paired preference method is commonly used in tests with one or more of the following objectives: (1) to establish superiority in preference versus the competition for advertising claims support; (2) to establish the preference of a new product for launch versus a competitor's product; ( 3) to establish the preference of a reformulated product in a product improvement or product modification project (for example, process change or ingredient change); and (4) to establish the preference of a cost improved product versus the current formulation in a cost savings project. Selected values of Pmax, α, and β will change with all four types of test objectives. These should be selected prior to determination of N.
5.2.1 Preference versus Competition or Launching a New Product versus Competition—Select a Pmax to represent what you expect a reasonable preference split to be. The main risk to avoid is to wrongly claim your product is preferred over the competitors. Thus, low values of α are selected, for example, 0.05, 0.01, or 0.001. The desired outcome of this test is to reject the null hypothesis. The alternative hypothesis is one sided: A new or improved product (A) is preferred over the competitor’s product (B). The test is one-sided. The value of β will be determined by the sample size chosen and the size of the preference in the consumer segment selected for the test. Selection of the appropriate number of respondents is determined by Pmax, α, and β, as well as the market segment that must be included in the test (for issues specific to conducting a paired preference test for an advertising claim, refer to Guide E1958).
5.2.2 ...
SCOPE
1.1 This document covers a procedure for determining preference between two products using either a two-alternative forced-choice task, or with the option of choosing no preference. Preference testing is a type of hedonic testing.
1.2 A paired preference test determines whether there is a statistically significant preference between two products for a given population of respondents. The target population must be carefully considered.
1.3 This method establishes preference in a single evaluation context. Replicated tests will not be covered within the scope of this document.
1.4 Paired preference testing can address overall preference or preference for a specified sensory attribute.
1.5 The method does not directly determine the magnitude of preference.
1.6 This method does not address whether or not two samples are perceived as different. Refer to Test Method E2164 for directional difference test.
1.7 A paired preference test is a simple task for respondents, and can be used with populations that have minimal reading or comprehension skills, or both.
1.8 Preference is not an intrinsic attribute of the product, such as hue is, but is a subjective measure relating to respondents' affective or hedonic response. It differs from paired comparison testing which measures objective characteristics of the product. Preference results are always dependent on the population sampled.
1.9 This standard does not purport to address all of the safety problems associated with its use, when testing includes hazardous materials, operations, or equipment. It is the responsibility of the user of this standard to establish appropriate safety and health practices and to determine the applicability of regulatory limitations prior to use.
General Information
Relations
Buy Standard
Standards Content (Sample)
NOTICE: This standard has either been superseded and replaced by a new version or withdrawn.
Contact ASTM International (www.astm.org) for the latest information
Designation: E2263 − 12
Standard Test Method for
1
Paired Preference Test
This standard is issued under the fixed designation E2263; the number immediately following the designation indicates the year of
original adoption or, in the case of revision, the year of last revision. A number in parentheses indicates the year of last reapproval. A
superscript epsilon (´) indicates an editorial change since the last revision or reapproval.
1. Scope 2. Referenced Documents
2
1.1 This document covers a procedure for determining 2.1 ASTM Standards:
preference between two products using either a two-alternative E253 Terminology Relating to Sensory Evaluation of Mate-
forced-choice task, or with the option of choosing no prefer- rials and Products
ence. Preference testing is a type of hedonic testing. E456 Terminology Relating to Quality and Statistics
E1871 Guide for Serving Protocol for Sensory Evaluation of
1.2 A paired preference test determines whether there is a
Foods and Beverages
statistically significant preference between two products for a
E1958 Guide for Sensory Claim Substantiation
givenpopulationofrespondents.Thetargetpopulationmustbe
E2164 Test Method for Directional Difference Test
carefully considered.
2.2 ISO Standard:
1.3 This method establishes preference in a single evalua-
ISO 5495 Sensory Analysis—Methodology—Paired Com-
tion context. Replicated tests will not be covered within the
3
parison
scope of this document.
1.4 Paired preference testing can address overall preference
3. Terminology
or preference for a specified sensory attribute.
3.1 For definition of terms relating to sensory analysis, see
1.5 The method does not directly determine the magnitude
Terminology E253, and for terms relating to statistics, see
of preference.
Terminology E456.
1.6 This method does not address whether or not two
3.2 Definitions of Terms Specific to This Standard:
samplesareperceivedasdifferent.RefertoTestMethodE2164
3.2.1 α (alpha) risk—the probability of concluding that a
for directional difference test.
preference exists when, in reality, one does not. (Also known
as Type I Error or significance level.)
1.7 Apairedpreferencetestisasimpletaskforrespondents,
and can be used with populations that have minimal reading or
3.2.2 β (beta) risk—the probability of concluding that no
comprehension skills, or both.
preference exists when, in reality, one does. (Also known as
Type II Error.)
1.8 Preference is not an intrinsic attribute of the product,
such as hue is, but is a subjective measure relating to 3.2.3 common responses—for a one-sided test, the number
respondents’ affective or hedonic response. It differs from of respondents selecting the product that is expected to be
paired comparison testing which measures objective character- preferred. For a two-sided test, the largest number of respon-
istics of the product. Preference results are always dependent dents selecting either product.
on the population sampled.
3.2.4 one-sided test—a test in which the researcher has an a
1.9 This standard does not purport to address all of the priori assumption concerning the direction of the preference.
safety problems associated with its use, when testing includes In this case, the alternative hypothesis will express that a
hazardous materials, operations, or equipment. It is the re- specific product is preferred over another product (that is only,
A > B or A < B), depending on the a priori belief.
sponsibility of the user of this standard to establish appropriate
safety and health practices and to determine the applicability
3.2.5 two-sided test—a test in which the researcher does not
of regulatory limitations prior to use.
have any a priori assumption concerning direction of the
1 2
This test method is under the jurisdiction ofASTM Committee E18 on Sensory For referenced ASTM standards, visit the ASTM website, www.astm.org, or
Evaluation and is the direct responsibility of Subcommittee E18.04 on Fundamen- contactASTM Customer Service at service@astm.org. ForAnnual Book ofASTM
tals of Sensory. Standards volume information, refer to the standard’s Document Summary page on
Current edition approved Oct. 15, 2012. Published December 2012. Originally the ASTM website.
3
approved in 2004. Last previous edition approved in 2004 as E2263 – 04. DOI: Available fromAmerican National Standards Institute (ANSI), 25 W. 43rd St.,
10.1520/E2263-12. 4th Floor, New York, NY 10036.
Copyright © ASTM International, 100 Barr Harbor Drive, PO Box C700, West Conshohocken, PA 19428-2959. United States
1
---------------------- Page: 1 ----------------------
E2263 − 12
preference. In this case, the alternative hypothesis is that the 5. Significance and Use
two products are not equally preferred (that is, A ≠ B).
5.1 The paired preference test determines whether or not
there is a preference for one
...
This document is not an ASTM standard and is intended only to provide the user of an ASTM standard an indication of what changes have been made to the previous version. Because
it may not be technically possible to adequately depict all changes accurately, ASTM recommends that users consult prior editions as appropriate. In all cases only the current version
of the standard as published by ASTM is to be considered the official document.
Designation: E2263 − 04 E2263 − 12
Standard Test Method for
1
Paired Preference Test
This standard is issued under the fixed designation E2263; the number immediately following the designation indicates the year of
original adoption or, in the case of revision, the year of last revision. A number in parentheses indicates the year of last reapproval. A
superscript epsilon (´) indicates an editorial change since the last revision or reapproval.
1. Scope
1.1 This document covers a procedure for determining preference between two products using either a two-alternative
forced-choice, which may or may not include forced-choice task, or with the option of choosing no preference. Preference testing
is a type of hedonic testing.
1.2 A paired preference test determines whether there is a statistically significant preference between two products for a given
population of respondents. The target population must be carefully considered.
1.3 This method establishes preference in a single evaluation context. Replicated tests will not be covered within the scope of
this document.
1.4 Paired preference testing can address overall preference or preference for a specified sensory attribute.
1.5 The method does not directly determine the magnitude of preference.
1.6 This method does not address whether or not two samples are perceived as different. See Refer to Test Method E2164. for
directional difference test.
1.7 A paired preference test is a simple task for respondents, and can be used with populations that have minimal reading or
comprehension skills, or both.
1.8 Preference is not an intrinsic attribute of the product, such as hue is, but is a subjective measure relating to respondents’
affective or hedonic response. It differs from paired comparison testing which measures objective characteristics of the product.
Preference results are always dependent on the population sampled.
1.9 This standard does not purport to address all of the safety concerns, if any, problems associated with its use. use, when
testing includes hazardous materials, operations, or equipment. It is the responsibility of the user of this standard to establish
appropriate safety and health practices and to determine the applicability of regulatory limitations prior to use.
2. Referenced Documents
2
2.1 ASTM Standards:
E253 Terminology Relating to Sensory Evaluation of Materials and Products
E456 Terminology Relating to Quality and Statistics
E1858 Test Method for Determining Oxidation Induction Time of Hydrocarbons by Differential Scanning Calorimetry
E1871 Guide for Serving Protocol for Sensory Evaluation of Foods and Beverages
E1958 Guide for Sensory Claim Substantiation
E2164 Test Method for Directional Difference Test
2.2 ASTM Publication:
2
Manual 26 Sensory Testing Methods, 2nd Edition
2.2 ISO Standard:
3
ISO 5495 Sensory Analysis—Methodology—Paired Comparison
1
This test method is under the jurisdiction of ASTM Committee E18 on Sensory Evaluation and is the direct responsibility of Subcommittee E18.04 on Fundamentals
of Sensory.
Current edition approved March 1, 2004Oct. 15, 2012. Published March 2004December 2012. Originally approved in 2004. Last previous edition approved in 2004 as
E2263 – 04. DOI: 10.1520/E2263-04.10.1520/E2263-12.
2
For referenced ASTM standards, visit the ASTM website, www.astm.org, or contact ASTM Customer Service at service@astm.org. For Annual Book of ASTM Standards
volume information, refer to the standard’s Document Summary page on the ASTM website.
3
Available from American National Standards Institute (ANSI), 25 W. 43rd St., 4th Floor, New York, NY 10036.
Copyright © ASTM International, 100 Barr Harbor Drive, PO Box C700, West Conshohocken, PA 19428-2959. United States
1
---------------------- Page: 1 ----------------------
E2263 − 12
3. Terminology
3.1 For definition of terms relating to sensory analysis, see Terminology E253, and for terms relating to statistics, see
Terminology E456.
3.2 Definitions of Terms Specific to This Standard:
3.2.1α(alpha) risk—the probability of concluding that a preference exists when, in reality, one does not. (Also known as Type
I Error or significance level.)
3.2.2β(beta) risk—the probability of concluding that no preference exists when, in reality, one does. (Also known as Type II
Error.)
3.2.3 common responses—for a one-sided test, the number of respondents selecting the product that is expected to be preferred.
For a two-sided test, the largest number of respondents selecting either product.
3.2.4 one-sided test—a test in which the researcher ha
...
Questions, Comments and Discussion
Ask us and Technical Secretary will try to provide an answer. You can facilitate discussion about the standard in here.