Sensory analysis - Methodology - General guidance for conducting hedonic tests with consumers in a controlled area (ISO 11136:2014)

ISO 11136:2014 describes approaches for measuring, within a controlled area, the degree to which consumers like or relatively like products.
It uses tests based on collecting consumers' responses to questions, generally on paper or via a keyboard or a touch screen. Tests of a behavioural nature (such as recording quantities consumed ad libitum by the consumers) do not fall within the scope of ISO 11136:2014.

Sensorische Analyse - Methodologie - Allgemeiner Leitfaden für die Durchführung hedonischer Prüfungen (Verbrauchertests) in einem festgelegten Bereich (ISO 11136:2014)

Diese Internationale Norm beschreibt Ansätze zur Messung des Grades, in dem Verbraucher Produkte als angenehm oder relativ angenehm empfinden, in einem kontrollierten Umfeld.
Hierbei kommen Prüfungen zum Einsatz, in deren Rahmen die Antworten von Verbrauchern auf Fragen erfasst werden, entweder allgemein in Papierform oder über eine Tastatur oder ein Touchscreen. Prüfungen verhaltensbezogener Art (wie z. B. die Erfassung der von Verbrauchern ad libitum verbrauchten Mengen) fallen nicht in den Anwendungsbereich dieser Internationalen Norm.
Die in dieser Internationalen Norm beschriebenen hedonischen Prüfungen können für folgende Aufgabenstellungen eingesetzt werden:
—   Vergleich eines Produktes mit Wettbewerbsprodukten;
—   Optimierung eines Produktes, sodass es eine hohe hedonische Einstufung erhält oder von einer großen Anzahl an Verbrauchern als angenehm empfunden wird;
—   Unterstützung bei der Entwicklung einer Produktreihe, die eine bestimmte Zielgruppe an Verbrauchern anspricht;
—   Unterstützung bei der Festlegung eines Mindesthaltbarkeitsdatums;
—   Beurteilung der Wirkung einer Rezepturänderung auf den vom Produkt ausgehenden Genusswert;
—   Untersuchung der Wirkung der sensorischen Eigenschaften eines Produktes darauf, als wie angenehm das Produkt empfunden wird, unabhängig von den extrinsischen Eigenschaften des Produktes, wie z. B. Marke, Preis oder Werbung;
—   Untersuchung der Auswirkungen einer Werbung oder auf die Aufmachung bezogenen Variable, wie z. B. Verpackung.
Die Verfahren dienen der Bestimmung
—   ob eine wahrnehmbare Präferenz besteht oder nicht (unterschiedliche Grade, in denen der betreffende Reiz als angenehm oder unangenehm empfunden wird) oder
—   ob keine wahrnehmbare Präferenz besteht oder doch (paarweise Ähnlichkeitsprüfung).

Analyse sensorielle - Méthodologie - Lignes directrices générales pour la réalisation d'épreuves hédoniques effectuées avec des consommateurs dans un espace contrôlé (ISO 11136:2014)

La présente Norme internationale décrit des méthodes de mesure, dans un espace contrôlé, du degré d'appréciation ou d'appréciation relative de produits par des consommateurs.
Elle utilise des essais reposant sur la collecte de réponses des consommateurs à des questions, généralement sur papier ou à l'aide d'un clavier ou d'un écran tactile. Les essais de nature comportementale (notamment l'enregistrement des quantités consommées ad libitum par les consommateurs) ne font pas partie du domaine d'application de la présente Norme internationale.
Les épreuves hédoniques traitées dans la présente Norme internationale peuvent être utilisées sous la forme d'une contribution aux éléments suivants:
—          comparer un produit avec des produits concurrentiels;
—          optimiser un produit afin qu'il obtienne une note hédonique élevée ou qu'il soit apprécié par un grand nombre de consommateurs;
—          aider à définir une gamme de produits correspondant à une population cible de consommateurs particuliers;
—          aider à définir la date de durabilité minimale;
—          évaluer l'impact d'un changement de formulation du produit sur le plaisir procuré par le produit;
—          étudier l'impact des caractéristiques sensorielles d'un produit sur le degré d'appréciation de celui-ci, quelles que soient les caractéristiques extrinsèques du produit, notamment la marque, le prix ou la publicité;
—          étudier l'effet d'une variable commerciale ou de présentation, notamment l'emballage.
Les méthodes sont efficaces pour déterminer:
—          s'il existe ou non une préférence perceptible (différence du degré d'appréciation); ou
—          s'il existe ou non une préférence imperceptible (essais par paires de similitude).

Senzorična analiza - Metodologija - Splošno navodilo za izvajanje hedoničnih preskusov s pomočjo potrošnikov v nadzorovanem območju (ISO 11136:2014)

ISO 11136:2014 opisuje pristope za merjenje (v nadzorovanem območju) stopnje, do katere so izdelki potrošnikom všeč ali sorazmerno všeč.
Standard uporablja preskuse, ki temeljijo na zbiranju odgovorov potrošnikov na vprašanja, običajno na papirju ali prek tipkovnice ali zaslona na dotik. Preskusi narave vedenja (kot je beleženje količin, ki so jih potrošniki poljubno porabili) ne spadajo na področje uporabe standarda ISO 11136:2014.

General Information

Status
Published
Public Enquiry End Date
19-Dec-2016
Publication Date
15-Aug-2017
Current Stage
6060 - National Implementation/Publication (Adopted Project)
Start Date
02-Aug-2017
Due Date
07-Oct-2017
Completion Date
16-Aug-2017

Relations

Buy Standard

Standard
EN ISO 11136:2017
English language
52 pages
sale 10% off
Preview
sale 10% off
Preview
e-Library read for
1 day

Standards Content (Sample)

SLOVENSKI STANDARD
SIST EN ISO 11136:2017
01-september-2017
6HQ]RULþQDDQDOL]D0HWRGRORJLMD6SORãQRQDYRGLOR]DL]YDMDQMHKHGRQLþQLK
SUHVNXVRYVSRPRþMRSRWURãQLNRYYQDG]RURYDQHPREPRþMX ,62
Sensory analysis - Methodology - General guidance for conducting hedonic tests with
consumers in a controlled area (ISO 11136:2014)
Sensorische Analyse - Methodologie - Allgemeiner Leitfaden für die Durchführung
hedonischer Prüfungen (Verbrauchertests) in einem festgelegten Bereich (ISO
11136:2014)
Analyse sensorielle - Méthodologie - Lignes directrices générales pour la réalisation
d'épreuves hédoniques effectuées avec des consommateurs dans un espace contrôlé
(ISO 11136:2014)
Ta slovenski standard je istoveten z: EN ISO 11136:2017
ICS:
67.240 6HQ]RULþQDDQDOL]D Sensory analysis
SIST EN ISO 11136:2017 en
2003-01.Slovenski inštitut za standardizacijo. Razmnoževanje celote ali delov tega standarda ni dovoljeno.

---------------------- Page: 1 ----------------------

SIST EN ISO 11136:2017

---------------------- Page: 2 ----------------------

SIST EN ISO 11136:2017


EN ISO 11136
EUROPEAN STANDARD

NORME EUROPÉENNE

May 2017
EUROPÄISCHE NORM
ICS 67.240
English Version

Sensory analysis - Methodology - General guidance for
conducting hedonic tests with consumers in a controlled
area (ISO 11136:2014)
Analyse sensorielle - Méthodologie - Lignes directrices Sensorische Analyse - Methodologie - Allgemeiner
générales pour la réalisation d'épreuves hédoniques Leitfaden für die Durchführung hedonischer Prüfungen
effectuées avec des consommateurs dans un espace (Verbrauchertests) in einem festgelegten Bereich (ISO
contrôlé (ISO 11136:2014) 11136:2014)
This European Standard was approved by CEN on 31 January 2017.

CEN members are bound to comply with the CEN/CENELEC Internal Regulations which stipulate the conditions for giving this
European Standard the status of a national standard without any alteration. Up-to-date lists and bibliographical references
concerning such national standards may be obtained on application to the CEN-CENELEC Management Centre or to any CEN
member.

This European Standard exists in three official versions (English, French, German). A version in any other language made by
translation under the responsibility of a CEN member into its own language and notified to the CEN-CENELEC Management
Centre has the same status as the official versions.

CEN members are the national standards bodies of Austria, Belgium, Bulgaria, Croatia, Cyprus, Czech Republic, Denmark, Estonia,
Finland, Former Yugoslav Republic of Macedonia, France, Germany, Greece, Hungary, Iceland, Ireland, Italy, Latvia, Lithuania,
Luxembourg, Malta, Netherlands, Norway, Poland, Portugal, Romania, Serbia, Slovakia, Slovenia, Spain, Sweden, Switzerland,
Turkey and United Kingdom.





EUROPEAN COMMITTEE FOR STANDARDIZATION
COMITÉ EUROPÉEN DE NORMALISATION

EUROPÄISCHES KOMITEE FÜR NORMUNG

CEN-CENELEC Management Centre: Avenue Marnix 17, B-1000 Brussels
© 2017 CEN All rights of exploitation in any form and by any means reserved Ref. No. EN ISO 11136:2017 E
worldwide for CEN national Members.

---------------------- Page: 3 ----------------------

SIST EN ISO 11136:2017
EN ISO 11136:2017 (E)
Contents Page
European foreword . 3

2

---------------------- Page: 4 ----------------------

SIST EN ISO 11136:2017
EN ISO 11136:2017 (E)
European foreword
The text of ISO 11136:2014 has been prepared by Technical Committee ISO/TC 34 “Food products” of
the International Organization for Standardization (ISO) and has been taken over as
EN ISO 11136:2017.
This European Standard shall be given the status of a national standard, either by publication of an
identical text or by endorsement, at the latest by November 2017, and conflicting national standards
shall be withdrawn at the latest by November 2017.
Attention is drawn to the possibility that some of the elements of this document may be the subject of
patent rights. CEN [and/or CENELEC] shall not be held responsible for identifying any or all such patent
rights.
According to the CEN-CENELEC Internal Regulations, the national standards organizations of the
following countries are bound to implement this European Standard: Austria, Belgium, Bulgaria,
Croatia, Cyprus, Czech Republic, Denmark, Estonia, Finland, Former Yugoslav Republic of Macedonia,
France, Germany, Greece, Hungary, Iceland, Ireland, Italy, Latvia, Lithuania, Luxembourg, Malta,
Netherlands, Norway, Poland, Portugal, Romania, Serbia, Slovakia, Slovenia, Spain, Sweden, Switzerland,
Turkey and the United Kingdom.
Endorsement notice
The text of ISO 11136:2014 has been approved by CEN as EN ISO 11136:2017 without any modification.

3

---------------------- Page: 5 ----------------------

SIST EN ISO 11136:2017

---------------------- Page: 6 ----------------------

SIST EN ISO 11136:2017
INTERNATIONAL ISO
STANDARD 11136
First edition
2014-12-01
Sensory analysis — Methodology
— General guidance for conducting
hedonic tests with consumers in a
controlled area
Analyse sensorielle — Méthodologie — Lignes directrices générales
pour la réalisation d’épreuves hédoniques effectuées avec des
consommateurs dans un espace contrôlé
Reference number
ISO 11136:2014(E)
©
ISO 2014

---------------------- Page: 7 ----------------------

SIST EN ISO 11136:2017
ISO 11136:2014(E)

COPYRIGHT PROTECTED DOCUMENT
© ISO 2014
All rights reserved. Unless otherwise specified, no part of this publication may be reproduced or utilized otherwise in any form
or by any means, electronic or mechanical, including photocopying, or posting on the internet or an intranet, without prior
written permission. Permission can be requested from either ISO at the address below or ISO’s member body in the country of
the requester.
ISO copyright office
Case postale 56 • CH-1211 Geneva 20
Tel. + 41 22 749 01 11
Fax + 41 22 749 09 47
E-mail copyright@iso.org
Web www.iso.org
Published in Switzerland
ii © ISO 2014 – All rights reserved

---------------------- Page: 8 ----------------------

SIST EN ISO 11136:2017
ISO 11136:2014(E)

Contents Page
Foreword .v
1 Scope . 1
2 Normative references . 1
3 Terms and definitions . 1
4 Preliminary considerations . 3
4.1 Study proposal. 3
4.2 Specification of the target population . 4
4.3 Further specifications . 4
5 The consumer sample . 5
5.1 General . 5
5.2 Recruiting the consumers. 5
5.3 Assembling a consumer sample . 7
5.4 Sample segmentation . 7
6 Size of the consumer sample . 8
6.1 Decisions of measurement . 8
6.2 Determining the sample size . 8
6.3 Working with subgroups . 9
6.4 Number of product samples and experimental design . 9
6.5 Safety margin in recruitment . 9
7 Test area .10
8 Products .10
8.1 Anonymous presentation of the products .10
8.2 Preparation and presentation of the products .10
9 Procedures .11
9.1 Two groups of hedonic tests .11
9.2 Rating tests .12
9.3 Paired comparison tests .12
9.4 Ranking test .13
9.5 Additional questions .14
9.6 Instructions for the consumers .14
10 Organization of test sessions .15
10.1 General .15
10.2 Plans .15
10.3 Number of products evaluated in a single session .16
10.4 Nature of the products evaluated within a session .17
10.5 Time of the session .17
10.6 Repetition of a product within a test .17
10.7 Pre-test .17
11 Analysis of the results .18
11.1 General .18
11.2 Inferential analysis .18
11.3 Ratings (see 9.2) .18
11.4 Paired comparisons (9.3) .18
11.5 Ranking (9.4) .18
© ISO 2014 – All rights reserved iii

---------------------- Page: 9 ----------------------

SIST EN ISO 11136:2017
ISO 11136:2014(E)

12 Study report .19
12.1 General .19
12.2 Products .19
12.3 Test procedure .20
12.4 Consumers .20
12.5 Results .21
12.6 Annexes to the report .21
Annex A (informative) Example of a recruitment questionnaire .22
Annex B (informative) Methods for evaluating the data of segmentation subgroups .26
Annex C (informative) Plans for assigning products to consumers .28
Annex D (informative) Influence of the sample size on the accuracy of one mean .29
Annex E (informative) Minimum sample size for tests using rating.30
Annex F (informative) Minimum sample size for tests using ranking .34
Annex G (informative) Examples of data analysis for ratings .36
Annex H (informative) Examples of data analysis for rankings .41
Bibliography .43
iv © ISO 2014 – All rights reserved

---------------------- Page: 10 ----------------------

SIST EN ISO 11136:2017
ISO 11136:2014(E)

Foreword
ISO (the International Organization for Standardization) is a worldwide federation of national standards
bodies (ISO member bodies). The work of preparing International Standards is normally carried out
through ISO technical committees. Each member body interested in a subject for which a technical
committee has been established has the right to be represented on that committee. International
organizations, governmental and non-governmental, in liaison with ISO, also take part in the work.
ISO collaborates closely with the International Electrotechnical Commission (IEC) on all matters of
electrotechnical standardization.
The procedures used to develop this document and those intended for its further maintenance are
described in the ISO/IEC Directives, Part 1. In particular the different approval criteria needed for the
different types of ISO documents should be noted. This document was drafted in accordance with the
editorial rules of the ISO/IEC Directives, Part 2 (see www.iso.org/directives).
Attention is drawn to the possibility that some of the elements of this document may be the subject of
patent rights. ISO shall not be held responsible for identifying any or all such patent rights. Details of any
patent rights identified during the development of the document will be in the Introduction and/or on
the ISO list of patent declarations received (see www.iso.org/patents).
Any trade name used in this document is information given for the convenience of users and does not
constitute an endorsement.
For an explanation on the meaning of ISO specific terms and expressions related to conformity
assessment, as well as information about ISO’s adherence to the WTO principles in the Technical Barriers
to Trade (TBT) see the following URL: Foreword - Supplementary information
The committee responsible for this document is ISO/TC 34, Food products, Subcommittee SC 12,
Sensory analysis.
© ISO 2014 – All rights reserved v

---------------------- Page: 11 ----------------------

SIST EN ISO 11136:2017

---------------------- Page: 12 ----------------------

SIST EN ISO 11136:2017
INTERNATIONAL STANDARD ISO 11136:2014(E)
Sensory analysis — Methodology — General guidance for
conducting hedonic tests with consumers in a controlled area
1 Scope
This International Standard describes approaches for measuring, within a controlled area, the degree to
which consumers like or relatively like products.
It uses tests based on collecting consumers’ responses to questions, generally on paper or via a keyboard
or a touch screen. Tests of a behavioural nature (such as recording quantities consumed ad libitum by
the consumers) do not fall within the scope of this International Standard.
The hedonic tests dealt with in this International Standard, can be used as a contribution to the following:
— comparing a product with competitor products;
— optimizing a product so that it obtains a high hedonic rating or is liked by a large number of consumers;
— helping to define a range of products to correspond to a particular consumer target population;
— helping to define a best-before date;
— assessing the impact of a product formulation change on the pleasure given by the product;
— studying the impact of sensory characteristics of a product on degree to which it is liked,
independently of the product’s extrinsic characteristics, such as brand, price, or advertising;
— studying the effect of a commercial or presentation variable, such as packaging.
The methods are effective for determining
— whether or not, a perceptible preference exists (difference in degree of liking), or
— whether or not, no perceptible preference (paired similarity test) exists.
2 Normative references
The following documents, in whole or in part, are normatively referenced in this document and are
indispensable for its application. For dated references, only the edition cited applies. For undated
references, the latest edition of the referenced document (including any amendments) applies.
ISO 4121, Sensory analysis — Guidelines for the use of quantitative response scales
ISO 5492, Sensory analysis — Vocabulary
ISO 5495, Sensory analysis — Methodology — Paired comparison test
ISO 8587, Sensory analysis — Methodology — Ranking
ISO 8589, Sensory analysis — General guidance for the design of test rooms
ISO 29842, Sensory analysis — Methodology — Balanced incomplete block designs
3 Terms and definitions
For the purposes of this document, the terms and definitions given in ISO 5492 and the following apply.
© ISO 2014 – All rights reserved 1

---------------------- Page: 13 ----------------------

SIST EN ISO 11136:2017
ISO 11136:2014(E)

3.1
access panel
sample database of potential respondents who declare that they will cooperate for future data
collection if selected
[SOURCE: ISO 20252]
Note 1 to entry: Respondents can be drawn on a more or less regular basis.
3.2
closed-ended question
question requiring respondents to select from a predetermined list of possible answers
3.3
commissioning party
person, body, or service who commissions a third party to conduct a study
Note 1 to entry: The concept of commissioning party corresponds to that of purchaser or customer in quality
control. It contrasts with that of the supplier, service provider, or laboratory
Note 2 to entry: Usually, the commissioning party and the service provider belong to different enterprises. Where
they belong to two departments of the same enterprise, the respective responsibilities of the two departments
shall be carefully differentiated and explicitly clarified in the study proposal
3.4
consumer
respondent
person who uses a product
Note 1 to entry: For the purposes of this International Standard, the meaning is restricted to a person who is
neither an expert, an expert sensory assessor nor a selected assessor in conformity with ISO 5492.
3.5
consumer sample
group of consumers recruited on the basis of criteria specified by the nature of the target population
3.6
controlled area
location providing
— controlled preparation and presentation of the products,
— comfortable conditions for consuming the products and for questioning the consumers, and
— absence of communication (verbal and non-verbal) between the consumers, guaranteeing
independent responses
3.7
hedonic perception
amount of pleasure given by the sensory properties of a product
3.8
hedonic test
test aimed at measuring the overall hedonic perception of a product by consumers
3.9
open-ended question
question that does not provide ready-made alternatives for respondents but asks them to answer in
their own words
Note 1 to entry: It can concern each of the products presented to the consumers or only some of them (e.g. when
the question asks why a particular product has appealed most, or least, to an consumer).
2 © ISO 2014 – All rights reserved

---------------------- Page: 14 ----------------------

SIST EN ISO 11136:2017
ISO 11136:2014(E)

3.10
position bias
bias related to the location of a product in a set of products being evaluated
3.11
product family
group of products that can replace one another under normal conditions of consumption
Note 1 to entry: Product families may vary according to culture and consumption habits.
3.12
representativeness
degree to which attributes of the sample agree with relevant attributes of the population
from which it is drawn
3.13
sequential bias
bias related to the temporal or sequential position of a product in a set of products being evaluated
3.14
session
meeting of consumers working simultaneously according to the same protocol during a defined time period
Note 1 to entry: A session can be divided into several subsessions separated by a defined rest time. For example, a
session lasting 1 h 30 min can be divided into two subsessions with a 10-min break between them.
3.15
target population
population whose hedonic response to a product is to be evaluated
4 Preliminary considerations
4.1 Study proposal
The study proposal is drawn up by the service-providing laboratory based on the information (especially
concerning the objective of the study and target population) given by the commissioning party, as a
written document that binds the laboratory and the commissioning party contractually. It includes the
following elements:
— the objective of the study;
— the products to be evaluated (and the procedures for their procurement, especially when the
laboratory has to procure one or more products);
— the target population for the study;
— the size of the consumer sample (sample size) and the way it is to be recruited;
— any limitations on consumers’ prior history of participation in consumer studies;
— any limitations on other products to be evaluated in the same testing session;
— the evaluation conditions;
— the type of interview (self-completion forms or interviewers);
— the questionnaire;
— the place of evaluation;
© ISO 2014 – All rights reserved 3

---------------------- Page: 15 ----------------------

SIST EN ISO 11136:2017
ISO 11136:2014(E)

— the number of products to be evaluated per session in the proposed study, together with an
indication of other products to be evaluated where the session comprises several product families
(where these products are not known at the time of drawing up the proposal, the laboratory should
be committed to communicate them as soon as the laboratory knows the nature of the products);
— the conditions of preparation specific to the products to be evaluated (if they are known at this stage);
— any instructions specific to the products to be evaluated (if they are known at this stage) together
with any specific information to be given about the products or the test at the start of the session;
— the name of the statistical tests to be used for interpreting the results; the type of risks used and
their tolerable values; the magnitude of the minimum difference to be detected in a difference of
liking test or of the maximum tolerable difference in a similarity of liking test;
— any envisaged segmentation of the consumer population, based either on characteristics known
before obtaining judgment data or from the responses obtained;
— the method of examining and summarizing open-ended questions;
— any recommendations the commissioning party wishes the laboratory to draft on the basis of the results;
— the dates envisaged for the tests and for submission of the report.
When any of the above elements are unknown at the time of the study proposal, the proposal includes for
each element concerned the following statement: “This element will be specified by the commissioning
party by. [specifying the stage of the study].”
NOTE If a specification already exists, the study proposal may make reference to it without repeating
technical points described in an operational manner in the specification.
4.2 Specification of the target population
In order to specify the target population, it is necessary to answer the following questions. These
questions shall be considered for each test to be performed because the consumer target group can be
different from one test to the next, even for the same product.
— Has the product to be tested already been introduced on the market? If so, is it possible to distinguish
between actual and potential consumers?
— Are the consumers of interest those who actually use the product, potential consumers who have
not been using the product or both groups?
— Are results from specified subgroups to be examined and compared?
— Are the results of the total consumer sample to be analysed with a view identifying subgroups?
— Are differences between the results of individuals of interest?
4.3 Further specifications
Subsequent to specifying the target popul
...

Questions, Comments and Discussion

Ask us and Technical Secretary will try to provide an answer. You can facilitate discussion about the standard in here.