ISO 29842

Sensory analysis — Methodology — Balanced incomplete block designs

This document specifies a method for the application of balanced incomplete block designs to sensory descriptive and hedonic tests. This document is applicable when the number of test samples exceeds the number of evaluations that an assessor can perform reliably in a single session. This document also specifies the fundamental characteristics of balanced incomplete block designs and establishes guidelines for their application in sensory evaluation.

Analyse sensorielle — Méthodologie — Plans de présentation en blocs incomplets équilibrés

Le présent document spécifie une méthode pour l’application de plans de présentation en blocs incomplets équilibrés destinés aux essais sensoriels descriptifs et hédoniques. Le présent document s’applique lorsque le nombre d’échantillons pour essai est supérieur au nombre d’évaluations qu’un sujet peut effectuer de manière fiable au cours d’une seule session. Le présent document spécifie également les caractéristiques fondamentales des plans de présentation en blocs incomplets équilibrés et établit les lignes directrices relatives à leur application dans le cadre de l’évaluation sensorielle.

General Information

• Status: Not Published
• ICS: 67.240 - Sensory analysis
• Technical Committee: ISO/TC 34/SC 12 - Sensory analysis
• Drafting Committee: ISO/TC 34/SC 12 - Sensory analysis

Relations

• Revises: ISO 29842:2011 - Sensory analysis — Methodology — Balanced incomplete block designs
• Effective Date: 15-Jul-2023
• Revises: ISO 29842:2011/Amd 1:2015 - Sensory analysis — Methodology — Balanced incomplete block designs — Amendment 1
• Effective Date: 15-Jul-2023

Standards Content (Sample)

FINAL DRAFT
International
Standard
ISO/FDIS 29842
ISO/TC 34/SC 12
Sensory analysis — Methodology —
Secretariat: IRAM
Balanced incomplete block designs
Voting begins on:
Analyse sensorielle — Méthodologie — Plans de présentation en 2024-03-20
blocs incomplets équilibrés
Voting terminates on:
2024-05-15
RECIPIENTS OF THIS DRAFT ARE INVITED TO SUBMIT,
WITH THEIR COMMENTS, NOTIFICATION OF ANY
RELEVANT PATENT RIGHTS OF WHICH THEY ARE AWARE
AND TO PROVIDE SUPPOR TING DOCUMENTATION.
IN ADDITION TO THEIR EVALUATION AS
BEING ACCEPTABLE FOR INDUSTRIAL, TECHNO­
LOGICAL, COMMERCIAL AND USER PURPOSES, DRAFT
INTERNATIONAL STANDARDS MAY ON OCCASION HAVE
TO BE CONSIDERED IN THE LIGHT OF THEIR POTENTIAL
TO BECOME STAN DARDS TO WHICH REFERENCE MAY BE
MADE IN NATIONAL REGULATIONS.
Reference number
ISO/FDIS 29842:2024(en) © ISO 2024

FINAL DRAFT
ISO/FDIS 29842:2024(en)
International
Standard
ISO/FDIS 29842
ISO/TC 34/SC 12
Sensory analysis — Methodology —
Secretariat: IRAM
Balanced incomplete block designs
Voting begins on:
Analyse sensorielle — Méthodologie — Plans de présentation en
blocs incomplets équilibrés
Voting terminates on:
RECIPIENTS OF THIS DRAFT ARE INVITED TO SUBMIT,
WITH THEIR COMMENTS, NOTIFICATION OF ANY
RELEVANT PATENT RIGHTS OF WHICH THEY ARE AWARE
AND TO PROVIDE SUPPOR TING DOCUMENTATION.
© ISO 2024
IN ADDITION TO THEIR EVALUATION AS
All rights reserved. Unless otherwise specified, or required in the context of its implementation, no part of this publication may
BEING ACCEPTABLE FOR INDUSTRIAL, TECHNO­
LOGICAL, COMMERCIAL AND USER PURPOSES, DRAFT
be reproduced or utilized otherwise in any form or by any means, electronic or mechanical, including photocopying, or posting on
INTERNATIONAL STANDARDS MAY ON OCCASION HAVE
the internet or an intranet, without prior written permission. Permission can be requested from either ISO at the address below
TO BE CONSIDERED IN THE LIGHT OF THEIR POTENTIAL
or ISO’s member body in the country of the requester.
TO BECOME STAN DARDS TO WHICH REFERENCE MAY BE
MADE IN NATIONAL REGULATIONS.
ISO copyright office
CP 401 • Ch. de Blandonnet 8
CH-1214 Vernier, Geneva
Phone: [phone]
Email: [e-mail]
Website: www.iso.org
Published in Switzerland Reference number
ISO/FDIS 29842:2024(en) © ISO 2024

ii
ISO/FDIS 29842:2024(en)
Contents Page
Foreword .iv
1 Scope . 1
2 Normative references . 1
3 Terms and definitions . 1
4 Specification of balanced incomplete block designs . 1
5 Data analysis . 2
5.1 General .2
5.2 Analysis of variance for rating data .3
5.3 Friedman's sum rank analysis for rank data .5
6 Application in sensory evaluation. 6
Annex A (informative) Catalogue of incomplete block designs . 7
Annex B (informative) Example of balanced incomplete block design with ratings data .15
Annex C (informative) Example of balanced incomplete block design with rank data . 17
Bibliography . 19

iii
ISO/FDIS 29842:2024(en)
Foreword
ISO (the International Organization for Standardization) is a worldwide federation of national standards
bodies (ISO member bodies). The work of preparing International Standards is normally carried out through
ISO technical committees. Each member body interested in a subject for which a technical committee
has been established has the right to be represented on that committee. International organizations,
governmental and non-governmental, in liaison with ISO, also take part in the work. ISO collaborates closely
with the International Electrotechnical Commission (IEC) on all matters of electrotechnical standardization.
The procedures used to develop this document and those intended for its further maintenance are described
in the ISO/IEC Directives, Part 1. In particular, the different approval criteria needed for the different types
of ISO document should be noted. This document was drafted in accordance with the editorial rules of the
ISO/IEC Directives, Part 2 (see www.iso.org/directives).
ISO draws attention to the possibility that the implementation of this document may involve the use of (a)
patent(s). ISO takes no position concerning the evidence, validity or applicability of any claimed patent
rights in respect thereof. As of the date of publication of this document, ISO had not received notice of (a)
patent(s) which may be required to implement this document. However, implementers are cautioned that
this may not represent the latest information, which may be obtained from the patent database available at
www.iso.org/patents. ISO shall not be held responsible for identifying any or all such patent rights.
Any trade name used in this document is information given for the convenience of users and does not
constitute an endorsement.
For an explanation of the voluntary nature of standards, the meaning of ISO specific terms and expressions
related to conformity assessment, as well as information about ISO's adherence to the World Trade
Organization (WTO) principles in the Technical Barriers to Trade (TBT), see www.iso.org/iso/foreword.html.
This document was prepared by Technical Committee ISO/TC 34, Food products, Subcommittee SC 12,
Sensory analysis.
This second edition cancels and replaces the first edition (ISO 29842:2011), of which it constitutes a minor
revision. It also incorporates the Amendment ISO 29842:2011/Amd.1:2015.
The changes are as follows:
— the corrections of the amendment have been included;
— the following clarifying sentence has been added in 5.2: “Typically, the assessors who participate in the
study are considered to comprise a random sample from a hypothetical population of similarly trained
and qualified assessors and are, therefore, treated as a random effect in the ANOVA model”;
— in Table 2, the formulae in the column “Mean square” have been corrected.
Any feedback or questions on this document should be directed to the user’s national standards body. A
complete listing of these bodies can be found at www.iso.org/members.html.

iv
FINAL DRAFT International Standard ISO/FDIS 29842:2024(en)
Sensory analysis — Methodology — Balanced incomplete
block designs
1 Scope
This document specifies a method for the application of balanced incomplete block designs to sensory
descriptive and hedonic tests.
This document is applicable when the number of test samples exceeds the number of evaluations that an
assessor can perform reliably in a single session.
This document also specifies the fundamental characteristics of balanced incomplete block designs and
establishes guidelines for their application in sensory evaluation.
2 Normative references
The following documents are referred to in the text in such a way that some or all of their content constitutes
requirements of this document. For dated references, only the edition cited applies. For undated references,
the latest edition of the referenced document (including any amendments) applies.
ISO 3534-1, Statistics — Vocabulary and symbols — Part 1: General statistical terms and terms used in
probability
ISO 5492, Sensory analysis — Vocabulary
3 Terms and definitions
For the purposes of this document, the terms and definitions given in ISO 3534-1, ISO 5492 and the
following apply.
ISO and IEC maintain terminology databases for use in standardization at the following addresses:
— ISO Online browsing platform: available at https:// www .iso .org/ obp
— IEC Electropedia: available at https:// www .electropedia .org/
3.1
block design
multi-sample serving protocol in which an assessor evaluates all or a subset of the
samples in a study
3.2
repetition
one occurrence of an experimental design
4 Specification of balanced incomplete block designs
Balanced incomplete block (BIB) designs apply to sensory tests in which the total number of samples
is greater than the number that can be evaluated before sensory and psychological fatigue set in. In BIB
designs, each assessor evaluates only a subset of the total number of samples in a single session.
An example of a BIB design is shown in Table 1.

ISO/FDIS 29842:2024(en)
Table 1 — A BIB design with five samples and 10 block/assessors
Test sample
Block
(assessor)
1 2 3 4 5
1 × × × — —
2 × × — × —
3 × × — — ×
4 × — × × —
5 × — × — ×
6 × — — × ×
7 — × × × —
8 — × × — ×
9 — × — × ×
10 — — × × ×
In a BIB design each assessor evaluates a subset, k, of the total number of samples, t, where k < t. The subset of
samples that an assessor evaluates is selected so that, in a single repetition of the BIB design, every sample is
evaluated an equal number of times and all possible pairs of two samples are evaluated by an equal number
of assessors.
The notation most commonly used in a BIB design is as follows:
— t  number of test samples;
— k  number of samples evaluated by an assessor in a single session (k < t);
— b  total number of blocks (typically, assessors) in one repetition of the BIB design;
— r  number of times each test sample is evaluated in one repetition of the BIB design;
— λ  number of times each pair of samples is evaluated by the same assessor;
— p  number of times the basic BIB design is repeated.
Notationally, each assessor evaluates k of the t samples (k < t). The subset of k samples that an assessor
evaluates is selected so that in a single repetition of the BIB design every sample is evaluated an equal
number of times and all possible pairs of samples are evaluated by an equal number of assessors. The number
of blocks (assessors) required to complete a single repetition of the BIB design is denoted by b. The number
of times each sample is evaluated in a single repetition of the BIB design is denoted by r and the number of
times every pair of two samples is evaluated together is denoted by λ.
The entire BIB design may need to be repeated several times in order to achieve an adequate level of precision
for the study. The number of repetitions of the basic BIB design is denoted by p. The total number of blocks
(typically assessors) is then p*b and the total of evaluations per sample is then p*r. The total number of times
each pair of samples is seen together is p*λ.
The constant values of r and λ for all samples in the BIB design imparts important statistical properties to
data collected from the design. The constant value of r ensures that the mean values of all of the samples are
estimated with equal precision. The constant value of λ ensures that all pair-wise comparisons between any
two samples are equally sensitive.
5 Data analysis
5.1 General
Two types of data can be collected using balanced incomplete block designs. Ratings data, or scores, are
obtained when assessors use a scale to report the perceived intensities of the attributes or impressions they
are evaluating. Rank data are obtained when assessors order the samples from lowest to highest (or vice

ISO/FDIS 29842:2024(en)
versa) relative to the attribute they are evaluating. Different data analysis methods are used for ratings and
rank data.
5.2 Analysis of variance for rating data
Analysis of variance (ANOVA) is used to analyse ratings data obtained from the BIB design. The sources
of variability accounted for in the ANOVA model for the BIB design are the same as those accounted for in
a randomized (complete) block design. In both cases, the total variability is partitioned into the separate
effects of blocks (typically assessors), treatments (typically samples) and errors. Typically, the assessors
who participate in the study are considered to comprise a random sample from a hypothetical population
of similarly trained and qualified assessors and are, therefore, treated as a random effect in the ANOVA
model. Because each assessor evaluates only a subset of the total number of test samples, more complicated
formulae are required to calculate the ANOVA sum-of-squares for the BIB design than for the randomized
(complete) block design. The sensory analyst shall ensure that the program used to perform the analysis is
capable of handling BIB designs. In many statistical computer packages, the ANOVA procedure applies only
to complete designs, i.e. studies in which every assessor evaluates all of the t
...

ISO/FDIS 29842:2023(2)
ISO/TC 34/SC 12
Secretariat: IRAM
Date: 2023-09-212024-03-05
Sensory analysis — Methodology — Balanced incomplete block
designs
Analyse sensorielle — Méthodologie — Plans de présentation en blocs incomplets équilibrés
FDIS stage
ISO/FDIS 29842:2024(en)
© ISO 298422024
All rights reserved. Unless otherwise specified, or required in the context of its implementation, no part of this publication
may be reproduced or utilized otherwise in any form or by any means, electronic or mechanical, including photocopying,
or posting on the internet or an intranet, without prior written permission. Permission can be requested from either ISO
at the address below or ISO’s member body in the country of the requester.
ISO copyright office
CP 401 • Ch. de Blandonnet 8
CH-1214 Vernier, Geneva
Phone: + 41 22 749 01 11
E-mail: [e-mail]
Website: www.iso.org
Published in Switzerland
ii
ISO/FDIS 29842:2024(en)
Contents
Foreword . iv
1 Scope . 1
2 Normative references . 1
3 Terms and definitions . 1
4 Specification of balanced incomplete block designs . 1
5 Data analysis . 3
5.1 General . 3
5.2 Analysis of variance for rating data . 3
5.3 Friedman's sum rank analysis for rank data . 5
6 Application in sensory evaluation . 6
Annex A (informative) Catalogue of incomplete block designs . 7
Annex B (informative) Example of balanced incomplete block design with ratings data . 16
B.1 Problem and situation . 16
B.2 Test design . 16
B.3 Results . 17
Annex C (informative) Example of balanced incomplete block design with rank data . 19
C.1 Problem and situation . 19
C.2 Test design . 19
C.3 Analysis of results . 19
Bibliography . 21

iii
ISO/FDIS 29842:2024(en)
Foreword
ISO (the International Organization for Standardization) is a worldwide federation of national standards
bodies (ISO member bodies). The work of preparing International Standards is normally carried out through
ISO technical committees. Each member body interested in a subject for which a technical committee has been
established has the right to be represented on that committee. International organizations, governmental and
non-governmental, in liaison with ISO, also take part in the work. ISO collaborates closely with the
International Electrotechnical Commission (IEC) on all matters of electrotechnical standardization.
The procedures used to develop this document and those intended for its further maintenance are described
in the ISO/IEC Directives, Part 1. In particular, the different approval criteria needed for the different types of
ISO documentsdocument should be noted. This document was drafted in accordance with the editorial rules
of the ISO/IEC Directives, Part 2 (see www.iso.org/directives).
ISO draws attention to the possibility that the implementation of this document may involve the use of (a)
patent(s). ISO takes no position concerning the evidence, validity or applicability of any claimed patent rights
in respect thereof. As of the date of publication of this document, ISO [had/had not] received notice of (a)
patent(s) which may be required to implement this document. However, implementers are cautioned that this
may not represent the latest information, which may be obtained from the patent database available at
www.iso.org/patents. ISO shall not be held responsible for identifying any or all such patent rights.
Any trade name used in this document is information given for the convenience of users and does not
constitute an endorsement.
For an explanation of the voluntary nature of standards, the meaning of ISO specific terms and expressions
related to conformity assessment, as well as information about ISO's adherence to the World Trade
Organization (WTO) principles in the Technical Barriers to Trade (TBT), see www.iso.org/iso/foreword.html.
This document was prepared by Technical Committee ISO/TC 34 food, Food products, Subcommittee SC 12,
sensorySensory analysis.
This second edition cancels and replaces the first edition (ISO 29842:2011), which has been technically
revisedof which it constitutes a minor revision. It also incorporates the Amendment ISO
29842:2011/Amd.1:2015.
The main changes are as follows:
— Thethe corrections of the corresponding Amendment 1 (ISO29842 :2011/AMD 1) are amendment have
been included;
— the following clarifying sentence has been added in 5.2this edition. : “Typically, the assessors who
participate in the study are considered to comprise a random sample from a hypothetical population of
similarly trained and qualified assessors and are, therefore, treated as a random effect in the ANOVA
model”;
— in Table 2, the formulae in the column “Mean square” have been corrected.
Any feedback or questions on this document should be directed to the user’s national standards body. A
complete listing of these bodies can be found at www.iso.org/members.html.
iv
ISO/FDIS 29842:2024(en)
Sensory analysis — Methodology — Balanced incomplete block
designs
1 Scope
This International Standarddocument specifies a method for the application of balanced incomplete block
designs to sensory descriptive and hedonic tests.
This International Standard appliesdocument is applicable when the number of test samples exceeds the
number of evaluations that an assessor can perform reliably in a single session.
This International Standarddocument also specifies the fundamental characteristics of balanced incomplete
block designs and establishes guidelines for their application in sensory evaluation.
2 Normative references
The following referenced documents are indispensable forreferred to in the applicationtext in such a way that
some or all of their content constitutes requirements of this document. For dated references, only the edition
cited applies. For undated references, the latest edition of the referenced document (including any
amendments) applies.
ISO 3534-1, Statistics — Vocabulary and symbols — Part 1: General statistical terms and terms used in
probability
ISO 5492, Sensory analysis — Vocabulary
3 Terms and definitions
For the purposes of this document, the terms and definitions given in ISO 5492, ISO 3534-1, ISO 5492 and the
following apply.
ISO and IEC maintain terminology databases for use in standardization at the following addresses:
— ISO Online browsing platform: available at https://www.iso.org/obp
— IEC Electropedia: available at https://www.electropedia.org/
3.1
block design
multi-sample serving protocol in which an assessor evaluates all or a subset of the samples
in a study
3.2
repetition
one occurrence of an experimental design
4 Specification of balanced incomplete block designs
Balanced incomplete block (BIB) designs apply to sensory tests in which the total number of samples is greater
than the number that can be evaluated before sensory and psychological fatigue set in. In BIB designs, each
assessor evaluates only a subset of the total number of samples in a single session.
ISO/FDIS 29842:2024(en)
An example of a BIB design is shown in Table 1.
Table 1 — A BIB design with five samples and 10 block/assessors
Test sample
Block
(assessor)
1 2 3 4 5
1 ×  ×  × — —
2 ×  × — × —
3 ×  × — — ×
4 × — ×  × —
5 × — × — ×
6 × — — ×  ×
7 — ×  ×  × —
8 — ×  × — ×
9 — × — ×  ×
10 — — ×  ×  ×
In a BIB design each assessor evaluates a subset, k, of the total number of samples, t, where k < t. The subset
of samples that an assessor evaluates is selected so that, in a single repetition of the BIB design, every sample
is evaluated an equal number of times and all possible pairs of two samples are evaluated by an equal number
of assessors.
The notation most commonly used in a BIB design is as follows.:
— t  number of test samples;
— k  number of samples evaluated by an assessor in a single session (k < t);
— b  total number of blocks (typically, assessors) in one repetition of the BIB design;
— r  number of times each test sample is evaluated in one repetition of the BIB design;
— λ  number of times each pair of samples is evaluated by the same assessor;
— p  number of times the basic BIB design is repeated.
Notationally, each assessor evaluates k of the t samples (k < t). The subset of k samples that an assessor
evaluates is selected so that in a single repetition of the BIB design every sample is evaluated an equal number
of times and all possible pairs of samples are evaluated by an equal number of assessors. The number of blocks
(assessors) required to complete a single repetition of the BIB design is denoted by b. The number of times
each sample is evaluated in a single repetition of the BIB design is denoted by r and the number of times every
pair of two samples is evaluated together is denoted by λ.
The entire BIB design may need to be repeated several times in order to achieve an adequate level of precision
for the study. The number of repetitions of the basic BIB design is denoted by p. The total number of blocks
(typically assessors) is then p*b and the total of evaluations per sample is then p*r. The total number of times
each pair of samples is seen together is p*λ.
ISO/FDIS 29842:2024(en)
The constant values of r and λ for all samples in the BIB design imparts important statistical properties to data
collected from the design. The constant value of r ensures that the mean values of all of the samples are
estimated with equal precision. The constant value of λ ensures that all pair-wise comparisons between any
two samples are equally sensitive.
5 Data analysis
5.1 General
Two types of data can be collected using balanced incomplete block designs. Ratings data, or scores, are
obtained when assessors use a scale to report the perceived intensities of the attributes or impressions they
are evaluating. Rank data are obtained when assessors order the samples from lowest to highest (or vice
versa) relative to the attribute they are evaluating. Different data analysis methods are used for ratings and
rank data.
5.2 Analysis of variance for rating data
Analysis of variance (ANOVA) is used to analyse ratings data obtained from the BIB design. The sources of
variability accounted for in the ANOVA model for the BIB design are the same as those accounted for in a
randomized (complete) block design. In both cases, the total variability is partitioned into the separate effects
of blocks (typically assessors), treatments (typically samples) and errors. Typically, the assessors who
participate in the study are considered to comprise a random sample from a hypothetical population of
similarly trained and qualified assessors and are, therefore, treated as a random effect in the ANOVA model.
Because each assessor evaluates only a subset of the total number of test samples, more complicated formulae
are required to calculate the ANOVA sum-of-squares for the BIB design than for the randomized (complete)
block design. The sensory analyst shall ensure that the program used to perform the analysis is capable of
handling BIB designs. In many statistical computer packages, the ANOVA procedure applies only to complete
designs, i.e. studies in which every assessor evaluates all of the test samples. For incomplete designs, such as
BIB designs, the general linear model (GLM) procedure or a mixed model procedure is required.
The form of the ANOVA used to analyse BIB data depends on how the d
...