ISO/IEC 17991:2021

Information technology - Office equipment - Method for measuring scanning productivity of digital scanning devices

This document specifies a method for determining scanning productivity by measuring "scanning speed", "scan to network folder speed" and "scan to PC speed". It includes test files, test setup procedure, test procedure and the reporting requirements for the scanning productivity measurements. This document is applicable to scanning devices including but not limited to multi-function devices, networked scanners and single-function scanners of any underlying scanning technology. This document is applicable to devices which are able to scan a media size of A4/8,5" × 11" and which have an automatic document feeder (ADF). It is also applicable to devices which have the ability to scan to network folder, or folder on PC and do not require, but can use, other application programs on a computer or another device to perform a scanning job. This document does not apply to testing and measurement of scan to USB, scan to local hard drive or other storage medium that is part of or plugged into the scanner. This document is not intended to be used for image quality measurement, document or record management of any scanned images.

Technologie de l'information — Équipement d'office — Méthode de mesure de la productivité du scanner des appareils de numérisation

General Information

• Status: Published
• Publication Date: 26-Jan-2021
• ICS: 37.100.10 - Reproduction equipment
• Technical Committee: ISO/IEC JTC 1/SC 28 - Office equipment
• Drafting Committee: ISO/IEC JTC 1/SC 28/WG 3 - Productivity
• Current Stage: 6060 - International Standard published
• Start Date: 27-Jan-2021
• Due Date: 18-Jan-2021
• Completion Date: 27-Jan-2021

Relations

• Consolidated By: ISO 4064-2:2024 - Water meters for cold potable water and hot water - Part 2: Test methods
• Effective Date: 06-Jun-2022
• Revises: ISO/IEC 17991:2015 - Information technology - Office equipment - Method for Measuring Scanning Productivity of Digital Multifunctional Devices
• Effective Date: 14-Oct-2017

Overview

ISO/IEC 17991:2021 - Information technology - Office equipment - Method for measuring scanning productivity of digital scanning devices defines a standardized method to measure and report the productivity of digital scanners. The standard specifies procedures to measure scanning speed, scan to network folder speed, and scan to PC speed, including test files, test targets (test charts), test setup, execution steps and reporting requirements. It applies to A4/letter-capable devices with an automatic document feeder (ADF): multi‑function devices, networked scanners and single‑function scanners. It explicitly excludes measurements for scan-to-USB or local hard-drive targets and is not intended for image‑quality assessment or document management.

Key topics and technical requirements

• Measured outcomes: scanning speed, scEFTP (scanner effective throughput, expressed in images per minute - ipm), scan-to-network-folder and scan‑to‑PC speeds.
• Test conditions: device setup, connection, environmental and electrical conditions, sample size, maintenance and preparation of test targets (test charts).
• Test procedures: structured tests such as the “1 set” test and “1 set + 30 seconds” test (including a first-page ejection result), plus ADF productivity measurement, scan-to‑folder/PC measurements and feature performance tests.
• Consistency & data handling: suggested flow charts, ±5% consistency criteria, methods for estimating set counts, calculations and data treatment.
• Reporting: minimum declarations, summary and full report formats, examples and annexed report templates to ensure repeatable, auditable results.
• Normative references: includes ISO 536 (paper grammage) and ISO 2470-1 (paper reflectance/brightness) to standardize test materials.

Practical applications & users

This standard is intended for:

• Manufacturers: to characterize and publish reproducible productivity metrics for product datasheets.
• Test laboratories: to perform consistent, comparable measurements across devices.
• Procurement teams and purchasers: to evaluate and compare scanning performance for RFPs and buying decisions.
• IT managers / system integrators: to validate device throughput for expected workflows (networked scanning, centralized capture).
• Quality assurance: to verify declared throughput and support service level agreements (SLAs).

Typical uses include comparative benchmarking, pre‑purchase evaluation, performance validation in enterprise deployments and inclusion of measured throughput in product documentation.

Related standards

• ISO/IEC 24734 / ISO/IEC 24735 (printing/copying productivity methods) - complementary measurement family.
• ISO/IEC 25735 referenced in background discussion.
• Normative test-material references: ISO 536 and ISO 2470-1.

Keywords: ISO/IEC 17991:2021, scanning productivity, scEFTP, ADF speed, scan to network folder, scan to PC, scanning speed, test procedure, scanner benchmarking.

Standards Content (Sample)

INTERNATIONAL ISO/IEC
STANDARD 17991
Second edition
2021-01
Information technology — Office
equipment — Method for measuring
scanning productivity of digital
scanning devices
Technologie de l'information — Équipement d'office — Méthode de
mesure de la productivité du scanner des appareils de numérisation
Reference number
©
ISO/IEC 2021
© ISO/IEC 2021
All rights reserved. Unless otherwise specified, or required in the context of its implementation, no part of this publication may
be reproduced or utilized otherwise in any form or by any means, electronic or mechanical, including photocopying, or posting
on the internet or an intranet, without prior written permission. Permission can be requested from either ISO at the address
below or ISO’s member body in the country of the requester.
ISO copyright office
CP 401 • Ch. de Blandonnet 8
CH-1214 Vernier, Geneva
Phone: [phone]
Email: [e-mail]
Website: www.iso.org
Published in Switzerland
ii © ISO/IEC 2021 – All rights reserved

Contents Page
Foreword .v
Introduction .vi
1 Scope . 1
2 Normative references . 1
3 Terms and definitions . 1
4 Test parameters and conditions . 4
4.1 Scanning device setup . . 4
4.2 Scanning device connection. 5
4.3 Scanning device condition . 5
4.4 Sample size . 5
4.5 Maintenance . 5
4.6 Preparation of test targets (test charts) . 5
4.7 Environment . 6
4.8 Voltage . 6
5 Test method . 6
5.1 Overview . 6
5.2 Test measurement procedure . 7
5.2.1 Test setup . 7
5.2.2 “1 set” test from ready. 8
5.2.3 “1 set + 30 seconds” test from ready . 8
5.3 Test method process . 9
5.3.1 Suggested flow chart . 9
5.3.2 ±5 % consistency criteria .10
5.3.3 Estimating the set count .11
5.4 ADF productivity measurement .11
5.5 “Scan to network folder productivity measurement” and “scan to PC file
productivity measurement” .11
5.5.1 Overview .11
5.5.2 Measurement of scEFTP .12
5.6 Feature performance test .12
5.6.1 Overview .12
5.6.2 Features setting conditions .12
5.6.3 Measurement of FSOT and ESAT .12
6 Calculations and treatment of data .13
6.1 Overview .13
6.2 “1 set” test from ready .13
6.3 “1 set + 30 seconds” test ready .14
7 Presentation of results .15
7.1 Sharing testing and reports .15
7.2 Minimum declaration .16
7.3 ADF productivity measurement .16
7.3.1 Overview .16
7.3.2 Summary report .16
7.3.3 Full report .17
7.4 “Scan to network folder productivity measurement” and “Scan to PC file
productivity measurement” .18
7.4.1 Overview .18
7.4.2 Summary report .19
7.4.3 Full report .20
7.5 Feature performance test .21
7.5.1 Overview .21
7.5.2 Summary report .21
© ISO/IEC 2021 – All rights reserved iii

7.5.3 Full report .21
Annex A (informative) Report presentation .23
Annex B (informative) Full detailed report example .27
Annex C (normative) Test targets for measurement of scanning productivity .31
Bibliography .32
iv © ISO/IEC 2021 – All rights reserved

Foreword
ISO (the International Organization for Standardization) and IEC (the International Electrotechnical
Commission) form the specialized system for worldwide standardization. National bodies that
are members of ISO or IEC participate in the development of International Standards through
technical committees established by the respective organization to deal with particular fields of
technical activity. ISO and IEC technical committees collaborate in fields of mutual interest. Other
international organizations, governmental and non-governmental, in liaison with ISO and IEC, also
take part in the work.
The procedures used to develop this document and those intended for its further maintenance are
described in the ISO/IEC Directives, Part 1. In particular, the different approval criteria needed for
the different types of document should be noted. This document was drafted in accordance with the
editorial rules of the ISO/IEC Directives, Part 2 (see www .iso .org/ directives).
Attention is drawn to the possibility that some of the elements of this document may be the subject
of patent rights. ISO and IEC shall not be held responsible for identifying any or all such patent
rights. Details of any patent rights identified during the development of the document will be in the
Introduction and/or on the ISO list of patent declarations received (see www .iso .org/ patents) or the
IEC list of patent declarations received (see https:// patents .iec .c).
Any trade name used in this document is information given for the convenience of users and does not
constitute an endorsement.
For an explanation of the voluntary nature of standards, the meaning of ISO specific terms and
expressions related to conformity assessment, as well as information about ISO's adherence to the
World Trade Organization (WTO) principles in the Technical Barriers to Trade (TBT), see www .iso .org/
iso/ foreword .html.
This document was prepared by Joint Technical Committee ISO/IEC JTC 1, Information technology,
Subcommittee SC 28, Office equipment.
This second edition cancels and replaces the first edition (ISO/IEC 17991:2015), which has been
technically revised.
The main changes compared to the previous edition are as follows:
— changed the document structure to be consistent with other productivity standards;
— added single function scanners to the Scope;
— updated reporting to include examples of minimum declarations;
— added “first page eject” test result to the “1 set” test from ready.
Any feedback or questions on this document should be directed to the user’s national standards body. A
complete listing of these bodies can be found at www .iso .org/ members .html.
© ISO/IEC 2021 – All rights reserved v

Introduction
The actual productivity measurement methods of copying and printing were published as ISO/IEC 24735
and ISO/IEC 24734. However, ISO/IEC 25735 contains no measurement method for the scanning
productivity of multifunctional devices to be used for comparison and procurement of these machines.
This document provides a general method for measuring “scanning productivity” of the scanning
devices. This document also includes a test chart for scanning productivity measurement. It allows
the manufacturers and the buyers of scanning devices to describe the productivity with respect to
representative usage.
vi © ISO/IEC 2021 – All rights reserved

INTERNATIONAL STANDARD ISO/IEC 17991:2021(E)
Information technology — Office equipment — Method for
measuring scanning productivity of digital scanning devices
1 Scope
This document specifies a method for determining scanning productivity by measuring “scanning
speed”, “scan to network folder speed” and “scan to PC speed”. It includes test files, test setup procedure,
test procedure and the reporting requirements for the scanning productivity measurements. This
document is applicable to scanning devices including but not limited to multi-function devices,
networked scanners and single-function scanners of any underlying scanning technology.
This document is applicable to devices which are able to scan a media size of A4/8,5" × 11" and which
have an automatic document feeder (ADF). It is also applicable to devices which have the ability to scan
to network folder, or folder on PC and do not require, but can use, other application programs on a
computer or another device to perform a scanning job.
This document does not apply to testing and measurement of scan to USB, scan to local hard drive or
other storage medium that is part of or plugged into the scanner.
This document is not intended to be used for image quality measurement, document or record
management of any scanned images.
2 Normative references
The following documents are referred to in the text in such a way that some or all of their content
constitutes requirements of this document. For dated references, only the edition cited applies. For
undated references, the latest edition of the referenced document (including any amendments) applies.
ISO 536, Paper and board — Determination of grammage
ISO 2470-1, Paper, board and pulps — Measurement of diffuse blue reflectance factor — Part 1: Indoor
daylight conditions (ISO brightness)
3 Terms and definitions
For the purposes of this document, the following terms and definitions apply.
ISO and IEC maintain terminological databases for use in standardization at the following addresses:
— ISO Online browsing platform: available at https:// www .iso .org/ obp
— IEC Electropedia: available at http:// www .electropedia .org/
3.1
ADF speed
rate at which a device scans documents using an automatic document feeder (ADF) to demonstrate the
productivity of the ADF and is represented with suffix A
EXAMPLE scEFTP is the scanner effective throughput (3.3) of the ADF on the 1set test.
1setA
© ISO/IEC 2021 – All rights reserved 1

3.2
duplex
duplex scanning
use of a scanning device with the scanning being done for both sides of a sheet
Note 1 to entry: An equivalent term is “double sided scanning”.
3.3
scEFTP
effective throughput
rate at which a device scans pages measured from the initiation of the job through the full ejection of
the last page of the scanning sets or through the complete creation of the file on the shared network
folder or PC after the transfer of the last page of the last test set (3.16)
EXAMPLE scEFTP means scanning effective throughput of “1 set test” for “ADF productivity
1setA
measurement”.
Note 1 to entry: “sc” denotes that the measurement is taken on the scanner.
Note 2 to entry: There are suffixes such as “ ”, “ ” or “ ”. Each suffix is used to classify tests such as
1setA 30secF 30secP
“1 set test” or “1 set + 30 second test” of the objects of tests for “ADF productivity measurement” (using suffix A),
“scan to network folder productivity measurement”(using suffix F) or “scan to pc file productivity measurement”
(using suffix P) test respectively.
Note 3 to entry: scEFTP is expressed in images per minute (ipm); it can be affected by scan time, digital processing
time, maintenance and the run time of the test.
Note 4 to entry: A different term (“EFTP; effective throughput” for digital copying machines) is defined in
ISO/IEC 24735.
Note 5 to entry: As for scEFTP , measurement parameters involving the measurement of file transmission
30secF
to a network folder are dependent on other factors like the computer and network configuration and represent
relative values and not absolute values.
Note 6 to entry: As for scEFTP , measurement parameters involving the measurement of file transmission to
30secP
a file are dependent on other factors like the computer, IO connection, IO speed and represent relative values and
not absolute values.
3.4
scESAT
estimated saturated throughput
rate at which a device scans pages measured from full ejection of the last page of the first test set (3.16)
from ADF through the full ejection of the last page of the last test set (using suffix A)
Note 1 to entry: “sc” denotes that the measurement is taken on the scanner.
Note 2 to entry: There are suffixes such as “ ”, “ ” or “ ”. Each suffix is used to classify tests such as
1setA 30secF 30secP
“1 set test” or “1 set + 30 second test” of the objects of tests for “ADF productivity measurement” (using suffix A),
“scan to network folder productivity measurement”(using suffix F) or “scan to pc file productivity measurement”
(using suffix P) test respectively. There is no measurement for “scan to network folder productivity measurement”
or “scan to pc file productivity measurement” of scESAT, scESAT and scESAT defined, therefore
30secF 30secP
scESAT , scESAT , and scESAT are not used as classifications.
1setA 1setF 1setP
Note 3 to entry: scESAT is expressed in images per minute (ipm).
3.5
scFPE
first page eject
number of seconds between the initiation of the job to full ejection of the first page of the first test set
(3.16) from the ADF
2 © ISO/IEC 2021 – All rights reserved

3.6
scFSOT
first set out time
number of seconds between the initiation of the job to full ejection of the last page of the first test set
(3.16) from the ADF
Note 1 to entry: There are suffixes such as “ ”, “ ” or “ ”. Each suffix is used to classify tests such as
1setA 30secF 30secP
“1 set test” or “1 set + 30 second test” of the objects of tests for “ADF productivity measurement” (using suffix A),
“scan to network folder productivity measurement”(using suffix F) or “scan to pc file productivity measurement”
(using suffix P) test respectively .
3.7
full detailed report
presentation of information including machine setup, summary and full measured test results
Note 1 to entry: An example of the full detailed report is shown in Annex B.
3.8
full report
presentation of results including the scFSOT (3.6), scESAT (3.4), and scEFTP (3.3) values in the
performance test (3.10) as well as the calculated averages for each value
3.9
network folder speed
rate at which a device scans and stores the scanned image file in the network folder to demonstrate the
overall productivity of the device when scanning documents
EXAMPLE A suffix such as " " means a test of "1 set + 30 second" test for "scan to network folder
30secF
productivity".
Note 1 to entry: Suffix " " means "scan to network folder productivity measurement".
F
3.10
performance test
test used to evaluate productivity by providing scFSOT (3.6), scESAT (3.4), and scEFTP (3.3) without
using any special feature or mode, and includes both the simplex scanning (3.12) mode and the duplex
scanning (3.2) mode if available
3.11
scLSOT
scLSOT
Nsets
scanning last set out time
number of seconds between the initiation of the job to full ejection of the last page of the last test set
(3.16) from ADF
Note 1 to entry: There are suffixes such as “ ”, “ ” or “ ”. Each suffix is used to classify tests such as
1setA 30secF 30secP
“1 set test” or “1 set + 30 second test” of the objects of tests for “ADF productivity measurement” (using suffix A),
“scan to network folder productivity measurement”(using suffix F) or “scan to pc file productivity measurement”
(using suffix P) test respectively.
3.12
simplex
simplex scanning
use of a scanning device when only a single side of a sheet is scanned
Note 1 to entry: An equivalent term is “single sided scanning”.
3.13
summary report
presentation of results including the average overall scEFTP (3.3) in the performance test (3.10) for the
scanning device default base line performance
© ISO/IEC 2021 – All rights reserved 3

3.14
test file
digital file used for creating test targets (3.17)
3.15
test run
operation of scanning all pages of targets from a test file (3.14), in a particular system configuration,
with a particular set and page count
Note 1 to entry: Scan times are recorded for each test run.
3.16
test set
all of the pages of targets from a test file (3.14)
3.17
test target
hardcopy document used for testing per the test method, and created from test file (3.14)
Note 1 to entry: An equivalent term is “test chart”.
3.18
time measurement
number of seconds measured by a timing device (stopwatch or other device) or by reading time display
on the PC clock
EXAMPLE "t " is the time measured via stopwatch or other device for completion of the first set out and
sw1A
"t " is the time measured via PC clock for completion of the first set file written to the network folder or PC file.
pc1F
Note 1 to entry: Suffixes such as " " and " " are used to show which time measurement is done; by timing
SW PC
device (stopwatch or other device) or by reading time display on the PC clock.
4 Test parameters and conditions
4.1 Scanning device setup
Place the scanning device on a horizontal surface and set up the scanning device according to the
manufacturer's recommendations.
The scanning device shall be fully enclosed in its normal exterior cover. The machine shall be acclimated
in the test environment prior to conducting the test(s) at least 8 h. All images and scanning modes should
be at their factory preset configuration for the scanning device. It is assumed that the settings listed in
Table 1 are common to all scanning devices. These listed settings shall be set to the manufacturer's
default or preset condition for the device. If a device has settings not listed in Table 1, they too shall
be set to default settings. All settings shall be explicitly stated in either case of default or non-default
settings. For scanning devices that have additional scan quality and digital image processing features,
those features shall be set to match their normal default condition and included in the result reporting.
Disabling manufacturer default installed features, routines or applications, is not allowed. As listed in
Table 1 the preset values in the test shall be noted in the full detailed report (see Annex B).
If the scanning device is setup with internal or external options such as memory as default, then these
options shall be noted on the full detailed report format in the configuration options as shown in
Annex B.
EXAMPLE Examples of configurations options to be captured:
— 160GB HDD installed.
Additional tests may be conducted using other non-default settings for the scanning device. The results
of such additional tests shall be documented as having parameters that differ from the factory defaults
and shown in comparison to the default system parameter results.
4 © ISO/IEC 2021 – All rights reserved

Optional paper sizes may be used for the scanning device tests such as A3 and/or 11"×17" size as
appropriate for the test mode. When sheets of paper size other than A4/8,5" ×11" are used, the sizes
shall be indicated in the places of A4/8,5"×11" in the measurement results tables.
When a comparison must be made between the productivity of one machine with that of other machines
the measurement shall be done with the same paper sizes.
Table 1 — Pre-set settings
Pre-set item Preset
value
Scanning resolution default (200 dpi)
Colour or gray scale/B&W default (colour)
Duplex/simplex default (simplex)
Original page size default (A4)
Mode
Paper feed orientation (long/short edge) default (long edge)
Scan destination default (shared network)
Storing file type default (pdf-multi)
Auto scan quality adjustment default (factory preset default setting)
4.2 Scanning device connection
There are three types of possible connections to the scanning device:
— network connection (such as Ethernet);
— wireless connection (such as Wi-Fi);
— direct connection (such as USB).
Connection to the test platform should be determined by the manufacturer’s recommended connection.
The connection type, version, and all settings that differ from the system or scanning device defaults
shall be recorded and reported.
4.3 Scanning device condition
If available, the number of pages scanned on the device prior to the start of the test shall be recorded
and reported. The machine shall be acclimated in the test environment prior to conducting the test(s)
at least 8 h. Performance may be impacted by the amount of life used as represented by page count.
Acclimation may affect the calibration of the device which in turn could impact performance.
4.4 Sample size
Each target shall be tested and measured at least twice for repeatability. All required tests shall be run
using one device.
4.5 Maintenance
Scanning device maintenance shall be performed throughout testing per the manufacturer's
recommendations.
4.6 Preparation of test targets (test charts)
Follow the outline of the scanning test file in Annex C.
This test file is from ISO/IEC 24735. The test file consists of four single sided pages. When using the
test file for the scanning productivity test, the test targets shall be created by printing the most recent
© ISO/IEC 2021 – All rights reserved 5

electronic test file on the device to be tested if it has print capability. If the test device to be tested does
not have a printer function or if the device is a colour capable scanner but does not have a printing
function of colour test targets (for the colour scanning test), then record the name of printer which is
used to print out the actual test targets.
For preparation method for double sided targets, follow the outline in Annex C.
The quality of test targets may affect the productivity measurement. Test targets should be created
according to the following instructions.
a) The test targets shall be printed by the equipment to be tested itself in its default-printing mode.
If the equipment to be tested does not have a print function or if the equipment to be tested does
not have a colour print function and colour test targets are required, then record the name of the
printer used to print out the actual test targets.
b) The paper used for creating the test targets shall have a brightness of at least 80 % to eliminate the
influence of background.
c) The paper used for creating the test targets shall be 64 g/m or above and sufficiently opaque to
prevent scanning of images on the backside.
d) The paper used for creating the test targets shall be free of wrinkles or other surface defects.
e) Confirm that there are no defects such as unexpected dots or contamination.
f) Page scaling shall not be used in performance test. Typically, this is done by setting page scaling to
"none". Options such as "Fit to printable area" shall not be used in performance testing, either.
g) Paper shall conform to the scanning device manufacturer’s paper specifications.
The brightness shall be measured according to ISO 2470-1. The paper grammage shall be measured
according to ISO 536.
4.7 Environment
The test environment, including temperature and humidity, shall be within the ranges recommended
by the manufacturer for operating the device. If no recommendation is available, the following ranges
shall apply:
— temperature: 18 °C to 25 °C,
— relative humidity: 30 % to 70 %.
The temperature and humidity ranges of the test environment shall be recorded in the full detailed report.
4.8 Voltage
The scanning device shall be connected to a voltage supply within the manufacturer specified operating
voltage range for the scanning device under test. The voltage should be measured under no-load
condition prior to each test suite and recorded in the full detailed report.
NOTE It is possible that devices that utilize a heater have a longer scFSOT time when the line voltage is at the
lower value of the recommended operating range.
5 Test method
5.1 Overview
The productivity of a digital scanning device like “scan to network folder speed” depends on factors
other than the scanning device itself. These include, but are not limited to, computer performance and
6 © ISO/IEC 2021 – All rights reserved

network configuration or the general environment in which the test is being held. Because of this, in
order to make useful and accurate direct comparisons of scanning productivity with this document, the
same computer system hardware and software, and network configuration shall be used for measuring
the scanning devices for the purpose of being directly compared one to another. For every scanning
productivity measurement, the basic specifications of the computer and the network shall be included
with the results of the scanning productivity measurement.
This clause defines the procedure on how to measure “ADF productivity measurement”, “scan to network
folder productivity measurement” and how to measure “scan to PC file productivity measurement”.
The intent of “ADF productivity measurement” test is to demonstrate the productivity of the ADF that
may be achieved with the specific settings. ADF speed is a component of scanning productivity.
The intent of “scan to network folder productivity measurement” test is to demonstrate the overall
productivity of the device in scanning documents. This test is a representative of a variety of scanning
tasks (e.g. scan to file server, scan to fax server, scan to email, scan to workflow, etc.).
A single set of each test target is scanned and measured to determine scEFTP . Multiple N sets of
1set
test target are scanned and measured for the 1 set + 30 seconds test run to calculate scESAT and
30sec
scEFTP , where N is the number of sets needed to meet scLSOT − scFSOT more than 30 s. (To
30sec Nsets 1set
estimate N, number of sets for test target, refer to 5.3.3.)
This method is used to provide varying tests for products across varying segments. This simple
approach allows faster products to be tested with more sets and slower products to be tested with
fewer sets without defining and categorizing products by segment.
“Scan to PC file productivity measurement” utilizes PC scanning software and is measured separately
from the “scan to network folder productivity measurement”. Both can be paired with “ADF productivity
measurement” to complete measurement in the same test run.
5.2 Test measurement procedure
5.2.1 Test setup
Before testing, the following setup activities shall be completed.
a) Install the scanning device following the manufacturer's recommendations.
b) Clean the surface of the image scanning device if needed.
c) Set the system parameters (such as paper size and feed orientation, image quality mode) for the
test. Record the scanning device model, configuration (options), default condition and any other
variations if selected.
d) Estimate the number of sets (= N sets) which is required to meet scLSOT − scFSOT ≥ 30 s.
Nsets 1set
(1 set consists of 4 originals.) (To estimate N, number of sets for test targets, refer to 5.3.3.)
e) Prepare N sets of test targets that will be used in the test, identified as described in 4.6.
f) Refer to 5.4 and 5.5 to decide what tests are to be run.
g) Connect the device and PC via an appropriate network connection or direct connection and create
the destination folder. The network and PC setup shall be documented, including any settings of the
configuration parameters that are different from the normal default.
h) Show a date/time tool on the PC.
i) The scan button used to start a scanning job may be a button on the device, a virtual button in
an embedded webserver, a virtual button in PC scanning software or similar user interface if the
virtual button initiates a scan in a similar way as the button on the device would.
© ISO/IEC 2021 – All rights reserved 7

Refer to Annex B for an example of settings to record. Refer to 5.4 and 5.5 for information on required
tests. Refer to Clause 6 for information on the calculation and treatment of data. Refer to Clause 7 for
information on data reporting.
The created file in the network folder or PC folder shall be a single file of multiple pages.
5.2.2 “1 set” test from ready
a) Put 1 set of test targets on ADF. (For the second and third tests, use 1 set.)
b) [Start test run] Initiate the scan and simultaneously start the timing device (stopwatch or
otherwise) and record the time “t ” to the minutes and seconds displayed on the PC clock of the
PC0
system where the target network folder or PC file folder exists. Record if scanning is initiated from
the device control panel or a software button.
c) Optionally record the time “t ” for completion of the first page ejected. This is the time from
FPE1A
pressing the scan button until the first page of the first test set is fully ejected from the ADF.
d) Record the time “t ” for completion of the first set out. This is the time from pressing the scan
SW1A
button until the fourth page of the first test set is fully ejected from the ADF.
e) After the time the file is completely written to the network folder or PC file folder, check the time
stamp of the file and record the time “t ” to the minutes and seconds.
PC1F
f) Calculate scFPE , scEFTP and scEFTP for each test run according to Clause 6.
1setA 1setA 1setF
g) Record scEFTP and scEFTP and optionally record scFPE .
1setA 1setF 1setA
h) [End test run]
i) Run this test steps a) – h) twice.
j) Determine if the results scEFTP , scEFTP , and scFPE are consistent within ±5 % and
1setA 1setF 1setA
refer to 5.3.2.
k) If needed, conduct a third test run. (If the first two test runs are not consistent within ±5 %, then a
third test run is required. The data from the test is average of the individual runs. Three iterations
are the max and the results from all iterations are averaged to get the required data.)
NOTE 1 Synchronization to an external clock or stopwatch with the PC clock is optional to record t .
SW1A
NOTE 2 “t ” is a starting time displayed on the PC clock and not necessarily 0(zero). On the other hand, a
PC0
hand timing device starts from 0(zero).
5.2.3 “1 set + 30 seconds” test from ready
a) Put N sets of test target on ADF. N is required to for scLSOT − scFSOT ≥ 30 s. (For the second
Nsets 1set
and third tests, use the same number of sets as used in the first test.)
b) [Start test run] Initiate the scan and simultaneously start the timing device (stopwatch or
otherwise) and record the time “t ” to the minutes and seconds displayed on the PC of the system
PC0
where the target network folder or PC file folder exists. Record if scanning is initiated from the
device control panel or a software button.
c) Record the time “t ” for completion of the first set out. This is the time from pressing scan
SW1A
button until the 4th page of the 1st test set is fully ejected from the ADF.
d) Record the time “t ” for completion of the LSOT . This is the time from pressing scan button
SWNA Nsets
until the last page of the N test set is fully ejected from the ADF.
If the original output tray capacity is less than the number of pages to be scanned, remove the
output originals during the test.
8 © ISO/IEC 2021 – All rights reserved

e) Once determined that the file is completely written to the network folder or PC file folder, check the
time stamp of the file and record the time “t ” to the minutes and seconds.
PCNF
f) Calculate scESAT , scEFTP and scEFTP for each test run according to Clause 6.
30secA 30secA 30secF
g) Record scESAT scEFTP and scEFTP .
30secA, 30secA 30secF
h) [End test run]
i) Run this test steps a) – h) twice.
j) Determine if the results are consistent within ±5 % and refer to 5.3.2.
k) If needed, conduct a third test run. If the first two test runs are not consistent within ±5 %, then a
third test run is required. The data from the test is average of the individual runs. Three iterations
are the maximum and the results from all iterations are averaged to get the required data.
NOTE 1 Synchronization to an external clock or stopwatch with the PC clock is optional to record t
SWNA
and t .
SW1A
NOTE 2 “t ” is a starting time displayed on the PC clock and not necessarily 0 (zero). On the other hand, a
PC0
hand timing device starts from 0 (zero).
5.3 Test method process
5.3.1 Suggested flow chart
a) Top part of the 1 set test flow chart
© ISO/IEC 2021 – All rights reserved 9

b) Bottom part of the 1 set test flow chart
Figure 1 — 1 set test flow chart
5.3.2 ±5 % consistency criteria
If the first two test runs are not consistent within ±5 %, then a third test run is required. Formulae for
scESAT and scEFTP can be found in Clause 6.
2×s
FSOT,1
c= −1
ss+
FSOT,1 FSOT,2
2×s
ESAT,1
c= −1
ss+
ESAT,1 ESAT,2
×s
EFTP,1
c= −1
ss+
EFTP,,12EFTP
where
c is the consistency;
st
s is the scanner FSOT from the 1 test (scFSOT );
FSOT,1 1
nd
s is the scanner FSOT from the 2 test (scFSOT );
FSOT,2 2
st
s is the scanner ESAT from the 1 test (scESAT );
ESAT,1 1
nd
s is the scanner ESAT from the 2 test (scESAT );
ESAT,2 2
st
s is the scanner EFTP from the 1 test (scEFTP );
EFTP,1 1
nd
s , is the scanner EFTP from the 2 test (scEFTP ).
EFTP 2 2
10 © ISO/IEC 2021 – All rights reserved

5.3.3 Estimating the set count
5.3.3.1 Overview
This estimation shall be done when multiple test sets for 1 set + 30 seconds are scanned.
5.3.3.2 ‘1 set + 30 seconds test’
The test may begin with an initial set count N = 2 or by estimating the number of sets needed,
sets
provided that the tester has sufficient information for estimation beforehand. If the N = 2 test
sets
result did not meet the scLSOT − scFSOT ≥ 30 s requirement, then calculate necessary set count
Nsets 1set
N as follows and test using the new N as the set count. The following formula can be used
est,30sec est,30sec
to estimate the number of sets needed:
 30×−N 1 
()
sets
N =RoundUp +1
 
est,30sec
ss−
 
LSOT,sN etsFSOT,1set
 
where
N estimated number of total sets to scan;
est,30sec
st
N is the estimated number of sets needed to scan for 30 s after the 1 test;
sets
s is the scanner LSOT from the last set (scLSOT );
LSOT,Nsets Nsets
st
s is the scanner FSOT from the 1 set (scFSOT ).
FSOT,1set 1set
The number of sets tested should result in scLSOT − scFSOT ≥ 30 s as close as possible. If the
Nsets 1set
results of a test run gives scLSOT − scFSOT < 30 s the number of sets shall be increased and all
Nsets 1set
runs re-tested.
If the 1 set + 30 seconds test estimated scan count is greater than the maximum scan count or ADF
allowable capacity, this test shall not be run and shall be reported as NA in the test report.
5.4 ADF productivity measurement
The tests require using the 1 set test and 1 set + 30 seconds test procedures in 5.2.
There is one key parameter, scESAT, reported in the summary report and in the full report. The "full
report" provides detailed information including scEFTP.
If the machine is a colour scanning device, testing in single sided colour mode using default scanning
settings is required, double sided colour mode scanning is optional; testing in monochrome single
sided and double scanning mode is optional. If the machine is a B&W only scanning device, testing in
monochrome single sided scanning is required and monochrome double sided is optional.
Prepare the test targets (described in 4.6) for this measurement. 1 set consists of 4 images, which are
4 simplex pages for simplex and two duplex pages for duplex.
The time measurement is started when the “scan start button” is pressed and is concluded when the
last page is fully ejected from the ADF. The measured intervals of time should be recorded.
5.5 “Scan to network folder productivity measurement” and “scan to PC file
productivity measurement”
5.5.1 Overview
“Scan to network folder productivity measurement” is required if “scan to network folder” is a
supported feature. The tests require using the 1 set test and 1 set + 30 seconds test procedures in 5.2.
© ISO/IEC 2021 – All rights reserved 11

If “scan to network folder” is not a supported feature, then “scan to PC file productivity” is required.
If both “scan to network folder” and “scan to PC file productivity” are supported, then “scan to network
folder pr
...