ISO/IEC 17991:2021
(Main)Information technology — Office equipment — Method for measuring scanning productivity of digital scanning devices
Information technology — Office equipment — Method for measuring scanning productivity of digital scanning devices
This document specifies a method for determining scanning productivity by measuring "scanning speed", "scan to network folder speed" and "scan to PC speed". It includes test files, test setup procedure, test procedure and the reporting requirements for the scanning productivity measurements. This document is applicable to scanning devices including but not limited to multi-function devices, networked scanners and single-function scanners of any underlying scanning technology. This document is applicable to devices which are able to scan a media size of A4/8,5" × 11" and which have an automatic document feeder (ADF). It is also applicable to devices which have the ability to scan to network folder, or folder on PC and do not require, but can use, other application programs on a computer or another device to perform a scanning job. This document does not apply to testing and measurement of scan to USB, scan to local hard drive or other storage medium that is part of or plugged into the scanner. This document is not intended to be used for image quality measurement, document or record management of any scanned images.
Technologie de l'information — Équipement d'office — Méthode de mesure de la productivité du scanner des appareils de numérisation
General Information
Relations
Buy Standard
Standards Content (Sample)
INTERNATIONAL ISO/IEC
STANDARD 17991
Second edition
2021-01
Information technology — Office
equipment — Method for measuring
scanning productivity of digital
scanning devices
Technologie de l'information — Équipement d'office — Méthode de
mesure de la productivité du scanner des appareils de numérisation
Reference number
ISO/IEC 17991:2021(E)
©
ISO/IEC 2021
---------------------- Page: 1 ----------------------
ISO/IEC 17991:2021(E)
COPYRIGHT PROTECTED DOCUMENT
© ISO/IEC 2021
All rights reserved. Unless otherwise specified, or required in the context of its implementation, no part of this publication may
be reproduced or utilized otherwise in any form or by any means, electronic or mechanical, including photocopying, or posting
on the internet or an intranet, without prior written permission. Permission can be requested from either ISO at the address
below or ISO’s member body in the country of the requester.
ISO copyright office
CP 401 • Ch. de Blandonnet 8
CH-1214 Vernier, Geneva
Phone: +41 22 749 01 11
Email: copyright@iso.org
Website: www.iso.org
Published in Switzerland
ii © ISO/IEC 2021 – All rights reserved
---------------------- Page: 2 ----------------------
ISO/IEC 17991:2021(E)
Contents Page
Foreword .v
Introduction .vi
1 Scope . 1
2 Normative references . 1
3 Terms and definitions . 1
4 Test parameters and conditions . 4
4.1 Scanning device setup . . 4
4.2 Scanning device connection. 5
4.3 Scanning device condition . 5
4.4 Sample size . 5
4.5 Maintenance . 5
4.6 Preparation of test targets (test charts) . 5
4.7 Environment . 6
4.8 Voltage . 6
5 Test method . 6
5.1 Overview . 6
5.2 Test measurement procedure . 7
5.2.1 Test setup . 7
5.2.2 “1 set” test from ready. 8
5.2.3 “1 set + 30 seconds” test from ready . 8
5.3 Test method process . 9
5.3.1 Suggested flow chart . 9
5.3.2 ±5 % consistency criteria .10
5.3.3 Estimating the set count .11
5.4 ADF productivity measurement .11
5.5 “Scan to network folder productivity measurement” and “scan to PC file
productivity measurement” .11
5.5.1 Overview .11
5.5.2 Measurement of scEFTP .12
5.6 Feature performance test .12
5.6.1 Overview .12
5.6.2 Features setting conditions .12
5.6.3 Measurement of FSOT and ESAT .12
6 Calculations and treatment of data .13
6.1 Overview .13
6.2 “1 set” test from ready .13
6.3 “1 set + 30 seconds” test ready .14
7 Presentation of results .15
7.1 Sharing testing and reports .15
7.2 Minimum declaration .16
7.3 ADF productivity measurement .16
7.3.1 Overview .16
7.3.2 Summary report .16
7.3.3 Full report .17
7.4 “Scan to network folder productivity measurement” and “Scan to PC file
productivity measurement” .18
7.4.1 Overview .18
7.4.2 Summary report .19
7.4.3 Full report .20
7.5 Feature performance test .21
7.5.1 Overview .21
7.5.2 Summary report .21
© ISO/IEC 2021 – All rights reserved iii
---------------------- Page: 3 ----------------------
ISO/IEC 17991:2021(E)
7.5.3 Full report .21
Annex A (informative) Report presentation .23
Annex B (informative) Full detailed report example .27
Annex C (normative) Test targets for measurement of scanning productivity .31
Bibliography .32
iv © ISO/IEC 2021 – All rights reserved
---------------------- Page: 4 ----------------------
ISO/IEC 17991:2021(E)
Foreword
ISO (the International Organization for Standardization) and IEC (the International Electrotechnical
Commission) form the specialized system for worldwide standardization. National bodies that
are members of ISO or IEC participate in the development of International Standards through
technical committees established by the respective organization to deal with particular fields of
technical activity. ISO and IEC technical committees collaborate in fields of mutual interest. Other
international organizations, governmental and non-governmental, in liaison with ISO and IEC, also
take part in the work.
The procedures used to develop this document and those intended for its further maintenance are
described in the ISO/IEC Directives, Part 1. In particular, the different approval criteria needed for
the different types of document should be noted. This document was drafted in accordance with the
editorial rules of the ISO/IEC Directives, Part 2 (see www .iso .org/ directives).
Attention is drawn to the possibility that some of the elements of this document may be the subject
of patent rights. ISO and IEC shall not be held responsible for identifying any or all such patent
rights. Details of any patent rights identified during the development of the document will be in the
Introduction and/or on the ISO list of patent declarations received (see www .iso .org/ patents) or the
IEC list of patent declarations received (see https:// patents .iec .c).
Any trade name used in this document is information given for the convenience of users and does not
constitute an endorsement.
For an explanation of the voluntary nature of standards, the meaning of ISO specific terms and
expressions related to conformity assessment, as well as information about ISO's adherence to the
World Trade Organization (WTO) principles in the Technical Barriers to Trade (TBT), see www .iso .org/
iso/ foreword .html.
This document was prepared by Joint Technical Committee ISO/IEC JTC 1, Information technology,
Subcommittee SC 28, Office equipment.
This second edition cancels and replaces the first edition (ISO/IEC 17991:2015), which has been
technically revised.
The main changes compared to the previous edition are as follows:
— changed the document structure to be consistent with other productivity standards;
— added single function scanners to the Scope;
— updated reporting to include examples of minimum declarations;
— added “first page eject” test result to the “1 set” test from ready.
Any feedback or questions on this document should be directed to the user’s national standards body. A
complete listing of these bodies can be found at www .iso .org/ members .html.
© ISO/IEC 2021 – All rights reserved v
---------------------- Page: 5 ----------------------
ISO/IEC 17991:2021(E)
Introduction
The actual productivity measurement methods of copying and printing were published as ISO/IEC 24735
and ISO/IEC 24734. However, ISO/IEC 25735 contains no measurement method for the scanning
productivity of multifunctional devices to be used for comparison and procurement of these machines.
This document provides a general method for measuring “scanning productivity” of the scanning
devices. This document also includes a test chart for scanning productivity measurement. It allows
the manufacturers and the buyers of scanning devices to describe the productivity with respect to
representative usage.
vi © ISO/IEC 2021 – All rights reserved
---------------------- Page: 6 ----------------------
INTERNATIONAL STANDARD ISO/IEC 17991:2021(E)
Information technology — Office equipment — Method for
measuring scanning productivity of digital scanning devices
1 Scope
This document specifies a method for determining scanning productivity by measuring “scanning
speed”, “scan to network folder speed” and “scan to PC speed”. It includes test files, test setup procedure,
test procedure and the reporting requirements for the scanning productivity measurements. This
document is applicable to scanning devices including but not limited to multi-function devices,
networked scanners and single-function scanners of any underlying scanning technology.
This document is applicable to devices which are able to scan a media size of A4/8,5" × 11" and which
have an automatic document feeder (ADF). It is also applicable to devices which have the ability to scan
to network folder, or folder on PC and do not require, but can use, other application programs on a
computer or another device to perform a scanning job.
This document does not apply to testing and measurement of scan to USB, scan to local hard drive or
other storage medium that is part of or plugged into the scanner.
This document is not intended to be used for image quality measurement, document or record
management of any scanned images.
2 Normative references
The following documents are referred to in the text in such a way that some or all of their content
constitutes requirements of this document. For dated references, only the edition cited applies. For
undated references, the latest edition of the referenced document (including any amendments) applies.
ISO 536, Paper and board — Determination of grammage
ISO 2470-1, Paper, board and pulps — Measurement of diffuse blue reflectance factor — Part 1: Indoor
daylight conditions (ISO brightness)
3 Terms and definitions
For the purposes of this document, the following terms and definitions apply.
ISO and IEC maintain terminological databases for use in standardization at the following addresses:
— ISO Online browsing platform: available at https:// www .iso .org/ obp
— IEC Electropedia: available at http:// www .electropedia .org/
3.1
ADF speed
rate at which a device scans documents using an automatic document feeder (ADF) to demonstrate the
productivity of the ADF and is represented with suffix A
EXAMPLE scEFTP is the scanner effective throughput (3.3) of the ADF on the 1set test.
1setA
© ISO/IEC 2021 – All rights reserved 1
---------------------- Page: 7 ----------------------
ISO/IEC 17991:2021(E)
3.2
duplex
duplex scanning
use of a scanning device with the scanning being done for both sides of a sheet
Note 1 to entry: An equivalent term is “double sided scanning”.
3.3
scEFTP
effective throughput
rate at which a device scans pages measured from the initiation of the job through the full ejection of
the last page of the scanning sets or through the complete creation of the file on the shared network
folder or PC after the transfer of the last page of the last test set (3.16)
EXAMPLE scEFTP means scanning effective throughput of “1 set test” for “ADF productivity
1setA
measurement”.
Note 1 to entry: “sc” denotes that the measurement is taken on the scanner.
Note 2 to entry: There are suffixes such as “ ”, “ ” or “ ”. Each suffix is used to classify tests such as
1setA 30secF 30secP
“1 set test” or “1 set + 30 second test” of the objects of tests for “ADF productivity measurement” (using suffix A),
“scan to network folder productivity measurement”(using suffix F) or “scan to pc file productivity measurement”
(using suffix P) test respectively.
Note 3 to entry: scEFTP is expressed in images per minute (ipm); it can be affected by scan time, digital processing
time, maintenance and the run time of the test.
Note 4 to entry: A different term (“EFTP; effective throughput” for digital copying machines) is defined in
ISO/IEC 24735.
Note 5 to entry: As for scEFTP , measurement parameters involving the measurement of file transmission
30secF
to a network folder are dependent on other factors like the computer and network configuration and represent
relative values and not absolute values.
Note 6 to entry: As for scEFTP , measurement parameters involving the measurement of file transmission to
30secP
a file are dependent on other factors like the computer, IO connection, IO speed and represent relative values and
not absolute values.
3.4
scESAT
estimated saturated throughput
rate at which a device scans pages measured from full ejection of the last page of the first test set (3.16)
from ADF through the full ejection of the last page of the last test set (using suffix A)
Note 1 to entry: “sc” denotes that the measurement is taken on the scanner.
Note 2 to entry: There are suffixes such as “ ”, “ ” or “ ”. Each suffix is used to classify tests such as
1setA 30secF 30secP
“1 set test” or “1 set + 30 second test” of the objects of tests for “ADF productivity measurement” (using suffix A),
“scan to network folder productivity measurement”(using suffix F) or “scan to pc file productivity measurement”
(using suffix P) test respectively. There is no measurement for “scan to network folder productivity measurement”
or “scan to pc file productivity measurement” of scESAT, scESAT and scESAT defined, therefore
30secF 30secP
scESAT , scESAT , and scESAT are not used as classifications.
1setA 1setF 1setP
Note 3 to entry: scESAT is expressed in images per minute (ipm).
3.5
scFPE
first page eject
number of seconds between the initiation of the job to full ejection of the first page of the first test set
(3.16) from the ADF
2 © ISO/IEC 2021 – All rights reserved
---------------------- Page: 8 ----------------------
ISO/IEC 17991:2021(E)
3.6
scFSOT
first set out time
number of seconds between the initiation of the job to full ejection of the last page of the first test set
(3.16) from the ADF
Note 1 to entry: There are suffixes such as “ ”, “ ” or “ ”. Each suffix is used to classify tests such as
1setA 30secF 30secP
“1 set test” or “1 set + 30 second test” of the objects of tests for “ADF productivity measurement” (using suffix A),
“scan to network folder productivity measurement”(using suffix F) or “scan to pc file productivity measurement”
(using suffix P) test respectively .
3.7
full detailed report
presentation of information including machine setup, summary and full measured test results
Note 1 to entry: An example of the full detailed report is shown in Annex B.
3.8
full report
presentation of results including the scFSOT (3.6), scESAT (3.4), and scEFTP (3.3) values in the
performance test (3.10) as well as the calculated averages for each value
3.9
network folder speed
rate at which a device scans and stores the scanned image file in the network folder to demonstrate the
overall productivity of the device when scanning documents
EXAMPLE A suffix such as " " means a test of "1 set + 30 second" test for "scan to network folder
30secF
productivity".
Note 1 to entry: Suffix " " means "scan to network folder productivity measurement".
F
3.10
performance test
test used to evaluate productivity by providing scFSOT (3.6), scESAT (3.4), and scEFTP (3.3) without
using any special feature or mode, and includes both the simplex scanning (3.12) mode and the duplex
scanning (3.2) mode if available
3.11
scLSOT
scLSOT
Nsets
scanning last set out time
number of seconds between the initiation of the job to full ejection of the last page of the last test set
(3.16) from ADF
Note 1 to entry: There are suffixes such as “ ”, “ ” or “ ”. Each suffix is used to classify tests such as
1setA 30secF 30secP
“1 set test” or “1 set + 30 second test” of the objects of tests for “ADF productivity measurement” (using suffix A),
“scan to network folder productivity measurement”(using suffix F) or “scan to pc file productivity measurement”
(using suffix P) test respectively.
3.12
simplex
simplex scanning
use of a scanning device when only a single side of a sheet is scanned
Note 1 to entry: An equivalent term is “single sided scanning”.
3.13
summary report
presentation of results including the average overall scEFTP (3.3) in the performance test (3.10) for the
scanning device default base line performance
© ISO/IEC 2021 – All rights reserved 3
---------------------- Page: 9 ----------------------
ISO/IEC 17991:2021(E)
3.14
test file
digital file used for creating test targets (3.17)
3.15
test run
operation of scanning all pages of targets from a test file (3.14), in a particular system configuration,
with a particular set and page count
Note 1 to entry: Scan times are recorded for each test run.
3.16
test set
all of the pages of targets from a test file (3.14)
3.17
test target
hardcopy document used for testing per the test method, and created from test file (3.14)
Note 1 to entry: An equivalent term is “test chart”.
3.18
time measurement
number of seconds measured by a timing device (stopwatch or other device) or by reading time display
on the PC clock
EXAMPLE "t " is the time measured via stopwatch or other device for completion of the first set out and
sw1A
"t " is the time measured via PC clock for completion of the first set file written to the network folder or PC file.
pc1F
Note 1 to entry: Suffixes such as " " and " " are used to show which time measurement is done; by timing
SW PC
device (stopwatch or other device) or by reading time display on the PC clock.
4 Test parameters and conditions
4.1 Scanning device setup
Place the scanning device on a horizontal surface and set up the scanning device according to the
manufacturer's recommendations.
The scanning device shall be fully enclosed in its normal exterior cover. The machine shall be acclimated
in the test environment prior to conducting the test(s) at least 8 h. All images and scanning modes should
be at their factory preset configuration for the scanning device. It is assumed that the settings listed in
Table 1 are common to all scanning devices. These listed settings shall be set to the manufacturer's
default or preset condition for the device. If a device has settings not listed in Table 1, they too shall
be set to default settings. All settings shall be explicitly stated in either case of default or non-default
settings. For scanning devices that have additional scan quality and digital image processing features,
those features shall be set to match their normal default condition and included in the result reporting.
Disabling manufacturer default installed features, routines or applications, is not allowed. As listed in
Table 1 the preset values in the test shall be noted in the full detailed report (see Annex B).
If the scanning device is setup with internal or external options such as memory as default, then these
options shall be noted on the full detailed report format in the configuration options as shown in
Annex B.
EXAMPLE Examples of configurations options to be captured:
— 160GB HDD installed.
Additional tests may be conducted using other non-default settings for the scanning device. The results
of such additional tests shall be documented as having parameters that differ from the factory defaults
and shown in comparison to the default system parameter results.
4 © ISO/IEC 2021 – All rights reserved
---------------------- Page: 10 ----------------------
ISO/IEC 17991:2021(E)
Optional paper sizes may be used for the scanning device tests such as A3 and/or 11"×17" size as
appropriate for the test mode. When sheets of paper size other than A4/8,5" ×11" are used, the sizes
shall be indicated in the places of A4/8,5"×11" in the measurement results tables.
When a comparison must be made between the productivity of one machine with that of other machines
the measurement shall be done with the same paper sizes.
Table 1 — Pre-set settings
Pre-set item Preset
value
Scanning resolution default (200 dpi)
Colour or gray scale/B&W default (colour)
Duplex/simplex default (simplex)
Original page size default (A4)
Mode
Paper feed orientation (long/short edge) default (long edge)
Scan destination default (shared network)
Storing file type default (pdf-multi)
Auto scan quality adjustment default (factory preset default setting)
4.2 Scanning device connection
There are three types of possible connections to the scanning device:
— network connection (such as Ethernet);
— wireless connection (such as Wi-Fi);
— direct connection (such as USB).
Connection to the test platform should be determined by the manufacturer’s recommended connection.
The connection type, version, and all settings that differ from the system or scanning device defaults
shall be recorded and reported.
4.3 Scanning device condition
If available, the number of pages scanned on the device prior to the start of the test shall be recorded
and reported. The machine shall be acclimated in the test environment prior to conducting the test(s)
at least 8 h. Performance may be impacted by the amount of life used as represented by page count.
Acclimation may affect the calibration of the device which in turn could impact performance.
4.4 Sample size
Each target shall be tested and measured at least twice for repeatability. All required tests shall be run
using one device.
4.5 Maintenance
Scanning device maintenance shall be performed throughout testing per the manufacturer's
recommendations.
4.6 Preparation of test targets (test charts)
Follow the outline of the scanning test file in Annex C.
This test file is from ISO/IEC 24735. The test file consists of four single sided pages. When using the
test file for the scanning productivity test, the test targets shall be created by printing the most recent
© ISO/IEC 2021 – All rights reserved 5
---------------------- Page: 11 ----------------------
ISO/IEC 17991:2021(E)
electronic test file on the device to be tested if it has print capability. If the test device to be tested does
not have a printer function or if the device is a colour capable scanner but does not have a printing
function of colour test targets (for the colour scanning test), then record the name of printer which is
used to print out the actual test targets.
For preparation method for double sided targets, follow the outline in Annex C.
The quali
...
INTERNATIONAL ISO
STANDARD 17991
Second edition
Information technology — Office
equipment — Method for measuring
scanning productivity of digital
scanning devices
Technologie de l'information — Équipement d'office — Méthode de
mesure de la productivité du scanner des appareils de numérisation
PROOF/ÉPREUVE
Reference number
ISO 17991:2020(E)
©
ISO 2020
---------------------- Page: 1 ----------------------
ISO 17991:2020(E)
COPYRIGHT PROTECTED DOCUMENT
© ISO/IEC 2020
All rights reserved. Unless otherwise specified, or required in the context of its implementation, no part of this publication may
be reproduced or utilized otherwise in any form or by any means, electronic or mechanical, including photocopying, or posting
on the internet or an intranet, without prior written permission. Permission can be requested from either ISO at the address
below or ISO’s member body in the country of the requester.
ISO copyright office
CP 401 • Ch. de Blandonnet 8
CH-1214 Vernier, Geneva
Phone: +41 22 749 01 11
Email: copyright@iso.org
Website: www.iso.org
Published in Switzerland
ii PROOF/ÉPREUVE © ISO/IEC 2020 – All rights reserved
---------------------- Page: 2 ----------------------
ISO 17991:2020(E)
Contents Page
Foreword .v
Introduction .vi
1 Scope . 1
2 Normative references . 1
3 Terms and definitions . 1
4 Test parameters and conditions . 4
4.1 Scanning device setup . . 4
4.2 Scanning device connection. 5
4.3 Scanning device condition . 5
4.4 Sample size . 5
4.5 Maintenance . 5
4.6 Preparation of test targets (test charts) . 5
4.7 Environment . 6
4.8 Voltage . 6
5 Test method . 6
5.1 Overview . 6
5.2 Test measurement procedure . 7
5.2.1 Test setup . 7
5.2.2 “1 set” test from ready. 8
5.2.3 “1 set + 30 seconds” test from ready . 8
5.3 Test method process . 9
5.3.1 Suggested flow chart . 9
5.3.2 ±5 % consistency criteria .10
5.3.3 Estimating the set count .11
5.4 ADF productivity measurement .11
5.5 “Scan to network folder productivity measurement” and “scan to PC file
productivity measurement” .11
5.5.1 Overview .11
5.5.2 Measurement of scEFTP .12
5.6 Feature performance test .12
5.6.1 Overview .12
5.6.2 Features setting conditions .12
5.6.3 Measurement of FSOT and ESAT .12
6 Calculations and treatment of data .13
6.1 Overview .13
6.2 “1 set” test from ready .13
6.3 “1 set + 30 seconds” test ready .14
7 Presentation of results .15
7.1 Sharing testing and reports .15
7.2 Minimum declaration .16
7.3 ADF productivity measurement .16
7.3.1 Overview .16
7.3.2 Summary report .16
7.3.3 Full report .17
7.4 “Scan to network folder productivity measurement” and “Scan to PC file
productivity measurement” .18
7.4.1 Overview .18
7.4.2 Summary report .19
7.4.3 Full report .20
7.5 Feature performance test .21
7.5.1 Overview .21
7.5.2 Summary report .21
© ISO/IEC 2020 – All rights reserved PROOF/ÉPREUVE iii
---------------------- Page: 3 ----------------------
ISO 17991:2020(E)
7.5.3 Full report .21
Annex A (informative) Report presentation .23
Annex B (informative) Full detailed report example .27
Annex C (normative) Test targets for measurement of scanning productivity .31
Bibliography .32
iv PROOF/ÉPREUVE © ISO/IEC 2020 – All rights reserved
---------------------- Page: 4 ----------------------
ISO 17991:2020(E)
Foreword
ISO (the International Organization for Standardization) and IEC (the International Electrotechnical
Commission) form the specialized system for worldwide standardization. National bodies that
are members of ISO or IEC participate in the development of International Standards through
technical committees established by the respective organization to deal with particular fields of
technical activity. ISO and IEC technical committees collaborate in fields of mutual interest. Other
international organizations, governmental and non-governmental, in liaison with ISO and IEC, also
take part in the work.
The procedures used to develop this document and those intended for its further maintenance are
described in the ISO/IEC Directives, Part 1. In particular, the different approval criteria needed for
the different types of document should be noted. This document was drafted in accordance with the
editorial rules of the ISO/IEC Directives, Part 2 (see www .iso .org/ directives).
Attention is drawn to the possibility that some of the elements of this document may be the subject
of patent rights. ISO and IEC shall not be held responsible for identifying any or all such patent
rights. Details of any patent rights identified during the development of the document will be in the
Introduction and/or on the ISO list of patent declarations received (see www .iso .org/ patents) or the
IEC list of patent declarations received (see https:// patents .iec .c).
Any trade name used in this document is information given for the convenience of users and does not
constitute an endorsement.
For an explanation of the voluntary nature of standards, the meaning of ISO specific terms and
expressions related to conformity assessment, as well as information about ISO's adherence to the
World Trade Organization (WTO) principles in the Technical Barriers to Trade (TBT), see www .iso .org/
iso/ foreword .html.
This document was prepared by Joint Technical Committee ISO/IEC JTC 1, Information technology,
Subcommittee SC 28, Office equipment.
This second edition cancels and replaces the first edition (ISO/IEC 17991:2015), which has been
technically revised.
The main changes compared to the previous edition are as follows:
— changed the document structure to be consistent with other productivity standards;
— added single function scanners to the Scope;
— updated reporting to include examples of minimum declarations;
— added “first page eject” test result to the “1 set” test from ready.
Any feedback or questions on this document should be directed to the user’s national standards body. A
complete listing of these bodies can be found at www .iso .org/ members .html.
© ISO/IEC 2020 – All rights reserved PROOF/ÉPREUVE v
---------------------- Page: 5 ----------------------
ISO 17991:2020(E)
Introduction
The actual productivity measurement methods of copying and printing were published as ISO/IEC 24735
and ISO/IEC 24734. However, ISO/IEC 25735 contains no measurement method for the scanning
productivity of multifunctional devices to be used for comparison and procurement of these machines.
This document provides a general method for measuring “scanning productivity” of the scanning
devices. This document also includes a test chart for scanning productivity measurement. It allows
the manufacturers and the buyers of scanning devices to describe the productivity with respect to
representative usage.
vi PROOF/ÉPREUVE © ISO/IEC 2020 – All rights reserved
---------------------- Page: 6 ----------------------
INTERNATIONAL STANDARD ISO 17991:2020(E)
Information technology — Office equipment — Method for
measuring scanning productivity of digital scanning devices
1 Scope
This document specifies a method for determining scanning productivity by measuring “scanning
speed”, “scan to network folder speed” and “scan to PC speed”. It includes test files, test setup procedure,
test procedure and the reporting requirements for the scanning productivity measurements. This
document is applicable to scanning devices including but not limited to multi-function devices,
networked scanners and single-function scanners of any underlying scanning technology.
This document is applicable to devices which are able to scan a media size of A4/8,5" × 11" and which
have an automatic document feeder (ADF). It is also applicable to devices which have the ability to scan
to network folder, or folder on PC and do not require, but can use, other application programs on a
computer or another device to perform a scanning job.
This document does not apply to testing and measurement of scan to USB, scan to local hard drive or
other storage medium that is part of or plugged into the scanner.
This document is not intended to be used for image quality measurement, document or record
management of any scanned images.
2 Normative references
The following documents are referred to in the text in such a way that some or all of their content
constitutes requirements of this document. For dated references, only the edition cited applies. For
undated references, the latest edition of the referenced document (including any amendments) applies.
ISO 536, Paper and board — Determination of grammage
ISO 2470-1, Paper, board and pulps — Measurement of diffuse blue reflectance factor — Part 1: Indoor
daylight conditions (ISO brightness)
3 Terms and definitions
For the purposes of this document, the following terms and definitions apply.
ISO and IEC maintain terminological databases for use in standardization at the following addresses:
— ISO Online browsing platform: available at https:// www .iso .org/ obp
— IEC Electropedia: available at http:// www .electropedia .org/
3.1
ADF speed
rate at which a device scans documents using an automatic document feeder (ADF) to demonstrate the
productivity of the ADF and is represented with suffix A
EXAMPLE scEFTP is the scanner effective throughput (3.3) of the ADF on the 1set test.
1setA
© ISO/IEC 2020 – All rights reserved PROOF/ÉPREUVE 1
---------------------- Page: 7 ----------------------
ISO 17991:2020(E)
3.2
duplex
duplex scanning
use of a scanning device with the scanning being done for both sides of a sheet
Note 1 to entry: An equivalent term is “double sided scanning”.
3.3
scEFTP
effective throughput
rate at which a device scans pages measured from the initiation of the job through the full ejection of
the last page of the scanning sets or through the complete creation of the file on the shared network
folder or PC after the transfer of the last page of the last test set (3.16)
EXAMPLE scEFTP means scanning effective throughput of “1 set test” for “ADF productivity
1setA
measurement”.
Note 1 to entry: “sc” denotes that the measurement is taken on the scanner.
Note 2 to entry: There are suffixes such as “ ”, “ ” or “ ”. Each suffix is used to classify tests such as
1setA 30secF 30secP
“1 set test” or “1 set + 30 second test” of the objects of tests for “ADF productivity measurement” (using suffix A),
“scan to network folder productivity measurement”(using suffix F) or “scan to pc file productivity measurement”
(using suffix P) test respectively.
Note 3 to entry: scEFTP is expressed in images per minute (ipm); it can be affected by scan time, digital processing
time, maintenance and the run time of the test.
Note 4 to entry: A different term (“EFTP; effective throughput” for digital copying machines) is defined in
ISO/IEC 24735.
Note 5 to entry: As for scEFTP , measurement parameters involving the measurement of file transmission
30secF
to a network folder are dependent on other factors like the computer and network configuration and represent
relative values and not absolute values.
Note 6 to entry: As for scEFTP , measurement parameters involving the measurement of file transmission to
30secP
a file are dependent on other factors like the computer, IO connection, IO speed and represent relative values and
not absolute values.
3.4
scESAT
estimated saturated throughput
rate at which a device scans pages measured from full ejection of the last page of the first test set (3.16)
from ADF through the full ejection of the last page of the last test set (using suffix A)
Note 1 to entry: “sc” denotes that the measurement is taken on the scanner.
Note 2 to entry: There are suffixes such as “ ”, “ ” or “ ”. Each suffix is used to classify tests such as
1setA 30secF 30secP
“1 set test” or “1 set + 30 second test” of the objects of tests for “ADF productivity measurement” (using suffix A),
“scan to network folder productivity measurement”(using suffix F) or “scan to pc file productivity measurement”
(using suffix P) test respectively. There is no measurement for “scan to network folder productivity measurement”
or “scan to pc file productivity measurement” of scESAT, scESAT and scESAT defined, therefore
30secF 30secP
scESAT , scESAT , and scESAT are not used as classifications.
1setA 1setF 1setP
Note 3 to entry: scESAT is expressed in images per minute (ipm).
3.5
scFPE
first page eject
number of seconds between the initiation of the job to full ejection of the first page of the first test set
(3.16) from the ADF
2 PROOF/ÉPREUVE © ISO/IEC 2020 – All rights reserved
---------------------- Page: 8 ----------------------
ISO 17991:2020(E)
3.6
scFSOT
first set out time
number of seconds between the initiation of the job to full ejection of the last page of the first test set
(3.16) from the ADF
Note 1 to entry: There are suffixes such as “ ”, “ ” or “ ”. Each suffix is used to classify tests such as
1setA 30secF 30secP
“1 set test” or “1 set + 30 second test” of the objects of tests for “ADF productivity measurement” (using suffix A),
“scan to network folder productivity measurement”(using suffix F) or “scan to pc file productivity measurement”
(using suffix P) test respectively .
3.7
full detailed report
presentation of information including machine setup, summary and full measured test results
Note 1 to entry: An example of the full detailed report is shown in Annex B.
3.8
full report
presentation of results including the scFSOT (3.6), scESAT (3.4), and scEFTP (3.3) values in the
performance test (3.10) as well as the calculated averages for each value
3.9
network folder speed
rate at which a device scans and stores the scanned image file in the network folder to demonstrate the
overall productivity of the device when scanning documents
EXAMPLE A suffix such as " " means a test of "1 set + 30 second" test for "scan to network folder
30secF
productivity".
Note 1 to entry: Suffix " " means "scan to network folder productivity measurement".
F
3.10
performance test
test used to evaluate productivity by providing scFSOT (3.6), scESAT (3.4), and scEFTP (3.3) without
using any special feature or mode, and includes both the simplex scanning (3.12) mode and the duplex
scanning (3.2) mode if available
3.11
scLSOT
scLSOT
Nsets
scanning last set out time
number of seconds between the initiation of the job to full ejection of the last page of the last test set
(3.16) from ADF
Note 1 to entry: There are suffixes such as “ ”, “ ” or “ ”. Each suffix is used to classify tests such as
1setA 30secF 30secP
“1 set test” or “1 set + 30 second test” of the objects of tests for “ADF productivity measurement” (using suffix A),
“scan to network folder productivity measurement”(using suffix F) or “scan to pc file productivity measurement”
(using suffix P) test respectively.
3.12
simplex
simplex scanning
use of a scanning device when only a single side of a sheet is scanned
Note 1 to entry: An equivalent term is “single sided scanning”.
3.13
summary report
presentation of results including the average overall scEFTP (3.3) in the performance test (3.10) for the
scanning device default base line performance
© ISO/IEC 2020 – All rights reserved PROOF/ÉPREUVE 3
---------------------- Page: 9 ----------------------
ISO 17991:2020(E)
3.14
test file
digital file used for creating test targets (3.17)
3.15
test run
operation of scanning all pages of targets from a test file (3.14), in a particular system configuration,
with a particular set and page count
Note 1 to entry: Scan times are recorded for each test run.
3.16
test set
all of the pages of targets from a test file (3.14)
3.17
test target
hardcopy document used for testing per the test method, and created from test file (3.14)
Note 1 to entry: An equivalent term is “test chart”.
3.18
time measurement
number of seconds measured by a timing device (stopwatch or other device) or by reading time display
on the PC clock
EXAMPLE "t " is the time measured via stopwatch or other device for completion of the first set out and
sw1A
"t " is the time measured via PC clock for completion of the first set file written to the network folder or PC file.
pc1F
Note 1 to entry: Suffixes such as " " and " " are used to show which time measurement is done; by timing
SW PC
device (stopwatch or other device) or by reading time display on the PC clock.
4 Test parameters and conditions
4.1 Scanning device setup
Place the scanning device on a horizontal surface and set up the scanning device according to the
manufacturer's recommendations.
The scanning device shall be fully enclosed in its normal exterior cover. The machine shall be acclimated
in the test environment prior to conducting the test(s) at least 8 h. All images and scanning modes should
be at their factory preset configuration for the scanning device. It is assumed that the settings listed in
Table 1 are common to all scanning devices. These listed settings shall be set to the manufacturer's
default or preset condition for the device. If a device has settings not listed in Table 1, they too shall
be set to default settings. All settings shall be explicitly stated in either case of default or non-default
settings. For scanning devices that have additional scan quality and digital image processing features,
those features shall be set to match their normal default condition and included in the result reporting.
Disabling manufacturer default installed features, routines or applications, is not allowed. As listed in
Table 1 the preset values in the test shall be noted in the full detailed report (see Annex B).
If the scanning device is setup with internal or external options such as memory as default, then these
options shall be noted on the full detailed report format in the configuration options as shown in
Annex B.
EXAMPLE Examples of configurations options to be captured:
— 160GB HDD installed.
Additional tests may be conducted using other non-default settings for the scanning device. The results
of such additional tests shall be documented as having parameters that differ from the factory defaults
and shown in comparison to the default system parameter results.
4 PROOF/ÉPREUVE © ISO/IEC 2020 – All rights reserved
---------------------- Page: 10 ----------------------
ISO 17991:2020(E)
Optional paper sizes may be used for the scanning device tests such as A3 and/or 11"×17" size as
appropriate for the test mode. When sheets of paper size other than A4/8,5" ×11" are used, the sizes
shall be indicated in the places of A4/8,5"×11" in the measurement results tables.
When a comparison must be made between the productivity of one machine with that of other machines
the measurement shall be done with the same paper sizes.
Table 1 — Pre-set settings
Pre-set item Preset
value
Scanning resolution default (200 dpi)
Colour or gray scale/B&W default (colour)
Duplex/simplex default (simplex)
Original page size default (A4)
Mode
Paper feed orientation (long/short edge) default (long edge)
Scan destination default (shared network)
Storing file type default (pdf-multi)
Auto scan quality adjustment default (factory preset default setting)
4.2 Scanning device connection
There are three types of possible connections to the scanning device:
— network connection (such as Ethernet);
— wireless connection (such as Wi-Fi);
— direct connection (such as USB).
Connection to the test platform should be determined by the manufacturer’s recommended connection.
The connection type, version, and all settings that differ from the system or scanning device defaults
shall be recorded and reported.
4.3 Scanning device condition
If available, the number of pages scanned on the device prior to the start of the test shall be recorded
and reported. The machine shall be acclimated in the test environment prior to conducting the test(s)
at least 8 h. Performance may be impacted by the amount of life used as represented by page count.
Acclimation may affect the calibration of the device which in turn could impact performance.
4.4 Sample size
Each target shall be tested and measured at least twice for repeatability. All required tests shall be run
using one device.
4.5 Maintenance
Scanning device maintenance shall be performed throughout testing per the manufacturer's
recommendations.
4.6 Preparation of test targets (test charts)
Follow the outline of the scanning test file in Annex C.
This test file is from ISO/IEC 24735. The test file consists of four single sided pages. When using the
test file for the scanning productivity test, the test targets shall be created by printing the most recent
© ISO/IEC 2020 – All rights reserved PROOF/ÉPREUVE 5
---------------------- Page: 11 ----------------------
ISO 17991:2020(E)
electronic test file on the device to be tested if it has print capability. If the test device to be tested does
not have a printer function or if the device is a colour capable scanner but does not have a printing
function of colour test targets (for the colour scanning test), then record the name of printer which is
used to print out the actual test targets.
For prepa
...
Questions, Comments and Discussion
Ask us and Technical Secretary will try to provide an answer. You can facilitate discussion about the standard in here.