Information technology -- Office equipment -- Method for measuring scanning productivity of digital scanning devices

This document specifies a method for determining scanning productivity by measuring "scanning speed", "scan to network folder speed" and "scan to PC speed". It includes test files, test setup procedure, test procedure and the reporting requirements for the scanning productivity measurements. This document is applicable to scanning devices including but not limited to multi-function devices, networked scanners and single-function scanners of any underlying scanning technology. This document is applicable to devices which are able to scan a media size of A4/8,5" × 11" and which have an automatic document feeder (ADF). It is also applicable to devices which have the ability to scan to network folder, or folder on PC and do not require, but can use, other application programs on a computer or another device to perform a scanning job. This document does not apply to testing and measurement of scan to USB, scan to local hard drive or other storage medium that is part of or plugged into the scanner. This document is not intended to be used for image quality measurement, document or record management of any scanned images.

Technologie de l'information -- Équipement d'office -- Méthode de mesure de la productivité du scanner des appareils de numérisation

General Information

Status
Published
Publication Date
26-Jan-2021
Current Stage
5060 - Close of voting Proof returned by Secretariat
Start Date
11-Dec-2020
Completion Date
11-Dec-2020
Ref Project

RELATIONS

Buy Standard

Standard
ISO/IEC 17991:2021 - Information technology -- Office equipment -- Method for measuring scanning productivity of digital scanning devices
English language
32 pages
sale 15% off
Preview
sale 15% off
Preview
Draft
ISO/IEC PRF 17991:Version 21-nov-2020 - Information technology -- Office equipment -- Method for measuring scanning productivity of digital scanning devices
English language
32 pages
sale 15% off
Preview
sale 15% off
Preview

Standards Content (sample)

INTERNATIONAL ISO/IEC
STANDARD 17991
Second edition
2021-01
Information technology — Office
equipment — Method for measuring
scanning productivity of digital
scanning devices
Technologie de l'information — Équipement d'office — Méthode de
mesure de la productivité du scanner des appareils de numérisation
Reference number
ISO/IEC 17991:2021(E)
ISO/IEC 2021
---------------------- Page: 1 ----------------------
ISO/IEC 17991:2021(E)
COPYRIGHT PROTECTED DOCUMENT
© ISO/IEC 2021

All rights reserved. Unless otherwise specified, or required in the context of its implementation, no part of this publication may

be reproduced or utilized otherwise in any form or by any means, electronic or mechanical, including photocopying, or posting

on the internet or an intranet, without prior written permission. Permission can be requested from either ISO at the address

below or ISO’s member body in the country of the requester.
ISO copyright office
CP 401 • Ch. de Blandonnet 8
CH-1214 Vernier, Geneva
Phone: +41 22 749 01 11
Email: copyright@iso.org
Website: www.iso.org
Published in Switzerland
ii © ISO/IEC 2021 – All rights reserved
---------------------- Page: 2 ----------------------
ISO/IEC 17991:2021(E)
Contents Page

Foreword ..........................................................................................................................................................................................................................................v

Introduction ................................................................................................................................................................................................................................vi

1 Scope ................................................................................................................................................................................................................................. 1

2 Normative references ...................................................................................................................................................................................... 1

3 Terms and definitions ..................................................................................................................................................................................... 1

4 Test parameters and conditions ........................................................................................................................................................... 4

4.1 Scanning device setup ......... .............................................................................................................................................................. 4

4.2 Scanning device connection......................................................................................................................................................... 5

4.3 Scanning device condition ............................................................................................................................................................ 5

4.4 Sample size ................................................................................................................................................................................................. 5

4.5 Maintenance .............................................................................................................................................................................................. 5

4.6 Preparation of test targets (test charts) ............................................................................................................................ 5

4.7 Environment ............................................................................................................................................................................................. 6

4.8 Voltage ............................................................................................................................................................................................................ 6

5 Test method ............................................................................................................................................................................................................... 6

5.1 Overview ...................................................................................................................................................................................................... 6

5.2 Test measurement procedure .................................................................................................................................................... 7

5.2.1 Test setup ............................................................................................................................................................................... 7

5.2.2 “1 set” test from ready................................................................................................................................................. 8

5.2.3 “1 set + 30 seconds” test from ready .............................................................................................................. 8

5.3 Test method process .......................................................................................................................................................................... 9

5.3.1 Suggested flow chart .................................................................................................................................................... 9

5.3.2 ±5 % consistency criteria ......................................................................................................................................10

5.3.3 Estimating the set count .........................................................................................................................................11

5.4 ADF productivity measurement ............................................................................................................................................11

5.5 “Scan to network folder productivity measurement” and “scan to PC file

productivity measurement” ......................................................................................................................................................11

5.5.1 Overview ..............................................................................................................................................................................11

5.5.2 Measurement of scEFTP .......................................................................................................................................12

5.6 Feature performance test ...........................................................................................................................................................12

5.6.1 Overview ..............................................................................................................................................................................12

5.6.2 Features setting conditions .................................................................................................................................12

5.6.3 Measurement of FSOT and ESAT ...................................................................................................................12

6 Calculations and treatment of data ................................................................................................................................................13

6.1 Overview ...................................................................................................................................................................................................13

6.2 “1 set” test from ready ...................................................................................................................................................................13

6.3 “1 set + 30 seconds” test ready .............................................................................................................................................14

7 Presentation of results ................................................................................................................................................................................15

7.1 Sharing testing and reports ......................................................................................................................................................15

7.2 Minimum declaration .....................................................................................................................................................................16

7.3 ADF productivity measurement ............................................................................................................................................16

7.3.1 Overview ..............................................................................................................................................................................16

7.3.2 Summary report ............................................................................................................................................................16

7.3.3 Full report ...........................................................................................................................................................................17

7.4 “Scan to network folder productivity measurement” and “Scan to PC file

productivity measurement” ......................................................................................................................................................18

7.4.1 Overview ..............................................................................................................................................................................18

7.4.2 Summary report ............................................................................................................................................................19

7.4.3 Full report ...........................................................................................................................................................................20

7.5 Feature performance test ...........................................................................................................................................................21

7.5.1 Overview ..............................................................................................................................................................................21

7.5.2 Summary report ............................................................................................................................................................21

© ISO/IEC 2021 – All rights reserved iii
---------------------- Page: 3 ----------------------
ISO/IEC 17991:2021(E)

7.5.3 Full report ...........................................................................................................................................................................21

Annex A (informative) Report presentation ..............................................................................................................................................23

Annex B (informative) Full detailed report example ........................................................................................................................27

Annex C (normative) Test targets for measurement of scanning productivity .....................................................31

Bibliography .............................................................................................................................................................................................................................32

iv © ISO/IEC 2021 – All rights reserved
---------------------- Page: 4 ----------------------
ISO/IEC 17991:2021(E)
Foreword

ISO (the International Organization for Standardization) and IEC (the International Electrotechnical

Commission) form the specialized system for worldwide standardization. National bodies that

are members of ISO or IEC participate in the development of International Standards through

technical committees established by the respective organization to deal with particular fields of

technical activity. ISO and IEC technical committees collaborate in fields of mutual interest. Other

international organizations, governmental and non-governmental, in liaison with ISO and IEC, also

take part in the work.

The procedures used to develop this document and those intended for its further maintenance are

described in the ISO/IEC Directives, Part 1. In particular, the different approval criteria needed for

the different types of document should be noted. This document was drafted in accordance with the

editorial rules of the ISO/IEC Directives, Part 2 (see www .iso .org/ directives).

Attention is drawn to the possibility that some of the elements of this document may be the subject

of patent rights. ISO and IEC shall not be held responsible for identifying any or all such patent

rights. Details of any patent rights identified during the development of the document will be in the

Introduction and/or on the ISO list of patent declarations received (see www .iso .org/ patents) or the

IEC list of patent declarations received (see https:// patents .iec .c).

Any trade name used in this document is information given for the convenience of users and does not

constitute an endorsement.

For an explanation of the voluntary nature of standards, the meaning of ISO specific terms and

expressions related to conformity assessment, as well as information about ISO's adherence to the

World Trade Organization (WTO) principles in the Technical Barriers to Trade (TBT), see www .iso .org/

iso/ foreword .html.

This document was prepared by Joint Technical Committee ISO/IEC JTC 1, Information technology,

Subcommittee SC 28, Office equipment.

This second edition cancels and replaces the first edition (ISO/IEC 17991:2015), which has been

technically revised.
The main changes compared to the previous edition are as follows:

— changed the document structure to be consistent with other productivity standards;

— added single function scanners to the Scope;
— updated reporting to include examples of minimum declarations;
— added “first page eject” test result to the “1 set” test from ready.

Any feedback or questions on this document should be directed to the user’s national standards body. A

complete listing of these bodies can be found at www .iso .org/ members .html.
© ISO/IEC 2021 – All rights reserved v
---------------------- Page: 5 ----------------------
ISO/IEC 17991:2021(E)
Introduction

The actual productivity measurement methods of copying and printing were published as ISO/IEC 24735

and ISO/IEC 24734. However, ISO/IEC 25735 contains no measurement method for the scanning

productivity of multifunctional devices to be used for comparison and procurement of these machines.

This document provides a general method for measuring “scanning productivity” of the scanning

devices. This document also includes a test chart for scanning productivity measurement. It allows

the manufacturers and the buyers of scanning devices to describe the productivity with respect to

representative usage.
vi © ISO/IEC 2021 – All rights reserved
---------------------- Page: 6 ----------------------
INTERNATIONAL STANDARD ISO/IEC 17991:2021(E)
Information technology — Office equipment — Method for
measuring scanning productivity of digital scanning devices
1 Scope

This document specifies a method for determining scanning productivity by measuring “scanning

speed”, “scan to network folder speed” and “scan to PC speed”. It includes test files, test setup procedure,

test procedure and the reporting requirements for the scanning productivity measurements. This

document is applicable to scanning devices including but not limited to multi-function devices,

networked scanners and single-function scanners of any underlying scanning technology.

This document is applicable to devices which are able to scan a media size of A4/8,5" × 11" and which

have an automatic document feeder (ADF). It is also applicable to devices which have the ability to scan

to network folder, or folder on PC and do not require, but can use, other application programs on a

computer or another device to perform a scanning job.

This document does not apply to testing and measurement of scan to USB, scan to local hard drive or

other storage medium that is part of or plugged into the scanner.

This document is not intended to be used for image quality measurement, document or record

management of any scanned images.
2 Normative references

The following documents are referred to in the text in such a way that some or all of their content

constitutes requirements of this document. For dated references, only the edition cited applies. For

undated references, the latest edition of the referenced document (including any amendments) applies.

ISO 536, Paper and board — Determination of grammage

ISO 2470-1, Paper, board and pulps — Measurement of diffuse blue reflectance factor — Part 1: Indoor

daylight conditions (ISO brightness)
3 Terms and definitions
For the purposes of this document, the following terms and definitions apply.

ISO and IEC maintain terminological databases for use in standardization at the following addresses:

— ISO Online browsing platform: available at https:// www .iso .org/ obp
— IEC Electropedia: available at http:// www .electropedia .org/
3.1
ADF speed

rate at which a device scans documents using an automatic document feeder (ADF) to demonstrate the

productivity of the ADF and is represented with suffix A

EXAMPLE scEFTP is the scanner effective throughput (3.3) of the ADF on the 1set test.

1setA
© ISO/IEC 2021 – All rights reserved 1
---------------------- Page: 7 ----------------------
ISO/IEC 17991:2021(E)
3.2
duplex
duplex scanning
use of a scanning device with the scanning being done for both sides of a sheet
Note 1 to entry: An equivalent term is “double sided scanning”.
3.3
scEFTP
effective throughput

rate at which a device scans pages measured from the initiation of the job through the full ejection of

the last page of the scanning sets or through the complete creation of the file on the shared network

folder or PC after the transfer of the last page of the last test set (3.16)

EXAMPLE scEFTP means scanning effective throughput of “1 set test” for “ADF productivity

1setA
measurement”.
Note 1 to entry: “sc” denotes that the measurement is taken on the scanner.

Note 2 to entry: There are suffixes such as “ ”, “ ” or “ ”. Each suffix is used to classify tests such as

1setA 30secF 30secP

“1 set test” or “1 set + 30 second test” of the objects of tests for “ADF productivity measurement” (using suffix A),

“scan to network folder productivity measurement”(using suffix F) or “scan to pc file productivity measurement”

(using suffix P) test respectively.

Note 3 to entry: scEFTP is expressed in images per minute (ipm); it can be affected by scan time, digital processing

time, maintenance and the run time of the test.

Note 4 to entry: A different term (“EFTP; effective throughput” for digital copying machines) is defined in

ISO/IEC 24735.

Note 5 to entry: As for scEFTP , measurement parameters involving the measurement of file transmission

30secF

to a network folder are dependent on other factors like the computer and network configuration and represent

relative values and not absolute values.

Note 6 to entry: As for scEFTP , measurement parameters involving the measurement of file transmission to

30secP

a file are dependent on other factors like the computer, IO connection, IO speed and represent relative values and

not absolute values.
3.4
scESAT
estimated saturated throughput

rate at which a device scans pages measured from full ejection of the last page of the first test set (3.16)

from ADF through the full ejection of the last page of the last test set (using suffix A)

Note 1 to entry: “sc” denotes that the measurement is taken on the scanner.

Note 2 to entry: There are suffixes such as “ ”, “ ” or “ ”. Each suffix is used to classify tests such as

1setA 30secF 30secP

“1 set test” or “1 set + 30 second test” of the objects of tests for “ADF productivity measurement” (using suffix A),

“scan to network folder productivity measurement”(using suffix F) or “scan to pc file productivity measurement”

(using suffix P) test respectively. There is no measurement for “scan to network folder productivity measurement”

or “scan to pc file productivity measurement” of scESAT, scESAT and scESAT defined, therefore

30secF 30secP
scESAT , scESAT , and scESAT are not used as classifications.
1setA 1setF 1setP
Note 3 to entry: scESAT is expressed in images per minute (ipm).
3.5
scFPE
first page eject

number of seconds between the initiation of the job to full ejection of the first page of the first test set

(3.16) from the ADF
2 © ISO/IEC 2021 – All rights reserved
---------------------- Page: 8 ----------------------
ISO/IEC 17991:2021(E)
3.6
scFSOT
first set out time

number of seconds between the initiation of the job to full ejection of the last page of the first test set

(3.16) from the ADF

Note 1 to entry: There are suffixes such as “ ”, “ ” or “ ”. Each suffix is used to classify tests such as

1setA 30secF 30secP

“1 set test” or “1 set + 30 second test” of the objects of tests for “ADF productivity measurement” (using suffix A),

“scan to network folder productivity measurement”(using suffix F) or “scan to pc file productivity measurement”

(using suffix P) test respectively .
3.7
full detailed report

presentation of information including machine setup, summary and full measured test results

Note 1 to entry: An example of the full detailed report is shown in Annex B.
3.8
full report

presentation of results including the scFSOT (3.6), scESAT (3.4), and scEFTP (3.3) values in the

performance test (3.10) as well as the calculated averages for each value
3.9
network folder speed

rate at which a device scans and stores the scanned image file in the network folder to demonstrate the

overall productivity of the device when scanning documents

EXAMPLE A suffix such as " " means a test of "1 set + 30 second" test for "scan to network folder

30secF
productivity".

Note 1 to entry: Suffix " " means "scan to network folder productivity measurement".

3.10
performance test

test used to evaluate productivity by providing scFSOT (3.6), scESAT (3.4), and scEFTP (3.3) without

using any special feature or mode, and includes both the simplex scanning (3.12) mode and the duplex

scanning (3.2) mode if available
3.11
scLSOT
scLSOT
Nsets
scanning last set out time

number of seconds between the initiation of the job to full ejection of the last page of the last test set

(3.16) from ADF

Note 1 to entry: There are suffixes such as “ ”, “ ” or “ ”. Each suffix is used to classify tests such as

1setA 30secF 30secP

“1 set test” or “1 set + 30 second test” of the objects of tests for “ADF productivity measurement” (using suffix A),

“scan to network folder productivity measurement”(using suffix F) or “scan to pc file productivity measurement”

(using suffix P) test respectively.
3.12
simplex
simplex scanning
use of a scanning device when only a single side of a sheet is scanned
Note 1 to entry: An equivalent term is “single sided scanning”.
3.13
summary report

presentation of results including the average overall scEFTP (3.3) in the performance test (3.10) for the

scanning device default base line performance
© ISO/IEC 2021 – All rights reserved 3
---------------------- Page: 9 ----------------------
ISO/IEC 17991:2021(E)
3.14
test file
digital file used for creating test targets (3.17)
3.15
test run

operation of scanning all pages of targets from a test file (3.14), in a particular system configuration,

with a particular set and page count
Note 1 to entry: Scan times are recorded for each test run.
3.16
test set
all of the pages of targets from a test file (3.14)
3.17
test target

hardcopy document used for testing per the test method, and created from test file (3.14)

Note 1 to entry: An equivalent term is “test chart”.
3.18
time measurement

number of seconds measured by a timing device (stopwatch or other device) or by reading time display

on the PC clock

EXAMPLE "t " is the time measured via stopwatch or other device for completion of the first set out and

sw1A

"t " is the time measured via PC clock for completion of the first set file written to the network folder or PC file.

pc1F

Note 1 to entry: Suffixes such as " " and " " are used to show which time measurement is done; by timing

SW PC
device (stopwatch or other device) or by reading time display on the PC clock.
4 Test parameters and conditions
4.1 Scanning device setup

Place the scanning device on a horizontal surface and set up the scanning device according to the

manufacturer's recommendations.

The scanning device shall be fully enclosed in its normal exterior cover. The machine shall be acclimated

in the test environment prior to conducting the test(s) at least 8 h. All images and scanning modes should

be at their factory preset configuration for the scanning device. It is assumed that the settings listed in

Table 1 are common to all scanning devices. These listed settings shall be set to the manufacturer's

default or preset condition for the device. If a device has settings not listed in Table 1, they too shall

be set to default settings. All settings shall be explicitly stated in either case of default or non-default

settings. For scanning devices that have additional scan quality and digital image processing features,

those features shall be set to match their normal default condition and included in the result reporting.

Disabling manufacturer default installed features, routines or applications, is not allowed. As listed in

Table 1 the preset values in the test shall be noted in the full detailed report (see Annex B).

If the scanning device is setup with internal or external options such as memory as default, then these

options shall be noted on the full detailed report format in the configuration options as shown in

Annex B.
EXAMPLE Examples of configurations options to be captured:
— 160GB HDD installed.

Additional tests may be conducted using other non-default settings for the scanning device. The results

of such additional tests shall be documented as having parameters that differ from the factory defaults

and shown in comparison to the default system parameter results.
4 © ISO/IEC 2021 – All rights reserved
---------------------- Page: 10 ----------------------
ISO/IEC 17991:2021(E)

Optional paper sizes may be used for the scanning device tests such as A3 and/or 11"×17" size as

appropriate for the test mode. When sheets of paper size other than A4/8,5" ×11" are used, the sizes

shall be indicated in the places of A4/8,5"×11" in the measurement results tables.

When a comparison must be made between the productivity of one machine with that of other machines

the measurement shall be done with the same paper sizes.
Table 1 — Pre-set settings
Pre-set item Preset
value
Scanning resolution default (200 dpi)
Colour or gray scale/B&W default (colour)
Duplex/simplex default (simplex)
Original page size default (A4)
Mode
Paper feed orientation (long/short edge) default (long edge)
Scan destination default (shared network)
Storing file type default (pdf-multi)
Auto scan quality adjustment default (factory preset default setting)
4.2 Scanning device connection
There are three types of possible connections to the scanning device:
— network connection (such as Ethernet);
— wireless connection (such as Wi-Fi);
— direct connection (such as USB).

Connection to the test platform should be determined by the manufacturer’s recommended connection.

The connection type, version, and all settings that differ from the system or scanning device defaults

shall be recorded and reported.
4.3 Scanning device condition

If available, the number of pages scanned on the device prior to the start of the test shall be recorded

and reported. The machine shall be acclimated in the test environment prior to conducting the test(s)

at least 8 h. Performance may be impacted by the amount of life used as represented by page count.

Acclimation may affect the calibration of the device which in turn could impact performance.

4.4 Sample size

Each target shall be tested and measured at least twice for repeatability. All required tests shall be run

using one device.
4.5 Maintenance

Scanning device maintenance shall be performed throughout testing per the manufacturer's

recommendations.
4.6 Preparation of test targets (test charts)
Follow the outline of the scanning test file in Annex C.

This test file is from ISO/IEC 24735. The test file consists of four single sided pages. When using the

test file for the scanning productivity test, the test targets shall be created by printing the most recent

© ISO/IEC 2021 – All rights reserved 5
---------------------- Page: 11 ----------------------
ISO/IEC 17991:2021(E)

electronic test file on the device to be tested if it has print capability. If the test device to be tested does

not have a printer function or if the device is a colour capable scanner but does not have a printing

function of colour test targets (for the colour scanning test), then record the name of printer which is

used to print out the actual test targets.
For preparation method for double sided targets, follow the outline in Annex C.
The quali
...

INTERNATIONAL ISO
STANDARD 17991
Second edition
Information technology — Office
equipment — Method for measuring
scanning productivity of digital
scanning devices
Technologie de l'information — Équipement d'office — Méthode de
mesure de la productivité du scanner des appareils de numérisation
PROOF/ÉPREUVE
Reference number
ISO 17991:2020(E)
ISO 2020
---------------------- Page: 1 ----------------------
ISO 17991:2020(E)
COPYRIGHT PROTECTED DOCUMENT
© ISO/IEC 2020

All rights reserved. Unless otherwise specified, or required in the context of its implementation, no part of this publication may

be reproduced or utilized otherwise in any form or by any means, electronic or mechanical, including photocopying, or posting

on the internet or an intranet, without prior written permission. Permission can be requested from either ISO at the address

below or ISO’s member body in the country of the requester.
ISO copyright office
CP 401 • Ch. de Blandonnet 8
CH-1214 Vernier, Geneva
Phone: +41 22 749 01 11
Email: copyright@iso.org
Website: www.iso.org
Published in Switzerland
ii PROOF/ÉPREUVE © ISO/IEC 2020 – All rights reserved
---------------------- Page: 2 ----------------------
ISO 17991:2020(E)
Contents Page

Foreword ..........................................................................................................................................................................................................................................v

Introduction ................................................................................................................................................................................................................................vi

1 Scope ................................................................................................................................................................................................................................. 1

2 Normative references ...................................................................................................................................................................................... 1

3 Terms and definitions ..................................................................................................................................................................................... 1

4 Test parameters and conditions ........................................................................................................................................................... 4

4.1 Scanning device setup ......... .............................................................................................................................................................. 4

4.2 Scanning device connection......................................................................................................................................................... 5

4.3 Scanning device condition ............................................................................................................................................................ 5

4.4 Sample size ................................................................................................................................................................................................. 5

4.5 Maintenance .............................................................................................................................................................................................. 5

4.6 Preparation of test targets (test charts) ............................................................................................................................ 5

4.7 Environment ............................................................................................................................................................................................. 6

4.8 Voltage ............................................................................................................................................................................................................ 6

5 Test method ............................................................................................................................................................................................................... 6

5.1 Overview ...................................................................................................................................................................................................... 6

5.2 Test measurement procedure .................................................................................................................................................... 7

5.2.1 Test setup ............................................................................................................................................................................... 7

5.2.2 “1 set” test from ready................................................................................................................................................. 8

5.2.3 “1 set + 30 seconds” test from ready .............................................................................................................. 8

5.3 Test method process .......................................................................................................................................................................... 9

5.3.1 Suggested flow chart .................................................................................................................................................... 9

5.3.2 ±5 % consistency criteria ......................................................................................................................................10

5.3.3 Estimating the set count .........................................................................................................................................11

5.4 ADF productivity measurement ............................................................................................................................................11

5.5 “Scan to network folder productivity measurement” and “scan to PC file

productivity measurement” ......................................................................................................................................................11

5.5.1 Overview ..............................................................................................................................................................................11

5.5.2 Measurement of scEFTP .......................................................................................................................................12

5.6 Feature performance test ...........................................................................................................................................................12

5.6.1 Overview ..............................................................................................................................................................................12

5.6.2 Features setting conditions .................................................................................................................................12

5.6.3 Measurement of FSOT and ESAT ...................................................................................................................12

6 Calculations and treatment of data ................................................................................................................................................13

6.1 Overview ...................................................................................................................................................................................................13

6.2 “1 set” test from ready ...................................................................................................................................................................13

6.3 “1 set + 30 seconds” test ready .............................................................................................................................................14

7 Presentation of results ................................................................................................................................................................................15

7.1 Sharing testing and reports ......................................................................................................................................................15

7.2 Minimum declaration .....................................................................................................................................................................16

7.3 ADF productivity measurement ............................................................................................................................................16

7.3.1 Overview ..............................................................................................................................................................................16

7.3.2 Summary report ............................................................................................................................................................16

7.3.3 Full report ...........................................................................................................................................................................17

7.4 “Scan to network folder productivity measurement” and “Scan to PC file

productivity measurement” ......................................................................................................................................................18

7.4.1 Overview ..............................................................................................................................................................................18

7.4.2 Summary report ............................................................................................................................................................19

7.4.3 Full report ...........................................................................................................................................................................20

7.5 Feature performance test ...........................................................................................................................................................21

7.5.1 Overview ..............................................................................................................................................................................21

7.5.2 Summary report ............................................................................................................................................................21

© ISO/IEC 2020 – All rights reserved PROOF/ÉPREUVE iii
---------------------- Page: 3 ----------------------
ISO 17991:2020(E)

7.5.3 Full report ...........................................................................................................................................................................21

Annex A (informative) Report presentation ..............................................................................................................................................23

Annex B (informative) Full detailed report example ........................................................................................................................27

Annex C (normative) Test targets for measurement of scanning productivity .....................................................31

Bibliography .............................................................................................................................................................................................................................32

iv PROOF/ÉPREUVE © ISO/IEC 2020 – All rights reserved
---------------------- Page: 4 ----------------------
ISO 17991:2020(E)
Foreword

ISO (the International Organization for Standardization) and IEC (the International Electrotechnical

Commission) form the specialized system for worldwide standardization. National bodies that

are members of ISO or IEC participate in the development of International Standards through

technical committees established by the respective organization to deal with particular fields of

technical activity. ISO and IEC technical committees collaborate in fields of mutual interest. Other

international organizations, governmental and non-governmental, in liaison with ISO and IEC, also

take part in the work.

The procedures used to develop this document and those intended for its further maintenance are

described in the ISO/IEC Directives, Part 1. In particular, the different approval criteria needed for

the different types of document should be noted. This document was drafted in accordance with the

editorial rules of the ISO/IEC Directives, Part 2 (see www .iso .org/ directives).

Attention is drawn to the possibility that some of the elements of this document may be the subject

of patent rights. ISO and IEC shall not be held responsible for identifying any or all such patent

rights. Details of any patent rights identified during the development of the document will be in the

Introduction and/or on the ISO list of patent declarations received (see www .iso .org/ patents) or the

IEC list of patent declarations received (see https:// patents .iec .c).

Any trade name used in this document is information given for the convenience of users and does not

constitute an endorsement.

For an explanation of the voluntary nature of standards, the meaning of ISO specific terms and

expressions related to conformity assessment, as well as information about ISO's adherence to the

World Trade Organization (WTO) principles in the Technical Barriers to Trade (TBT), see www .iso .org/

iso/ foreword .html.

This document was prepared by Joint Technical Committee ISO/IEC JTC 1, Information technology,

Subcommittee SC 28, Office equipment.

This second edition cancels and replaces the first edition (ISO/IEC 17991:2015), which has been

technically revised.
The main changes compared to the previous edition are as follows:

— changed the document structure to be consistent with other productivity standards;

— added single function scanners to the Scope;
— updated reporting to include examples of minimum declarations;
— added “first page eject” test result to the “1 set” test from ready.

Any feedback or questions on this document should be directed to the user’s national standards body. A

complete listing of these bodies can be found at www .iso .org/ members .html.
© ISO/IEC 2020 – All rights reserved PROOF/ÉPREUVE v
---------------------- Page: 5 ----------------------
ISO 17991:2020(E)
Introduction

The actual productivity measurement methods of copying and printing were published as ISO/IEC 24735

and ISO/IEC 24734. However, ISO/IEC 25735 contains no measurement method for the scanning

productivity of multifunctional devices to be used for comparison and procurement of these machines.

This document provides a general method for measuring “scanning productivity” of the scanning

devices. This document also includes a test chart for scanning productivity measurement. It allows

the manufacturers and the buyers of scanning devices to describe the productivity with respect to

representative usage.
vi PROOF/ÉPREUVE © ISO/IEC 2020 – All rights reserved
---------------------- Page: 6 ----------------------
INTERNATIONAL STANDARD ISO 17991:2020(E)
Information technology — Office equipment — Method for
measuring scanning productivity of digital scanning devices
1 Scope

This document specifies a method for determining scanning productivity by measuring “scanning

speed”, “scan to network folder speed” and “scan to PC speed”. It includes test files, test setup procedure,

test procedure and the reporting requirements for the scanning productivity measurements. This

document is applicable to scanning devices including but not limited to multi-function devices,

networked scanners and single-function scanners of any underlying scanning technology.

This document is applicable to devices which are able to scan a media size of A4/8,5" × 11" and which

have an automatic document feeder (ADF). It is also applicable to devices which have the ability to scan

to network folder, or folder on PC and do not require, but can use, other application programs on a

computer or another device to perform a scanning job.

This document does not apply to testing and measurement of scan to USB, scan to local hard drive or

other storage medium that is part of or plugged into the scanner.

This document is not intended to be used for image quality measurement, document or record

management of any scanned images.
2 Normative references

The following documents are referred to in the text in such a way that some or all of their content

constitutes requirements of this document. For dated references, only the edition cited applies. For

undated references, the latest edition of the referenced document (including any amendments) applies.

ISO 536, Paper and board — Determination of grammage

ISO 2470-1, Paper, board and pulps — Measurement of diffuse blue reflectance factor — Part 1: Indoor

daylight conditions (ISO brightness)
3 Terms and definitions
For the purposes of this document, the following terms and definitions apply.

ISO and IEC maintain terminological databases for use in standardization at the following addresses:

— ISO Online browsing platform: available at https:// www .iso .org/ obp
— IEC Electropedia: available at http:// www .electropedia .org/
3.1
ADF speed

rate at which a device scans documents using an automatic document feeder (ADF) to demonstrate the

productivity of the ADF and is represented with suffix A

EXAMPLE scEFTP is the scanner effective throughput (3.3) of the ADF on the 1set test.

1setA
© ISO/IEC 2020 – All rights reserved PROOF/ÉPREUVE 1
---------------------- Page: 7 ----------------------
ISO 17991:2020(E)
3.2
duplex
duplex scanning
use of a scanning device with the scanning being done for both sides of a sheet
Note 1 to entry: An equivalent term is “double sided scanning”.
3.3
scEFTP
effective throughput

rate at which a device scans pages measured from the initiation of the job through the full ejection of

the last page of the scanning sets or through the complete creation of the file on the shared network

folder or PC after the transfer of the last page of the last test set (3.16)

EXAMPLE scEFTP means scanning effective throughput of “1 set test” for “ADF productivity

1setA
measurement”.
Note 1 to entry: “sc” denotes that the measurement is taken on the scanner.

Note 2 to entry: There are suffixes such as “ ”, “ ” or “ ”. Each suffix is used to classify tests such as

1setA 30secF 30secP

“1 set test” or “1 set + 30 second test” of the objects of tests for “ADF productivity measurement” (using suffix A),

“scan to network folder productivity measurement”(using suffix F) or “scan to pc file productivity measurement”

(using suffix P) test respectively.

Note 3 to entry: scEFTP is expressed in images per minute (ipm); it can be affected by scan time, digital processing

time, maintenance and the run time of the test.

Note 4 to entry: A different term (“EFTP; effective throughput” for digital copying machines) is defined in

ISO/IEC 24735.

Note 5 to entry: As for scEFTP , measurement parameters involving the measurement of file transmission

30secF

to a network folder are dependent on other factors like the computer and network configuration and represent

relative values and not absolute values.

Note 6 to entry: As for scEFTP , measurement parameters involving the measurement of file transmission to

30secP

a file are dependent on other factors like the computer, IO connection, IO speed and represent relative values and

not absolute values.
3.4
scESAT
estimated saturated throughput

rate at which a device scans pages measured from full ejection of the last page of the first test set (3.16)

from ADF through the full ejection of the last page of the last test set (using suffix A)

Note 1 to entry: “sc” denotes that the measurement is taken on the scanner.

Note 2 to entry: There are suffixes such as “ ”, “ ” or “ ”. Each suffix is used to classify tests such as

1setA 30secF 30secP

“1 set test” or “1 set + 30 second test” of the objects of tests for “ADF productivity measurement” (using suffix A),

“scan to network folder productivity measurement”(using suffix F) or “scan to pc file productivity measurement”

(using suffix P) test respectively. There is no measurement for “scan to network folder productivity measurement”

or “scan to pc file productivity measurement” of scESAT, scESAT and scESAT defined, therefore

30secF 30secP
scESAT , scESAT , and scESAT are not used as classifications.
1setA 1setF 1setP
Note 3 to entry: scESAT is expressed in images per minute (ipm).
3.5
scFPE
first page eject

number of seconds between the initiation of the job to full ejection of the first page of the first test set

(3.16) from the ADF
2 PROOF/ÉPREUVE © ISO/IEC 2020 – All rights reserved
---------------------- Page: 8 ----------------------
ISO 17991:2020(E)
3.6
scFSOT
first set out time

number of seconds between the initiation of the job to full ejection of the last page of the first test set

(3.16) from the ADF

Note 1 to entry: There are suffixes such as “ ”, “ ” or “ ”. Each suffix is used to classify tests such as

1setA 30secF 30secP

“1 set test” or “1 set + 30 second test” of the objects of tests for “ADF productivity measurement” (using suffix A),

“scan to network folder productivity measurement”(using suffix F) or “scan to pc file productivity measurement”

(using suffix P) test respectively .
3.7
full detailed report

presentation of information including machine setup, summary and full measured test results

Note 1 to entry: An example of the full detailed report is shown in Annex B.
3.8
full report

presentation of results including the scFSOT (3.6), scESAT (3.4), and scEFTP (3.3) values in the

performance test (3.10) as well as the calculated averages for each value
3.9
network folder speed

rate at which a device scans and stores the scanned image file in the network folder to demonstrate the

overall productivity of the device when scanning documents

EXAMPLE A suffix such as " " means a test of "1 set + 30 second" test for "scan to network folder

30secF
productivity".

Note 1 to entry: Suffix " " means "scan to network folder productivity measurement".

3.10
performance test

test used to evaluate productivity by providing scFSOT (3.6), scESAT (3.4), and scEFTP (3.3) without

using any special feature or mode, and includes both the simplex scanning (3.12) mode and the duplex

scanning (3.2) mode if available
3.11
scLSOT
scLSOT
Nsets
scanning last set out time

number of seconds between the initiation of the job to full ejection of the last page of the last test set

(3.16) from ADF

Note 1 to entry: There are suffixes such as “ ”, “ ” or “ ”. Each suffix is used to classify tests such as

1setA 30secF 30secP

“1 set test” or “1 set + 30 second test” of the objects of tests for “ADF productivity measurement” (using suffix A),

“scan to network folder productivity measurement”(using suffix F) or “scan to pc file productivity measurement”

(using suffix P) test respectively.
3.12
simplex
simplex scanning
use of a scanning device when only a single side of a sheet is scanned
Note 1 to entry: An equivalent term is “single sided scanning”.
3.13
summary report

presentation of results including the average overall scEFTP (3.3) in the performance test (3.10) for the

scanning device default base line performance
© ISO/IEC 2020 – All rights reserved PROOF/ÉPREUVE 3
---------------------- Page: 9 ----------------------
ISO 17991:2020(E)
3.14
test file
digital file used for creating test targets (3.17)
3.15
test run

operation of scanning all pages of targets from a test file (3.14), in a particular system configuration,

with a particular set and page count
Note 1 to entry: Scan times are recorded for each test run.
3.16
test set
all of the pages of targets from a test file (3.14)
3.17
test target

hardcopy document used for testing per the test method, and created from test file (3.14)

Note 1 to entry: An equivalent term is “test chart”.
3.18
time measurement

number of seconds measured by a timing device (stopwatch or other device) or by reading time display

on the PC clock

EXAMPLE "t " is the time measured via stopwatch or other device for completion of the first set out and

sw1A

"t " is the time measured via PC clock for completion of the first set file written to the network folder or PC file.

pc1F

Note 1 to entry: Suffixes such as " " and " " are used to show which time measurement is done; by timing

SW PC
device (stopwatch or other device) or by reading time display on the PC clock.
4 Test parameters and conditions
4.1 Scanning device setup

Place the scanning device on a horizontal surface and set up the scanning device according to the

manufacturer's recommendations.

The scanning device shall be fully enclosed in its normal exterior cover. The machine shall be acclimated

in the test environment prior to conducting the test(s) at least 8 h. All images and scanning modes should

be at their factory preset configuration for the scanning device. It is assumed that the settings listed in

Table 1 are common to all scanning devices. These listed settings shall be set to the manufacturer's

default or preset condition for the device. If a device has settings not listed in Table 1, they too shall

be set to default settings. All settings shall be explicitly stated in either case of default or non-default

settings. For scanning devices that have additional scan quality and digital image processing features,

those features shall be set to match their normal default condition and included in the result reporting.

Disabling manufacturer default installed features, routines or applications, is not allowed. As listed in

Table 1 the preset values in the test shall be noted in the full detailed report (see Annex B).

If the scanning device is setup with internal or external options such as memory as default, then these

options shall be noted on the full detailed report format in the configuration options as shown in

Annex B.
EXAMPLE Examples of configurations options to be captured:
— 160GB HDD installed.

Additional tests may be conducted using other non-default settings for the scanning device. The results

of such additional tests shall be documented as having parameters that differ from the factory defaults

and shown in comparison to the default system parameter results.
4 PROOF/ÉPREUVE © ISO/IEC 2020 – All rights reserved
---------------------- Page: 10 ----------------------
ISO 17991:2020(E)

Optional paper sizes may be used for the scanning device tests such as A3 and/or 11"×17" size as

appropriate for the test mode. When sheets of paper size other than A4/8,5" ×11" are used, the sizes

shall be indicated in the places of A4/8,5"×11" in the measurement results tables.

When a comparison must be made between the productivity of one machine with that of other machines

the measurement shall be done with the same paper sizes.
Table 1 — Pre-set settings
Pre-set item Preset
value
Scanning resolution default (200 dpi)
Colour or gray scale/B&W default (colour)
Duplex/simplex default (simplex)
Original page size default (A4)
Mode
Paper feed orientation (long/short edge) default (long edge)
Scan destination default (shared network)
Storing file type default (pdf-multi)
Auto scan quality adjustment default (factory preset default setting)
4.2 Scanning device connection
There are three types of possible connections to the scanning device:
— network connection (such as Ethernet);
— wireless connection (such as Wi-Fi);
— direct connection (such as USB).

Connection to the test platform should be determined by the manufacturer’s recommended connection.

The connection type, version, and all settings that differ from the system or scanning device defaults

shall be recorded and reported.
4.3 Scanning device condition

If available, the number of pages scanned on the device prior to the start of the test shall be recorded

and reported. The machine shall be acclimated in the test environment prior to conducting the test(s)

at least 8 h. Performance may be impacted by the amount of life used as represented by page count.

Acclimation may affect the calibration of the device which in turn could impact performance.

4.4 Sample size

Each target shall be tested and measured at least twice for repeatability. All required tests shall be run

using one device.
4.5 Maintenance

Scanning device maintenance shall be performed throughout testing per the manufacturer's

recommendations.
4.6 Preparation of test targets (test charts)
Follow the outline of the scanning test file in Annex C.

This test file is from ISO/IEC 24735. The test file consists of four single sided pages. When using the

test file for the scanning productivity test, the test targets shall be created by printing the most recent

© ISO/IEC 2020 – All rights reserved PROOF/ÉPREUVE 5
---------------------- Page: 11 ----------------------
ISO 17991:2020(E)

electronic test file on the device to be tested if it has print capability. If the test device to be tested does

not have a printer function or if the device is a colour capable scanner but does not have a printing

function of colour test targets (for the colour scanning test), then record the name of printer which is

used to print out the actual test targets.
For prepa
...

Questions, Comments and Discussion

Ask us and Technical Secretary will try to provide an answer. You can facilitate discussion about the standard in here.