ISO/IEC 18305:2016

Information technology — Real time locating systems — Test and evaluation of localization and tracking systems

ISO/IEC 18305:2016 identifies appropriate performance metrics and test & evaluation scenarios for localization and tracking systems, and it provides guidance on how best to present and visualize the T&E results. It focuses primarily on indoor environments.

Technologies de l'information - Systèmes de localisation en temps réel - Essais et évaluation des systèmes de localisation et de suivi

General Information

• Status: Published
• Publication Date: 31-Oct-2016
• ICS: 35.040 - Information coding
• ICS: 35.040.50 - Automatic identification and data capture techniques
• Technical Committee: ISO/IEC JTC 1/SC 31 - Automatic identification and data capture techniques
• Drafting Committee: ISO/IEC JTC 1/SC 31/WG 4 - Radio communications

Standards Content (Sample)

INTERNATIONAL ISO/IEC
STANDARD 18305
First edition
2016-11-01
Information technology — Real time
locating systems — Test and evaluation
of localization and tracking systems
Technologies de l’information - Systèmes de localisation en temps réel
- Essais et évaluation des systèmes de localisation et de suivi
Reference number
©
ISO/IEC 2016
© ISO/IEC 2016, Published in Switzerland
All rights reserved. Unless otherwise specified, no part of this publication may be reproduced or utilized otherwise in any form
or by any means, electronic or mechanical, including photocopying, or posting on the internet or an intranet, without prior
written permission. Permission can be requested from either ISO at the address below or ISO’s member body in the country of
the requester.
ISO copyright office
Ch. de Blandonnet 8 • CP 401
CH-1214 Vernier, Geneva, Switzerland
Tel. [phone]
Fax [phone]
[e-mail]
www.iso.org
ii © ISO/IEC 2016 – All rights reserved

Contents Page
Foreword .v
Introduction .vi
1 Scope . 1
2 Normative references . 1
3 Terms and definitions . 1
4 Abbreviated terms . 2
5 LTS taxonomy . 3
5.1 Types of location sensors . 3
5.1.1 Unimodal systems . 4
5.1.2 Multimodal systems . 5
5.2 Reliance on pre-existing networking / localization infrastructure . 5
5.2.1 LTSs requiring infrastructure . 5
5.2.2 LTSs capable of infrastructure-less operation . 5
5.2.3 Real-time deployment of nodes facilitating localization . 6
5.2.4 Opportunistic use of infrastructure/environment . 6
5.3 Off-line, building-specific training . 6
5.3.1 LTSs requiring off-line training . 6
5.3.2 LTSs not requiring off-line training . 7
5.4 Ultimate consumer(s) of location information . 7
5.4.1 Introduction . 7
5.4.2 The ELT . 8
5.4.3 The tracking authority . 8
5.4.4 Both the ELT and the tracking authority . 8
6 LTS privacy and security considerations . 8
6.1 Privacy . 8
6.2 Security . 9
7 T&E methodology taxonomy . 9
7.1 System vs. component testing . 9
7.1.1 System testing . 9
7.1.2 Component testing . 9
7.2 Knowledge about LTS inner-workings .10
7.2.1 T&E designed with full knowledge of LTS inner-workings .10
7.2.2 Black-box testing . .10
7.3 Repeatability .10
7.3.1 Repeatable testing .10
7.3.2 Non-repeatable testing .10
7.4 Test site .10
7.4.1 Building-wide testing . .10
7.4.2 Laboratory testing .11
7.5 Ground truth .11
7.5.1 Off-line surveyed test points .11
7.5.2 Reference LTS.11
8 LTS performance metrics .12
8.1 Introduction .12
8.2 Floor detection probability .13
8.3 Zone detection probability .13
8.4 Means of various errors .13
8.5 Covariance matrix of the error vector .14
8.6 Variances of magnitudes of various errors .14
8.7 RMS values of various errors .15
8.8 Absolute mean of the error vector .15
© ISO/IEC 2016 – All rights reserved iii

8.9 Circular Error 95% (CE95) and Circular Error Probable (CEP) .15
8.10 Vertical Error 95% (VE95) and Vertical Error Probable (VEP) .16
8.11 Spherical Error 95% (SE95) and Spherical Error Probable (SEP) .16
8.12 Coverage .16
8.13 Relative accuracy .17
8.14 Latency .17
8.15 Set-up time .18
8.16 Optional performance metrics .18
8.16.1 Location-specific accuracy .18
8.16.2 Availability.19
9 Optional performance metrics for LTS use in mission critical applications .19
9.1 Introduction .19
9.2 Susceptibility .20
9.3 Resilience .20
10 T&E considerations and scenarios .20
10.1 Building types .20
10.1.1 Introduction .20
10.1.2 Wooden structure single-family house .20
10.1.3 Medium-size brick & concrete office building .21
10.1.4 Warehouse/factory .21
10.1.5 High-rise steel structure.21
10.1.6 Subterranean structure .21
10.2 Effects of mobility .21
10.2.1 Introduction .
...