ISO/IEC 18039:2019
(Main)Information technology — Computer graphics, image processing and environmental data representation — Mixed and augmented reality (MAR) reference model
Information technology — Computer graphics, image processing and environmental data representation — Mixed and augmented reality (MAR) reference model
This document defines the scope and key concepts of mixed and augmented reality, the relevant terms and their definitions and a generalized system architecture that together serve as a reference model for mixed and augmented reality (MAR) applications, components, systems, services and specifications. This architectural reference model establishes the set of required sub-modules and their minimum functions, the associated information content and the information models to be provided and/or supported by a compliant MAR system. The reference model is intended for use by current and future developers of MAR applications, components, systems, services or specifications to describe, compare, contrast and communicate their architectural design and implementation. The MAR reference model is designed to apply to MAR systems independent of specific algorithms, implementation methods, computational platforms, display systems and sensors or devices used. This document does not specify how a particular MAR application, component, system, service or specification is designed, developed or implemented. It does not specify the bindings of those designs and concepts to programming languages or the encoding of MAR information through any coding technique or interchange format. This document contains a list of representative system classes and use cases with respect to the reference model.
Technologies de l'information — Infographie, traitement de l'image et représentation des données environnementales — Modèle de référence en réalité mixte et augmentée
General Information
Buy Standard
Standards Content (Sample)
INTERNATIONAL ISO/IEC
STANDARD 18039
First edition
2019-02
Information technology — Computer
graphics, image processing and
environmental data representation —
Mixed and augmented reality (MAR)
reference model
Technologies de l'information — Infographie, traitement de l'image
et représentation des données environnementales — Modèle de
référence en réalité mixte et augmentée
Reference number
©
ISO/IEC 2019
© ISO/IEC 2019
All rights reserved. Unless otherwise specified, or required in the context of its implementation, no part of this publication may
be reproduced or utilized otherwise in any form or by any means, electronic or mechanical, including photocopying, or posting
on the internet or an intranet, without prior written permission. Permission can be requested from either ISO at the address
below or ISO’s member body in the country of the requester.
ISO copyright office
CP 401 • Ch. de Blandonnet 8
CH-1214 Vernier, Geneva
Phone: +41 22 749 01 11
Fax: +41 22 749 09 47
Email: copyright@iso.org
Website: www.iso.org
Published in Switzerland
ii © ISO/IEC 2019 – All rights reserved
Contents Page
Foreword .v
Introduction .vi
1 Scope . 1
2 Normative references . 1
3 Terms, definitions and abbreviated terms . 1
3.1 Terms and definitions . 1
3.2 Abbreviated terms . 4
4 Mixed and augmented reality (MAR) domain and concepts . 4
4.1 General . 4
4.2 MAR continuum . 6
5 MAR reference model usage example . 7
5.1 Designing an MAR application or service . 7
5.2 Deriving an MAR business model . 7
5.3 Extending existing or creating new standards for MAR . 7
6 MAR reference system architecture . 8
6.1 Overview . 8
6.2 Viewpoints . 9
6.3 Enterprise viewpoint . 9
6.3.1 General. 9
6.3.2 Classes of actors .10
6.3.3 Business model of MAR systems .11
6.3.4 Criteria for successful MAR systems .12
6.4 Computational viewpoint .12
6.4.1 General.12
6.4.2 Sensors: pure sensor and real world capturer .12
6.4.3 Context analyser: recognizer and tracker .13
6.4.4 Spatial mapper .14
6.4.5 Event mapper . . .14
6.4.6 MAR execution engine .15
6.4.7 Renderer .15
6.4.8 Display and user interface .16
6.4.9 MAR system API .17
6.5 Information viewpoint .17
6.5.1 General.17
6.5.2 Sensors .17
6.5.3 Recognizer .18
6.5.4 Tracker . .19
6.5.5 Spatial mapper .19
6.5.6 Event mapper . . .19
6.5.7 Execution engine .20
6.5.8 Renderer .20
6.5.9 Display and user interface .20
7 MAR component classification framework .21
8 MAR system classes .22
8.1 General .22
8.2 MAR Class V — Visual augmentation systems.22
8.2.1 Local recognition and tracking .22
8.2.2 Local registration, remote recognition and tracking .23
8.2.3 Remote recognition, local tracking and registration .24
8.2.4 Remote recognition, registration and composition .26
8.2.5 MAR Class V-R: visual augmentation with 3D environment reconstruction .27
© ISO/IEC 2019 – All rights reserved iii
8.3 MAR type 3DV: 3D video systems .27
8.3.1 Real-time, local-depth estimation, condition-based augmentation .27
8.3.2 Real-time, local-depth estimation, model-based augmentation .28
8.3.3 Real-time, remote depth estimation, condition-based augmentation .29
8.3.4 Real-time, remote-depth estimation, model-based augmentation .30
8.3.5 Real-time, multiple remote user reconstructions, condition-based
augmentation .31
8.4 MAR Class G: points of interest (POI) — GNSS-based systems .32
8.4.1 Content-embedded POIs .32
8.4.2 Server-available POIs .33
8.5 MAR type A: audio systems .34
8.5.1 Local audio recognition . .34
8.5.2 Remote audio recognition .35
8.6 MAR type 3DA: 3D audio systems .36
8.6.1 Local audio spatialization .36
9 Conformance .37
10 Performance .38
11 Safety .38
12 Security.39
13 Privacy .39
14 Usability and accessibility .39
Annex A (informative) AR-related solutions and technologies and their relation to the MAR
reference model .41
Annex B (informative) Use case examples and coverage by the MAR reference model .45
Bibliography .60
iv © ISO/IEC 2019 – All rights reserved
ISO/IEC 18039
...
INTERNATIONAL ISO/IEC
STANDARD 18039
First edition
2019-02
Information technology — Computer
graphics, image processing and
environmental data representation —
Mixed and augmented reality (MAR)
reference model
Technologies de l'information — Infographie, traitement de l'image
et représentation des données environnementales — Modèle de
référence en réalité mixte et augmentée
Reference number
©
ISO/IEC 2019
© ISO/IEC 2019
All rights reserved. Unless otherwise specified, or required in the context of its implementation, no part of this publication may
be reproduced or utilized otherwise in any form or by any means, electronic or mechanical, including photocopying, or posting
on the internet or an intranet, without prior written permission. Permission can be requested from either ISO at the address
below or ISO’s member body in the country of the requester.
ISO copyright office
CP 401 • Ch. de Blandonnet 8
CH-1214 Vernier, Geneva
Phone: +41 22 749 01 11
Fax: +41 22 749 09 47
Email: copyright@iso.org
Website: www.iso.org
Published in Switzerland
ii © ISO/IEC 2019 – All rights reserved
Contents Page
Foreword .v
Introduction .vi
1 Scope . 1
2 Normative references . 1
3 Terms, definitions and abbreviated terms . 1
3.1 Terms and definitions . 1
3.2 Abbreviated terms . 4
4 Mixed and augmented reality (MAR) domain and concepts . 4
4.1 General . 4
4.2 MAR continuum . 6
5 MAR reference model usage example . 7
5.1 Designing an MAR application or service . 7
5.2 Deriving an MAR business model . 7
5.3 Extending existing or creating new standards for MAR . 7
6 MAR reference system architecture . 8
6.1 Overview . 8
6.2 Viewpoints . 9
6.3 Enterprise viewpoint . 9
6.3.1 General. 9
6.3.2 Classes of actors .10
6.3.3 Business model of MAR systems .11
6.3.4 Criteria for successful MAR systems .12
6.4 Computational viewpoint .12
6.4.1 General.12
6.4.2 Sensors: pure sensor and real world capturer .12
6.4.3 Context analyser: recognizer and tracker .13
6.4.4 Spatial mapper .14
6.4.5 Event mapper . . .14
6.4.6 MAR execution engine .15
6.4.7 Renderer .15
6.4.8 Display and user interface .16
6.4.9 MAR system API .17
6.5 Information viewpoint .17
6.5.1 General.17
6.5.2 Sensors .17
6.5.3 Recognizer .18
6.5.4 Tracker . .19
6.5.5 Spatial mapper .19
6.5.6 Event mapper . . .19
6.5.7 Execution engine .20
6.5.8 Renderer .20
6.5.9 Display and user interface .20
7 MAR component classification framework .21
8 MAR system classes .22
8.1 General .22
8.2 MAR Class V — Visual augmentation systems.22
8.2.1 Local recognition and tracking .22
8.2.2 Local registration, remote recognition and tracking .23
8.2.3 Remote recognition, local tracking and registration .24
8.2.4 Remote recognition, registration and composition .26
8.2.5 MAR Class V-R: visual augmentation with 3D environment reconstruction .27
© ISO/IEC 2019 – All rights reserved iii
8.3 MAR type 3DV: 3D video systems .27
8.3.1 Real-time, local-depth estimation, condition-based augmentation .27
8.3.2 Real-time, local-depth estimation, model-based augmentation .28
8.3.3 Real-time, remote depth estimation, condition-based augmentation .29
8.3.4 Real-time, remote-depth estimation, model-based augmentation .30
8.3.5 Real-time, multiple remote user reconstructions, condition-based
augmentation .31
8.4 MAR Class G: points of interest (POI) — GNSS-based systems .32
8.4.1 Content-embedded POIs .32
8.4.2 Server-available POIs .33
8.5 MAR type A: audio systems .34
8.5.1 Local audio recognition . .34
8.5.2 Remote audio recognition .35
8.6 MAR type 3DA: 3D audio systems .36
8.6.1 Local audio spatialization .36
9 Conformance .37
10 Performance .38
11 Safety .38
12 Security.39
13 Privacy .39
14 Usability and accessibility .39
Annex A (informative) AR-related solutions and technologies and their relation to the MAR
reference model .41
Annex B (informative) Use case examples and coverage by the MAR reference model .45
Bibliography .60
iv © ISO/IEC 2019 – All rights reserved
ISO/IEC 18039
...
Questions, Comments and Discussion
Ask us and Technical Secretary will try to provide an answer. You can facilitate discussion about the standard in here.