ETSI GS ARF 004-3 V1.1.1 (2021-10)

Augmented Reality Framework (ARF); Interoperability Requirements for AR components, systems and services; Part 3: World Capture, World Analysis and Scene Management

DGS/ARF-004-3

General Information

• Status: Not Published
• Technical Committee: ARF - Augmented Reality Framework
• Current Stage: 12 - Completion
• Due Date: 19-Oct-2021
• Completion Date: 14-Oct-2021

Standards Content (Sample)

GROUP SPECIFICATION
Augmented Reality Framework (ARF);
Interoperability Requirements for
AR components, systems and services;
Part 3: World Capture, World Analysis and
Scene Management
Disclaimer
The present document has been produced and approved by the Augmented Reality Framework (ARF) ETSI Industry
Specification Group (ISG) and represents the views of those members who participated in this ISG.
It does not necessarily represent the views of the entire ETSI membership.

2 ETSI GS ARF 004-3 V1.1.1 (2021-10)

Reference
DGS/ARF-004-3
Keywords
API, AR Cloud, architecture, augmented reality,
context capturing and analysis, framework,
interoperability, model, real time, real world
capture, requirements, sensor
ETSI
650 Route des Lucioles
F-06921 Sophia Antipolis Cedex - FRANCE

Tel.: [phone]  Fax: [phone]

Siret N° 348 623 562 00017 - APE 7112B
Association à but non lucratif enregistrée à la
Sous-Préfecture de Grasse (06) N° w061004871

Important notice
The present document can be downloaded from:
http://www.etsi.org/standards-search
The present document may be made available in electronic versions and/or in print. The content of any electronic and/or
print versions of the present document shall not be modified without the prior written authorization of ETSI. In case of any
existing or perceived difference in contents between such versions and/or in print, the prevailing version of an ETSI
deliverable is the one made publicly available in PDF format at www.etsi.org/deliver.
Users of the present document should be aware that the document may be subject to revision or change of status.
Information on the current status of this and other ETSI documents is available at
https://portal.etsi.org/TB/ETSIDeliverableStatus.aspx
If you find errors in the present document, please send your comment to one of the following services:
https://portal.etsi.org/People/CommiteeSupportStaff.aspx
Notice of disclaimer & limitation of liability
The information provided in the present deliverable is directed solely to professionals who have the appropriate degree of
experience to understand and interpret its content in accordance with generally accepted engineering or
other professional standard and applicable regulations.
No recommendation as to products and services or vendors is made or should be implied.
No representation or warranty is made that this deliverable is technically accurate or sufficient or conforms to any law
and/or governmental rule and/or regulation and further, no representation or warranty is made of merchantability or fitness
for any particular purpose or against infringement of intellectual property rights.
In no event shall ETSI be held liable for loss of profits or any other incidental or consequential damages.

Any software contained in this deliverable is provided "AS IS" with no warranties, express or implied, including but not
limited to, the warranties of merchantability, fitness for a particular purpose and non-infringement of intellectual property
rights and ETSI shall not be held liable in any event for any damages whatsoever (including, without limitation, damages
for loss of profits, business interruption, loss of information, or any other pecuniary loss) arising out of or related to the use
of or inability to use the software.
Copyright Notification
No part may be reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying and
microfilm except as authorized by written permission of ETSI.
The content of the PDF version shall not be modified without the written authorization of ETSI.
The copyright and the foregoing restriction extend to reproduction in all media.

© ETSI 2021.
All rights reserved.
ETSI
3 ETSI GS ARF 004-3 V1.1.1 (2021-10)
Contents
Intellectual Property Rights . 4
Foreword . 4
Modal verbs terminology . 4
1 Scope . 5
2 References . 5
2.1 Normative references . 5
2.2 Informative references . 5
3 Definition of terms, symbols and abbreviations . 7
3.1 Terms . 7
3.2 Symbols . 7
3.3 Abbreviations . 7
4 Interoperability Requirements for AR1 and AR2 . 7
4.1 AR1 and AR2 Reference Points Scope . 7
4.2 High-level requirements . 8
4.3 World Analysis Function Access to World Capture Sensors . 9
4.4 World Analysis Function Control of World Capture Sensors . 10
4.5 Transfer of Data between World Capture and World Analysis . 10
4.6 Scene Management Function Access to World Capture Sensors . 11
4.7 Scene Management Function Control of World Capture Sensors . 11
4.8 Transfer of Data between World Capture and Scene Management . 12
Annex A (informative): Other Standards of Relevance to AR1 and AR 2 Requirements . 13
A.1 Overview . 13
A.2 Standards Providing World Capture System Architectures . 13
A.2.1 Overview . 13
A.2.2 OGC Observations and Measurements (O&M) Abstract Specification . 13
A.2.3 OGC Sensor Web Enablement (SWE) standards . 14
A.2.4 OGC SensorML . 14
A.2.5 W3C Semantic Sensor Model and Semantic Sensor Network Ontology . 14
A.2.6 W3C Web of Things Architecture 1.1 . 15
A.2.7 ISO/IEC 23093-1:2020 MPEG Internet of Media Things Part 1: Architecture . 15
A.2.8 W3C WoT Thing Description . 15
A.3 Standards Defining Access and Control Protocols . 15
A.3.1 Overview . 15
A.3.2 OGC SensorThings API . 16
A.3.3 W3C Web of Things Discovery . 16
A.3.4 ISO/IEC 18038:2020 . 16
A.3.5 IEEE 1451 . 17
A.3.6 ISO/IEC 23093 series . 17
A.4 Media Transfer . 17
A.4.1 Overview . 17
A.4.2 ISO/IEC 23093-3 . 17
A.4.3 ISO/IEC 23090 MPEG Point Cloud Compression Standards . 18
A.5 Miscellaneous . 18
A.5.1 Overview . 18
A.5.2 IEEE 1451 . 18
A.5.3 ISO 19130 Imagery Sensor Models for Geopositioning . 18
A.5.4 W3C Devices and Sensors Working Group Standards . 18
A.5.5 Internet of Things . 19
History . 20

ETSI
4 ETSI GS ARF 004-3 V1.1.1 (2021-10)
Intellectual Property Rights
Essential patents
IPRs essential or potentially essential to normative deliverables may have been declared to ETSI. The declarations
pertaining to these essential IPRs, if any, are publicly available for ETSI members and non-members, and can be
found in ETSI SR 000 314: "Intellectual Property Rights (IPRs); Essential, or potentially Essential, IPRs notified to
ETSI in respect of ETSI standards", which is available from the ETSI Secretariat. Latest updates are available on the
ETSI Web server (https://ipr.etsi.org/).
Pursuant to the ETSI Directives including the ETSI IPR Policy, no investigation regarding the essentiality of IPRs,
including IPR searches, has been carried out by ETSI. No guarantee can be given as to the existence of other IPRs not
referenced in ETSI SR 000 314 (or the updates on the ETSI Web server) which are, or may be, or may become,
essential to the present document.
Trademarks
The present document may include trademarks and/or tradenames which are asserted and/or registered by their owners.
ETSI claims no ownership of these except for any which are indicated as being the property of ETSI, and conveys no
right to use or reproduce any trademark and/or tradename. Mention of those trademarks in the present document does
not constitute an endorsement by ETSI of products, services or organizations associated with those trademarks.
DECT™, PLUGTESTS™, UMTS™ and the ETSI logo are trademarks of ETSI registered for the benefit of its

Members. 3GPP™ and LTE™ are trademarks of ETSI registered for the benefit of its Members and of the 3GPP
Organizational Partners. oneM2M™ logo is a trademark of ETSI registered for the benefit of its Members and of the ®
oneM2M Partners. GSM and the GSM logo are trademarks registered and owned by the GSM Association.
Foreword
This Group Specification (GS) has been produced by ETSI Industry Specification Group (ISG) Augmented Reality
Framework (ARF).
The present document is part 3 of a multi-part deliverable covering Interoperability Requirements for AR components,
systems and services, as identified below:
Part 1: "Overview";
Part 2: "World Storage and AR Authoring functions";
Part 3: "World Capture, World Analysis and Scene Management".
The ISG ARF shares the following understanding for Augmented Reality: Augmented Reality (AR) is the ability to mix
in real-time spatially-registered digital content with the real world. The present document specifies the interoperability
requirements for Reference Points AR1 and AR2 of the reference architecture for AR solutions defined in ETSI
GS ARF 003 [1].
Modal verbs terminology
In the present document "shall", "shall not", "should", "should not", "may", "need not", "will", "will not", "can" and
"cannot" are to be interpreted as described in clause 3.2 of the ETSI Drafting Rules (Verbal forms for the expression of
provisions).
"must" and "must not" are NOT allowed in ETSI deliverables except when used in direct citation.
ETSI
5 ETSI GS ARF 004-3 V1.1.1 (2021-10)
1 Scope
The present document reviews the high level Reference Point requirements between the World Capture, World
Authoring and Scene Management functions as they are identified in ETSI GS ARF 003 [1]. It further defines the
requirements of reference points "Sensors for World Analysis" (AR1) and "Sensors for Scene Management" (AR2).
2 References
2.1 Normative references
References are either specific (identified by date of publication and/or edition number or version number) or
non-specific. For specific references, only the cited version applies. For non-specific references, the latest version of the
referenced document (including any amendments) applies.
Referenced documents which are not found to be publicly available in the expected location might be found at
https://docbox.etsi.org/Reference/.
NOTE: While any hyperlinks included in this clause were valid at the time of publication, ETSI cannot guarantee
their long term validity.
The following referenced documents are necessary for the application of the present document.
[1] ETSI GS ARF 003 (V1.1.1): "Augmented Reality Framework (ARF) AR framework architecture".
2.2 Informative references
References are either specific (identified by date of publication and/or edition number or version number) or
non-specific. For specific references, only the cited version applies. For non-specific references, the latest version of the
referenced document (including any amendments) applies.
NOTE: While any hyperlinks included in this clause were valid at the time of publication, ETSI cannot guarantee
their long term validity.
The following referenced documents are not necessary for the application of the present document but they assist the
user with regard to a particular subject area. ®
[i.1] OGC : "Geographic information - Observations and measurements".
NOTE: This standard can be found at https://portal.ogc.org/files/?artifact_id=41579.
[i.2] Fowler, Martin (1997): "Analysis Patterns: Reusable Object Models". Addison-Wesley. pp. 35-55.
ISBN 978-0-201-89542-1.
NOTE: This document can be found at https://archive.org/details/analysispatterns00fowl_085. ®
[i.3] OGC : "Sensor Web Enablement (SWE)".
NOTE: The page that describes the various parts of the standard suite can be found at
https://www.ogc.org/node/698. ®
[i.4] OGC : "SensorML: Model and XML Encoding Standard".
NOTE: This standard can be found at https://portal.ogc.org/files/?artifact_id=55939.
® ®
[i.5] OCG /W3C : "Semantic Sensor Network Ontology".
NOTE: This standard can be found at https://www.w3.org/TR/vocab-ssn/. ®
[i.6] W3C : "Web of Things (WoT) Architecture 1.1".
NOTE: This standard can be found at https://www.w3.org/TR/2020/WD-wot-architecture11-20201124/.
ETSI
6 ETSI GS ARF 004-3 V1.1.1 (2021-10)
[i.7] ISO/IEC 23093 (all parts): "Information technology - Internet of media things".
NOTE: This standard can be found at https://www.iso.org/search.html?q=23093. ®
[i.8] W3C : "Web of Things (WoT) Thing Description".
NOTE: This standard can be found at https://www.w3.org/TR/wot-thing-description/. ®
[i.9] OGC : "SensorThings API".
NOTE: This standard can be found at http://docs.opengeospatial.org/is/15-078r6/15-078r6.html.
[i.10] W3C®: "Web of Things (WoT) Discovery".
NOTE: This draft standard can be found at https://www.w3.org/TR/wot-discovery/.
[i.11] ISO/IEC 18038:2020: "Information technology - Computer graphics, image processing and
environmental representation - Sensor representation in mixed and augmented reality".
NOTE: This draft standard can be found at https://www.iso.org/standard/70720.html.
[i.12] IEEE 1451™: "Standard for a Smart Transducer Interface for Sensors and Actuators".
NOTE: A tutorial about the family of standards can be found at https://standards.ieee.org/content/dam/ieee-
standards/standards/web/documents/tutorials/1451d4.pdf.
[i.13] ISO/IEC 23093-2 and ISO/IEC 23093-3: "Information technology - Internet of media things -
Part 2: Discovery and communication API" and "Information technology - Internet of media
things - Part 3: Media data formats and APIs".
NOTE: These standards can be found at https://www.iso.org/standard/74332.html and
https://www.iso.org/standard/74333.html.
[i.14] ISO/IEC 23090-5:2021 and ISO/IEC 23090-9: "Information technology -- Coded representation of
immersive media -- Part 5: Visual volumetric video-based coding (V3C) and video-based point cloud
compression (V-PCC)" and "Information technology -- Coded representation of immersive media --
Part 9: Geometry-based point cloud compression".
NOTE: These specifications can be found at https://www.iso.org/standard/73025.html and
https://www.iso.org/standard/78990.html. More information about the MPEG PCC family of
specifications can be found at https://mpeg-pcc.org/.
[i.15] ISO 19130-1 and ISO 19130-2: "Geographic information -- Imagery Sensor Models for
geopositioning -- Part 1: Fundamentals" and "Geographic information -- Imagery sensor models
for geopositioning -- Part 2: SAR, InSAR, lidar and sonar".
NOTE: Available at https://www.iso.org/standard/66847.html and https://www.iso.org/standard/56113.html. ®
[i.16] W3C : "Generic Sensor API".
NOTE: The draft Generic Device Sensor API standard is found at https://www.w3.org/TR/generic-sensor/.
[i.17] Internet of Things standards are discussed in a blog post found at this URL
https://www.postscapes.com/internet-of-things-protocols/.
ETSI
7 ETSI GS ARF 004-3 V1.1.1 (2021-10)
3 Definition of terms, symbols and abbreviations
3.1 Terms
For the purposes of the present document, the following terms apply:
feature: characteristics of a real world element that can be searched, recognized or tracked
NOTE: Features can be of different nature without being limited to visual patterns, UWB, Wi-Fi, Infra Red or
sounds.
reference point: point located at the interface of two non-overlapping functions and representing interrelated
interactions between those functions
3.2 Symbols
Void.
3.3 Abbreviations
For the purposes of the present document, the following abbreviations apply:
API Application Programming Interface
AR Augmented Reality
DAS Devices And Sensors
GPS Global Positioning System
ISG Industry Specification Group
JSON JavaScript Object Notation
MPEG Motion Pictures Experts Group
PCC Point Cloud Compression
RFID Radio Frequency Identifier
RGB Red Green Blue
RGB-D Red Green Blue + Depth
RP Reference Point
SAR Synthetic Aperture Radar
SC SubCommittee
SDO Standard Development Organization
SM Scene Management
SOSA Sensor, Observation, Sample and Actuator
SSN Semantic Sensor Network
SWE Sensor Web Enablement
TEDS Transducer Electronic Data Sheets
UID Unique Identifier
WA World Analysis
WC World Capture
WG Working Group
4 Interoperability Requirements for AR1 and AR2
4.1 AR1 and AR2 Reference Points Scope
AR1 "Sensors for World Analysis" and AR2 "Sensor Data for Scene Management" Reference Points (RP), as specified
in ETSI GS ARF 003 [1] define the dialog structure between the World Capture, World Analysis (WA) and the Scene
Management (SM) functions respectively to ensure that relevant features in the real world which are captured by
sensors are available, received and useable by the WA and SM subfunctions.
ETSI
8 ETSI GS ARF 004-3 V1.1.1 (2021-10)
The AR1 and AR2 are separate Reference Points because they connect two different functions to the World Capture
function, however, their requirements are identical because both the World Analysis and Scene Management use the
World Capture capabilities. They may be implemented together or separately, depending on system requirements and
design.
4.2 High-level requirements
There are three high level requirements. Figure 1 shows how the high level requirements are in sequence.

Figure 1: Sequence of AR1 and AR2 requirements
In clause 6.2 of ETSI GS ARF 003 [1], the requirements of AR1 reference point are defined as:
• Access to sensor capabilities and characteristics:
- Type of sensor (e.g. RGB camera, RGB-D camera, accelerometer, magnetometer, microphone, or GPS).
- Identifier of the sensor provided by the World Capture function.
- Number of devices of similar type.
- Measuring characteristics (e.g. range and resolution, acquisition frequency, conditions of use, or
coverage).
- Information about the extrinsic, intrinsic and distortion parameters of the sensors.
• Control of the sensor:
- Initializing and shutting-down sensors.
- Starting and stopping the access to sensors.
- Setting of identifiers as used by the World Analysis function.
- Setting of measurement characteristics (e.g. ranges, systems of units, resolutions, or acquisition
frequency).
- Switching between sensors.
- Requesting conditions for data delivery to the AR implementation (e.g. event-based, temporal, or
synchronized with other sensors).
• Transfer of captured data:
- Sensor data as e.g. raw data or aggregated or converted data.
- The ID of the sensor which has captured the data.
- Metadata associated to data captured by the sensor.
ETSI
9 ETSI GS ARF 004-3 V1.1.1 (2021-10)
In clause 6.3 of ETSI GS ARF 003 [1], the requirements are defined as:
• Access to sensor capabilities and characteristics:
- Type of sensor (e.g. RGB camera, RGB-D camera, accelerometer, magnetometer, microphone, or GPS).
- Identifier of the sensor provided by the World Capture function.
- Number of devices of similar type.
- Measuring characteristics (e.g. range and resolution, acquisition frequency, conditions of use, or
coverage).
- Information about the extrinsic, intrinsic and distortion parameters of the sensors.
• Control of the sensor:
- Initializing and shutting-down sensors.
- Starting and stopping the access to sensors.
- Setting of identifiers as used by the Scene Management function.
- Setting of measurement characteristics (e.g. ranges, systems of units, resolutions, or acquisition
frequency).
- Switching between sensors.
- Requesting conditions for data delivery to the AR implementation (e.g. event-based, temporal, or
synchronized with other sensors).
• Transfer of captured data:
- Sensor data as e.g. raw data or aggregated or converted data.
- The ID of the sensor which has captured the data.
- Metadata associated to data captured by the sensor.
NOTE 1: Extrinsic parameters can provide the pose of the sensor relatively to reference coordinate systems related
to the AR device, to another sensor, or to the real world.
NOTE 2: The metadata associated to the captured data can be an actual measurement unit or a time stamp for
representing time of data acqu
...