Information technologies — JPEG systems — Part 6: JPEG 360 — Amendment 1: Addition of new JPEG 360 image types and accelerated ROI rendering

Technologies de l'information — Systèmes JPEG — Partie 6: JPEG 360 — Amendement 1: Titre manque

General Information

Status
Published
Publication Date
28-Jun-2021
Current Stage
6060 - International Standard published
Start Date
29-Jun-2021
Completion Date
29-Jun-2021
Ref Project

RELATIONS

Buy Standard

Standard
ISO/IEC 19566-6:2019/Amd 1:2021 - Addition of new JPEG 360 image types and accelerated ROI rendering
English language
19 pages
sale 15% off
Preview
sale 15% off
Preview
Draft
ISO/IEC 19566-6:2019/PRF Amd 1:Version 18-apr-2021 - Addition of new JPEG 360 image types and accelerated ROI rendering
English language
19 pages
sale 15% off
Preview
sale 15% off
Preview

Standards Content (sample)

INTERNATIONAL ISO/IEC
STANDARD 19566-6
First edition
2019-07
AMENDMENT 1
2021-06
Information technologies — JPEG
systems —
Part 6:
JPEG 360
AMENDMENT 1: Addition of new JPEG
360 image types and accelerated ROI
rendering
Technologies de l'information — Systèmes JPEG JPEG 360 —
Partie 6: JPEG 360
AMENDEMENT 1
Reference number
ISO/IEC 19566-6:2019/Amd.1:2021(E)
ISO/IEC 2021
---------------------- Page: 1 ----------------------
ISO/IEC 19566-6:2019/Amd.1:2021(E)
COPYRIGHT PROTECTED DOCUMENT
© ISO/IEC 2021

All rights reserved. Unless otherwise specified, or required in the context of its implementation, no part of this publication may

be reproduced or utilized otherwise in any form or by any means, electronic or mechanical, including photocopying, or posting

on the internet or an intranet, without prior written permission. Permission can be requested from either ISO at the address

below or ISO’s member body in the country of the requester.
ISO copyright office
CP 401 • Ch. de Blandonnet 8
CH-1214 Vernier, Geneva
Phone: +41 22 749 01 11
Email: copyright@iso.org
Website: www.iso.org
Published in Switzerland
ii © ISO/IEC 2021 – All rights reserved
---------------------- Page: 2 ----------------------
ISO/IEC 19566-6:2019/Amd.1:2021(E)
Foreword

ISO (the International Organization for Standardization) and IEC (the International Electrotechnical

Commission) form the specialized system for worldwide standardization. National bodies that are

members of ISO or IEC participate in the development of International Standards through technical

committees established by the respective organization to deal with particular fields of technical

activity. ISO and IEC technical committees collaborate in fields of mutual interest. Other international

organizations, governmental and non-governmental, in liaison with ISO and IEC, also take part in the

work.

The procedures used to develop this document and those intended for its further maintenance are

described in the ISO/IEC Directives, Part 1. In particular, the different approval criteria needed for

the different types of document should be noted. This document was drafted in accordance with the

editorial rules of the ISO/IEC Directives, Part 2 (see www .iso .org/ directives or www .iec .ch/ members

_experts/ refdocs).

Attention is drawn to the possibility that some of the elements of this document may be the subject

of patent rights. ISO and IEC shall not be held responsible for identifying any or all such patent

rights. Details of any patent rights identified during the development of the document will be in the

Introduction and/or on the ISO list of patent declarations received (see www .iso .org/ patents) or the IEC

list of patent declarations received (see patents.iec.ch).

Any trade name used in this document is information given for the convenience of users and does not

constitute an endorsement.

For an explanation of the voluntary nature of standards, the meaning of ISO specific terms and

expressions related to conformity assessment, as well as information about ISO's adherence to the

World Trade Organization (WTO) principles in the Technical Barriers to Trade (TBT), see www .iso .org/

iso/ foreword .html. In the IEC, see www .iec .ch/ understanding -standards.

This document was prepared by Joint Technical Committee ISO/IEC JTC 1, Information technology,

Subcommittee SC 29, Coding of audio, picture, multimedia and hypermedia information.

A list of all parts in the ISO/IEC 19566 series can be found on the ISO and IEC websites.

Any feedback or questions on this document should be directed to the user’s national standards body. A

complete listing of these bodies can be found at www .iso .org/ members .html and www .iec .ch/ national

-committees.
© ISO/IEC 2021 – All rights reserved iii
---------------------- Page: 3 ----------------------
ISO/IEC 19566-6:2019/Amd.1:2021(E)
Information technologies — JPEG systems —
Part 6:
JPEG 360
AMENDMENT 1: Addition of new JPEG 360 image types and
accelerated ROI rendering
3.2
Add the following abbreviations terms:
FOV field of view
URI uniform resource identifier
5.3
Add a new paragraph at the end of clause 5.3 as follows:

In addition, an accelerated viewport rendering to support an efficient and low latency viewport

transmission shall be done as defined in Annex C.
5.4
Renumber subclause 5.4 as 5.5 and add a new subclause 5.4 as follows:
5.4 Stereoscopic 360 image
5.4.1 General

A stereoscopic 360 image is a pair that consists of two images of the same scene or object but a slightly

different angle or perspective for the left and right eye. Each pair should be an image with an ERP

format. This pair is stored in three formats for JPEG 360 in addition to an existing monoscopic format

which provides the only single view.
5.4.2 Stereoscopic formats

The stereoscopic format indicates an arrangement of the left and right images. This subclause defines

three formats for organizing the pair of the stereoscopic 360 images as follows.
— Side-by-side: left- and right-eye images are packed horizontally.
© ISO/IEC 2021 – All rights reserved 1
---------------------- Page: 4 ----------------------
ISO/IEC 19566-6:2019/Amd.1:2021(E)
a) Structure
b) Example of the format
Figure 11 — Side-by-side format
— Top-bottom: left- and right-eye images are packed vertically.
a) Structure b) Example of the format
Figure 12 — Top-bottom format

— Extended: one of the left- and right-eye images is stored in the form of a JPEG image, which contains

the metadata required to construct a stereoscopic scene. The metadata includes information that

identifies the location of the remaining image in both eyes. Figure 13 shows an example of the

extended format. Although this example shows the right-eye image is contained in the same JPEG

image file, the right-eye image may be referenced externally as a different JPEG image file, as per

ISO/IEC 19566-5.
2 © ISO/IEC 2021 – All rights reserved
---------------------- Page: 5 ----------------------
ISO/IEC 19566-6:2019/Amd.1:2021(E)
Figure 13 — Example of the extended format
5.4.3   Viewport definition in the stereo vision model
Key
a centre of the baseline f sphere
b left eye g left 360-degree image
c right eye h viewport mapped on the left image
d baseline i viewport mapped on the right image
e viewport j right 360-degree image
Figure 14 — Viewport definition in the stereo vision model

Figure 14 illustrates the stereo vision model used for stereoscopic 360 images and how a viewport is

organized. The viewport is a rectangular sub-region of the sphere specified by the FOV span values

from the centre of the sphere that is supposed to be the centre of the two eyes in the model.

In this model, P, which is a point on the sphere with Cartesian coordinate, is mapped on to the left

and right images, P and P , differently depending on the configuration of the capture devices. This

L R
© ISO/IEC 2021 – All rights reserved 3
---------------------- Page: 6 ----------------------
ISO/IEC 19566-6:2019/Amd.1:2021(E)

allows the human visual system to perceive the point P more realistically when left and right images

are projected on both eyes, respectively. In this case, the viewports for both eyes are not necessarily

defined for the left and right eyes separately but can be defined by the viewing direction from the centre

of both eyes. Therefore, the viewport is specified by the FOV span values at the centre of the sphere that

is considered as the centre of the two eyes in the model.
5.4.4   Compatible with a conventional 360 image viewer

An interaction modality, such as a head-mounted display, is able to present a stereoscopic scene while

a conventional 360 image viewer may parse only monoscopic JPEG 360 image and present a viewport.

However, when the conventional viewer loads the stereoscopic JPEG 360 image file, it is possible

to extract the left- or right-eye image from the file based on the metadata embedded in the file then

present it to the viewer.

Furthermore, when the stereoscopic JPEG 360 image is an extended format, the conventional viewer will

display one of the left- and right-eye images without additional processing. This follows the backward

compatible mechanism, as described in subclause 5.2, which allows that an image is decoded when the

file is opened by conventional JPEG viewing applications.
6.1
Change the number of Figure 11 to 15.
B.2
Replace the meaning of the BoxReference in Table B.1 with the following:

Refers to a label for either a JUMBF Codestream Content Type box or a JUMBF Embedded File Content

Type box, as per ISO/IEC 19566-5.
B.7
Replace the XMP expression with the following:



xmlns:xmp="http://ns.adobe.com/xap/1.0/"
xmlns:umf="http://ns.intel.com/umf/2.0">
0




JPEG360Metadata



JPEG360ImageMetadata



JPEG360Version
integer


MediaType
string

4 © ISO/IEC 2021 – All rights reserved
---------------------- Page: 7 ----------------------
ISO/IEC 19566-6:2019/Amd.1:2021(E)

ProjectionType
string


PhiMin
real


PhiMax
real


ThetaMax
real


ThetaMin
real


PhiGravity
real


ThetaGravity
real


CompassPhi
real


BoxReference
string





JPEG360ViewportMetadata



JPEG360ViewportNumber
integer


ViewportPhi
real


ViewportTheta
real


ViewportPhiFOV
real


ViewportThetaFOV
real


ViewportRoll
real





© ISO/IEC 2021 – All rights reserved 5
---------------------- Page: 8 ----------------------
ISO/IEC 19566-6:2019/Amd.1:2021(E)







JPEG360Metadata









B.9
Replace the XMP expression with the following:



xmlns:xmp="http://ns.adobe.com/xap/1.0/" mlns:umf="http://ns.intel.com/umf/2.0">

3




JPEG360Metadata



JPEG360ImageMetadata



JPEG360Version
integer


MediaType
string


ProjectionType
string


PhiMin
real


PhiMax
real


ThetaMax
real


ThetaMin
real

6 © ISO/IEC 2021 – All rights reserved
---------------------- Page: 9 ----------------------
ISO/IEC 19566-6:2019/Amd.1:2021(E)

PhiGravity
real


ThetaGravity
real


CompassPhi
real


BoxReference
string





JPEG360ViewportMetadata



JPEG360ViewportNumber
integer


ViewportPhi
real


ViewportTheta
real


ViewportPhiFOV
real


ViewportThetaFOV
real


ViewportRoll
real












JPEG360Metadata



JPEG360ImageMetadata



3



© ISO/IEC 2021 – All rights reserved 7
---------------------- Page: 10 ----------------------
ISO/IEC 19566-6:2019/Amd.1:2021(E)
1
JPEG360Version


image/jpeg
MediaType

Equirectangular
ProjectionType

-180
PhiMin

180
PhiMax

90
ThetaMax
...

INTERNATIONAL ISO/IEC
STANDARD 19566-6
First edition
2019-07
AMENDMENT 1
Information technologies — JPEG
systems —
Part 6:
JPEG 360
AMENDMENT 1: Addition of new JPEG
360 image types and accelerated ROI
rendering
Technologies de l'information — Systèmes JPEG JPEG 360 —
Partie 6: JPEG 360
AMENDEMENT 1: .
PROOF/ÉPREUVE
Reference number
ISO/IEC 19566-6:2019/Amd.1:2021(E)
ISO/IEC 2021
---------------------- Page: 1 ----------------------
ISO/IEC 19566-6:2019/Amd.1:2021(E)
COPYRIGHT PROTECTED DOCUMENT
© ISO/IEC 2021

All rights reserved. Unless otherwise specified, or required in the context of its implementation, no part of this publication may

be reproduced or utilized otherwise in any form or by any means, electronic or mechanical, including photocopying, or posting

on the internet or an intranet, without prior written permission. Permission can be requested from either ISO at the address

below or ISO’s member body in the country of the requester.
ISO copyright office
CP 401 • Ch. de Blandonnet 8
CH-1214 Vernier, Geneva
Phone: +41 22 749 01 11
Email: copyright@iso.org
Website: www.iso.org
Published in Switzerland
ii PROOF/ÉPREUVE © ISO/IEC 2021 – All rights reserved
---------------------- Page: 2 ----------------------
ISO/IEC 19566-6:2019/Amd.1:2021(E)
Foreword

ISO (the International Organization for Standardization) and IEC (the International Electrotechnical

Commission) form the specialized system for worldwide standardization. National bodies that are

members of ISO or IEC participate in the development of International Standards through technical

committees established by the respective organization to deal with particular fields of technical

activity. ISO and IEC technical committees collaborate in fields of mutual interest. Other international

organizations, governmental and non-governmental, in liaison with ISO and IEC, also take part in the

work.

The procedures used to develop this document and those intended for its further maintenance are

described in the ISO/IEC Directives, Part 1. In particular, the different approval criteria needed for

the different types of document should be noted. This document was drafted in accordance with the

editorial rules of the ISO/IEC Directives, Part 2 (see www .iso .org/ directives or www .iec .ch/ members

_experts/ refdocs).

Attention is drawn to the possibility that some of the elements of this document may be the subject

of patent rights. ISO and IEC shall not be held responsible for identifying any or all such patent

rights. Details of any patent rights identified during the development of the document will be in the

Introduction and/or on the ISO list of patent declarations received (see www .iso .org/ patents) or the IEC

list of patent declarations received (see https:// patents .iec .ch).

Any trade name used in this document is information given for the convenience of users and does not

constitute an endorsement.

For an explanation of the voluntary nature of standards, the meaning of ISO specific terms and

expressions related to conformity assessment, as well as information about ISO's adherence to the

World Trade Organization (WTO) principles in the Technical Barriers to Trade (TBT), see www .iso .org/

iso/ foreword .html. In the IEC, see www .iec .ch/ understanding -standards.

This document was prepared by Joint Technical Committee ISO/IEC JTC 1, Information technology,

Subcommittee SC 29, Coding of audio, picture, multimedia and hypermedia information.

A list of all parts in the ISO/IEC 19566 series can be found on the ISO and IEC websites.

Any feedback or questions on this document should be directed to the user’s national standards body. A

complete listing of these bodies can be found at www .iso .org/ members .html and www .iec .ch/ national

-committees.
© ISO/IEC 2021 – All rights reserved PROOF/ÉPREUVE iii
---------------------- Page: 3 ----------------------
ISO/IEC 19566-6:2019/Amd.1:2021(E)
Information technologies — JPEG systems —
Part 6:
JPEG 360
AMENDMENT 1: Addition of new JPEG 360 image types and
accelerated ROI rendering
3.2
Add the following abbreviations terms:
FOV field of view
URI uniform resource identifier
5.3
Add a new paragraph at the end of clause 5.3 as follows:

In addition, an accelerated viewport rendering to support an efficient and low latency viewport

transmission shall be done as defined in Annex C.
5.4
Renumber subclause 5.4 as 5.5 and add a new subclause 5.4 as follows:
5.4 Stereoscopic 360 image
5.4.1 General

A stereoscopic 360 image is a pair that consists of two images of the same scene or object but a slightly

different angle or perspective for the left and right eye. Each pair should be an image with an ERP

format. This pair is stored in three formats for JPEG 360 in addition to an existing monoscopic format

which provides the only single view.
5.4.2 Stereoscopic formats

The stereoscopic format indicates an arrangement of the left and right images. This subclause defines

three formats for organizing the pair of the stereoscopic 360 images as follows.
— Side-by-side: left- and right-eye images are packed horizontally.
© ISO/IEC 2021 – All rights reserved PROOF/ÉPREUVE 1
---------------------- Page: 4 ----------------------
ISO/IEC 19566-6:2019/Amd.1:2021(E)
a) Structure
b) Example of the format
Figure 11 — Side-by-side format
— Top-bottom: left- and right-eye images are packed vertically.
a) Structure b) Example of the format
Figure 12 — Top-bottom format

— Extended: one of the left- and right-eye images is stored in the form of a JPEG image, which contains

the metadata required to construct a stereoscopic scene. The metadata includes information that

identifies the location of the remaining image in both eyes. Figure 13 shows an example of the

extended format. Although this example shows the right-eye image is contained in the same JPEG

image file, the right-eye image may be referenced externally as a different JPEG image file, as per

ISO/IEC 19566-5.
2 PROOF/ÉPREUVE © ISO/IEC 2021 – All rights reserved
---------------------- Page: 5 ----------------------
ISO/IEC 19566-6:2019/Amd.1:2021(E)
Figure 13 — Example of the extended format
5.4.3   Viewport definition in the stereo vision model
Key
a f
Center of the baseline. Sphere.
b g
Left eye. Left 360-degree image.
c h
Right eye. Viewport mapped on the left image.
d i
Baseline. Viewport mapped on the right image.
e j
Viewport. Right 360-degree image.
Figure 14 — Viewport definition in the stereo vision model

Figure 14 illustrates the stereo vision model used for stereoscopic 360 images and how a viewport is

organized. The viewport is a rectangular sub-region of the sphere specified by the FOV span values

from the centre of the sphere that is supposed to be the centre of the two eyes in the model.

In this model, P, which is a point on the sphere with Cartesian coordinate, is mapped on to the left

and right images, P and P , differently depending on the configuration of the capture devices. This

L R
© ISO/IEC 2021 – All rights reserved PROOF/ÉPREUVE 3
---------------------- Page: 6 ----------------------
ISO/IEC 19566-6:2019/Amd.1:2021(E)

allows the human visual system to perceive the point P more realistically when left and right images

are projected on both eyes, respectively. In this case, the viewports for both eyes are not necessarily

defined for the left and right eyes separately but can be defined by the viewing direction from the centre

of both eyes. Therefore, the viewport is specified by the FOV span values at the centre of the sphere that

is considered as the centre of the two eyes in the model.
5.4.4   Compatible with a conventional 360 image viewer

An interaction modality, such as a head-mounted display, is able to present a stereoscopic scene while

a conventional 360 image viewer may parse only monoscopic JPEG 360 image and present a viewport.

However, when the conventional viewer loads the stereoscopic JPEG 360 image file, it is possible

to extract the left- or right-eye image from the file based on the metadata embedded in the file then

present it to the viewer.

Furthermore, when the stereoscopic JPEG 360 image is an extended format, the conventional viewer will

display one of the left- and right-eye images without additional processing. This follows the backward

compatible mechanism, as described in subclause 5.2, which allows that an image is decoded when the

file is opened by conventional JPEG viewing applications.
6.1
Change the number of Figure 11 to 15.
B.2
Replace the meaning of the BoxReference in Table B.1 with the following:

Refers to a label for either a JUMBF Codestream Content Type box or a JUMBF Embedded File Content

Type box, as per ISO/IEC 19566-5.
B.7
Replace the XMP expression with the following:



xmlns:xmp="http://ns.adobe.com/xap/1.0/"
xmlns:umf="http://ns.intel.com/umf/2.0">
0




JPEG360Metadata



JPEG360ImageMetadata



JPEG360Version
integer


MediaType
string

4 PROOF/ÉPREUVE © ISO/IEC 2021 – All rights reserved
---------------------- Page: 7 ----------------------
ISO/IEC 19566-6:2019/Amd.1:2021(E)

ProjectionType
string


PhiMin
real


PhiMax
real


ThetaMax
real


ThetaMin
real


PhiGravity
real


ThetaGravity
real


CompassPhi
real


BoxReference
string





JPEG360ViewportMetadata



JPEG360ViewportNumber
integer


ViewportPhi
real


ViewportTheta
real


ViewportPhiFOV
real


ViewportThetaFOV
real


ViewportRoll
real





© ISO/IEC 2021 – All rights reserved PROOF/ÉPREUVE 5
---------------------- Page: 8 ----------------------
ISO/IEC 19566-6:2019/Amd.1:2021(E)







JPEG360Metadata









B.9
Replace the XMP expression with the following:



xmlns:xmp="http://ns.adobe.com/xap/1.0/" mlns:umf="http://ns.intel.com/umf/2.0">

3




JPEG360Metadata



JPEG360ImageMetadata



JPEG360Version
integer


MediaType
string


ProjectionType
string


PhiMin
real


PhiMax
real


ThetaMax
real


ThetaMin
real

6 PROOF/ÉPREUVE © ISO/IEC 2021 – All rights reserved
---------------------- Page: 9 ----------------------
ISO/IEC 19566-6:2019/Amd.1:2021(E)

PhiGravity
real


ThetaGravity
real


CompassPhi
real


BoxReference
string





JPEG360ViewportMetadata



JPEG360ViewportNumber
integer


ViewportPhi
real


ViewportTheta
real


ViewportPhiFOV
real


ViewportThetaFOV
real


ViewportRoll
real












JPEG360Metadata



JPEG360ImageMetadata



3



© ISO/IEC 2021 – All rights reserved PROOF/ÉPREUVE 7
---------------------- Page: 10 ----------------------
ISO/IEC 19566-6:2019/Amd.1:2021(E)
1
JPEG360Version


image/jpeg
MediaType

Equirectangular
ProjectionType

-180
PhiMin

180
PhiMax

90
ThetaMax

...

Questions, Comments and Discussion

Ask us and Technical Secretary will try to provide an answer. You can facilitate discussion about the standard in here.