Information technologies — JPEG systems — Part 6: JPEG 360 — Amendment 1: Addition of new JPEG 360 image types and accelerated ROI rendering

Technologies de l'information — Systèmes JPEG — Partie 6: JPEG 360 — Amendement 1: Titre manque

General Information

Status
Published
Publication Date
28-Jun-2021
Current Stage
6060 - International Standard published
Start Date
29-Jun-2021
Due Date
08-May-2022
Completion Date
29-Jun-2021
Ref Project

Relations

Buy Standard

Standard
ISO/IEC 19566-6:2019/Amd 1:2021 - Addition of new JPEG 360 image types and accelerated ROI rendering
English language
19 pages
sale 15% off
Preview
sale 15% off
Preview
Draft
ISO/IEC 19566-6:2019/PRF Amd 1:Version 18-apr-2021 - Addition of new JPEG 360 image types and accelerated ROI rendering
English language
19 pages
sale 15% off
Preview
sale 15% off
Preview

Standards Content (Sample)

INTERNATIONAL ISO/IEC
STANDARD 19566-6
First edition
2019-07
AMENDMENT 1
2021-06
Information technologies — JPEG
systems —
Part 6:
JPEG 360
AMENDMENT 1: Addition of new JPEG
360 image types and accelerated ROI
rendering
Technologies de l'information — Systèmes JPEG JPEG 360 —
Partie 6: JPEG 360
AMENDEMENT 1
Reference number
ISO/IEC 19566-6:2019/Amd.1:2021(E)
©
ISO/IEC 2021

---------------------- Page: 1 ----------------------
ISO/IEC 19566-6:2019/Amd.1:2021(E)

COPYRIGHT PROTECTED DOCUMENT
© ISO/IEC 2021
All rights reserved. Unless otherwise specified, or required in the context of its implementation, no part of this publication may
be reproduced or utilized otherwise in any form or by any means, electronic or mechanical, including photocopying, or posting
on the internet or an intranet, without prior written permission. Permission can be requested from either ISO at the address
below or ISO’s member body in the country of the requester.
ISO copyright office
CP 401 • Ch. de Blandonnet 8
CH-1214 Vernier, Geneva
Phone: +41 22 749 01 11
Email: copyright@iso.org
Website: www.iso.org
Published in Switzerland
ii © ISO/IEC 2021 – All rights reserved

---------------------- Page: 2 ----------------------
ISO/IEC 19566-6:2019/Amd.1:2021(E)

Foreword
ISO (the International Organization for Standardization) and IEC (the International Electrotechnical
Commission) form the specialized system for worldwide standardization. National bodies that are
members of ISO or IEC participate in the development of International Standards through technical
committees established by the respective organization to deal with particular fields of technical
activity. ISO and IEC technical committees collaborate in fields of mutual interest. Other international
organizations, governmental and non-governmental, in liaison with ISO and IEC, also take part in the
work.
The procedures used to develop this document and those intended for its further maintenance are
described in the ISO/IEC Directives, Part 1. In particular, the different approval criteria needed for
the different types of document should be noted. This document was drafted in accordance with the
editorial rules of the ISO/IEC Directives, Part 2 (see www .iso .org/ directives or www .iec .ch/ members
_experts/ refdocs).
Attention is drawn to the possibility that some of the elements of this document may be the subject
of patent rights. ISO and IEC shall not be held responsible for identifying any or all such patent
rights. Details of any patent rights identified during the development of the document will be in the
Introduction and/or on the ISO list of patent declarations received (see www .iso .org/ patents) or the IEC
list of patent declarations received (see patents.iec.ch).
Any trade name used in this document is information given for the convenience of users and does not
constitute an endorsement.
For an explanation of the voluntary nature of standards, the meaning of ISO specific terms and
expressions related to conformity assessment, as well as information about ISO's adherence to the
World Trade Organization (WTO) principles in the Technical Barriers to Trade (TBT), see www .iso .org/
iso/ foreword .html. In the IEC, see www .iec .ch/ understanding -standards.
This document was prepared by Joint Technical Committee ISO/IEC JTC 1, Information technology,
Subcommittee SC 29, Coding of audio, picture, multimedia and hypermedia information.
A list of all parts in the ISO/IEC 19566 series can be found on the ISO and IEC websites.
Any feedback or questions on this document should be directed to the user’s national standards body. A
complete listing of these bodies can be found at www .iso .org/ members .html and www .iec .ch/ national
-committees.
© ISO/IEC 2021 – All rights reserved iii

---------------------- Page: 3 ----------------------
ISO/IEC 19566-6:2019/Amd.1:2021(E)
Information technologies — JPEG systems —
Part 6:
JPEG 360
AMENDMENT 1: Addition of new JPEG 360 image types and
accelerated ROI rendering

3.2
Add the following abbreviations terms:
FOV field of view
URI uniform resource identifier

5.3
Add a new paragraph at the end of clause 5.3 as follows:
In addition, an accelerated viewport rendering to support an efficient and low latency viewport
transmission shall be done as defined in Annex C.

5.4
Renumber subclause 5.4 as 5.5 and add a new subclause 5.4 as follows:
5.4  Stereoscopic 360 image
5.4.1  General
A stereoscopic 360 image is a pair that consists of two images of the same scene or object but a slightly
different angle or perspective for the left and right eye. Each pair should be an image with an ERP
format. This pair is stored in three formats for JPEG 360 in addition to an existing monoscopic format
which provides the only single view.
5.4.2  Stereoscopic formats
The stereoscopic format indicates an arrangement of the left and right images. This subclause defines
three formats for organizing the pair of the stereoscopic 360 images as follows.
— Side-by-side: left- and right-eye images are packed horizontally.
© ISO/IEC 2021 – All rights reserved 1

---------------------- Page: 4 ----------------------
ISO/IEC 19566-6:2019/Amd.1:2021(E)

a) Structure
b) Example of the format
Figure 11 — Side-by-side format
— Top-bottom: left- and right-eye images are packed vertically.
a) Structure b) Example of the format
Figure 12 — Top-bottom format
— Extended: one of the left- and right-eye images is stored in the form of a JPEG image, which contains
the metadata required to construct a stereoscopic scene. The metadata includes information that
identifies the location of the remaining image in both eyes. Figure 13 shows an example of the
extended format. Although this example shows the right-eye image is contained in the same JPEG
image file, the right-eye image may be referenced externally as a different JPEG image file, as per
ISO/IEC 19566-5.
2 © ISO/IEC 2021 – All rights reserved

---------------------- Page: 5 ----------------------
ISO/IEC 19566-6:2019/Amd.1:2021(E)

Figure 13 — Example of the extended format
5.4.3   Viewport definition in the stereo vision model
Key
a centre of the baseline f sphere
b left eye g left 360-degree image
c right eye h viewport mapped on the left image
d baseline i viewport mapped on the right image
e viewport j right 360-degree image
Figure 14 — Viewport definition in the stereo vision model
Figure 14 illustrates the stereo vision model used for stereoscopic 360 images and how a viewport is
organized. The viewport is a rectangular sub-region of the sphere specified by the FOV span values
from the centre of the sphere that is supposed to be the centre of the two eyes in the model.
In this model, P, which is a point on the sphere with Cartesian coordinate, is mapped on to the left
and right images, P and P , differently depending on the configuration of the capture devices. This
L R
© ISO/IEC 2021 – All rights reserved 3

---------------------- Page: 6 ----------------------
ISO/IEC 19566-6:2019/Amd.1:2021(E)

allows the human visual system to perceive the point P more realistically when left and right images
are projected on both eyes, respectively. In this case, the viewports for both eyes are not necessarily
defined for the left and right eyes separately but can be defined by the viewing direction from the centre
of both eyes. Therefore, the viewport is specified by the FOV span values at the centre of the sphere that
is considered as the centre of the two eyes in the model.
5.4.4   Compatible with a conventional 360 image viewer
An interaction modality, such as a head-mounted display, is able to present a stereoscopic scene while
a conventional 360 image viewer may parse only monoscopic JPEG 360 image and present a viewport.
However, when the conventional viewer loads the stereoscopic JPEG 360 image file, it is possible
to extract the left- or right-eye image from the file based on the metadata embedded in the file then
present it to the viewer.
Furthermore, when the stereoscopic JPEG 360 image is an extended format, the conventional viewer will
display one of the left- and right-eye images without additional processing. This follows the backward
compatible mechanism, as described in subclause 5.2, which allows that an image is decoded when the
file is opened by conventional JPEG viewing applications.

6.1
Change the number of Figure 11 to 15.

B.2
Replace the meaning of the BoxReference in Table B.1 with the following:
Refers to a label for either a JUMBF Codestream Content Type box or a JUMBF Embedded File Content
Type box, as per ISO/IEC 19566-5.

B.7
Replace the XMP expression with the following:

 
  
         xmlns:xmp="http://ns.adobe.com/xap/1.0/"
     xmlns:umf="http://ns.intel.com/umf/2.0">
    0
    
     
      
       
       JPEG360Metadata
        
         
          
           JPEG360ImageMetadata
           
            
             
              JPEG360Version
              integer
             
             
              MediaType
              string
             
4 © ISO/IEC 2021 – All rights reserved

---------------------- Page: 7 ----------------------
ISO/IEC 19566-6:2019/Amd.1:2021(E)

             
              ProjectionType
              string
             
             
              PhiMin
              real
             
             
              PhiMax
              real
             
             
              ThetaMax
              real
             
             
              ThetaMin
              real
             
             
              PhiGravity
              real
             
             
              ThetaGravity
              real
             
             
              CompassPhi
              real
             
             
              BoxReference
              string
             
            
           
          
          
           JPEG360ViewportMetadata
           
            
             
              JPEG360ViewportNumber
              integer
             
             
              ViewportPhi
              real
             
             
              ViewportTheta
              real
             
             
              ViewportPhiFOV
              real
             
             
              ViewportThetaFOV
              real
             
             
              ViewportRoll
              real
             
            
           
          
         
© ISO/IEC 2021 – All rights reserved 5

---------------------- Page: 8 ----------------------
ISO/IEC 19566-6:2019/Amd.1:2021(E)

        
       
      
     

     
     
      
       JPEG360Metadata
       
       
      
     
    

   
  

 


B.9
Replace the XMP expression with the following:

 
  
      xmlns:xmp="http://ns.adobe.com/xap/1.0/" mlns:umf="http://ns.intel.com/umf/2.0">
   3
   
    
    
    
     JPEG360Metadata
     
      
       
        JPEG360ImageMetadata
         
          
           
            JPEG360Version
            integer
           
           
            MediaType
            string
           
           
            ProjectionType
            string
           
           
            PhiMin
            real
           
           
            PhiMax
            real
           
           
            ThetaMax
            real
           
           
            ThetaMin
            real
           
6 © ISO/IEC 2021 – All rights reserved

---------------------- Page: 9 ----------------------
ISO/IEC 19566-6:2019/Amd.1:2021(E)

           
            PhiGravity
            real
           
           
            ThetaGravity
            real
           
           
            CompassPhi
            real
           
           
            BoxReference
            string
           
          
         
        
        
         JPEG360ViewportMetadata
         
          
           
            JPEG360ViewportNumber
            integer
           
           
            ViewportPhi
            real
           
           
            ViewportTheta
            real
           
           
            ViewportPhiFOV
            real
           
           
            ViewportThetaFOV
            real
           
           
            ViewportRoll
             real
           
          
         
        
       
      
     
    
   

   
    
     
      JPEG360Metadata
       
        
         
          JPEG360ImageMetadata
          
           
            
             3
             
              
               
© ISO/IEC 2021 – All rights reserved 7

---------------------- Page: 10 ----------------------
ISO/IEC 19566-6:2019/Amd.1:2021(E)

                1
                JPEG360Version
               
               
                 image/jpeg
                MediaType
               
                Equirectangular
                ProjectionType
               
                -180
                PhiMin
               
                180
                PhiMax
               
                90
                ThetaMax

...

INTERNATIONAL ISO/IEC
STANDARD 19566-6
First edition
2019-07
AMENDMENT 1
Information technologies — JPEG
systems —
Part 6:
JPEG 360
AMENDMENT 1: Addition of new JPEG
360 image types and accelerated ROI
rendering
Technologies de l'information — Systèmes JPEG JPEG 360 —
Partie 6: JPEG 360
AMENDEMENT 1: .
PROOF/ÉPREUVE
Reference number
ISO/IEC 19566-6:2019/Amd.1:2021(E)
©
ISO/IEC 2021

---------------------- Page: 1 ----------------------
ISO/IEC 19566-6:2019/Amd.1:2021(E)

COPYRIGHT PROTECTED DOCUMENT
© ISO/IEC 2021
All rights reserved. Unless otherwise specified, or required in the context of its implementation, no part of this publication may
be reproduced or utilized otherwise in any form or by any means, electronic or mechanical, including photocopying, or posting
on the internet or an intranet, without prior written permission. Permission can be requested from either ISO at the address
below or ISO’s member body in the country of the requester.
ISO copyright office
CP 401 • Ch. de Blandonnet 8
CH-1214 Vernier, Geneva
Phone: +41 22 749 01 11
Email: copyright@iso.org
Website: www.iso.org
Published in Switzerland
ii PROOF/ÉPREUVE © ISO/IEC 2021 – All rights reserved

---------------------- Page: 2 ----------------------
ISO/IEC 19566-6:2019/Amd.1:2021(E)

Foreword
ISO (the International Organization for Standardization) and IEC (the International Electrotechnical
Commission) form the specialized system for worldwide standardization. National bodies that are
members of ISO or IEC participate in the development of International Standards through technical
committees established by the respective organization to deal with particular fields of technical
activity. ISO and IEC technical committees collaborate in fields of mutual interest. Other international
organizations, governmental and non-governmental, in liaison with ISO and IEC, also take part in the
work.
The procedures used to develop this document and those intended for its further maintenance are
described in the ISO/IEC Directives, Part 1. In particular, the different approval criteria needed for
the different types of document should be noted. This document was drafted in accordance with the
editorial rules of the ISO/IEC Directives, Part 2 (see www .iso .org/ directives or www .iec .ch/ members
_experts/ refdocs).
Attention is drawn to the possibility that some of the elements of this document may be the subject
of patent rights. ISO and IEC shall not be held responsible for identifying any or all such patent
rights. Details of any patent rights identified during the development of the document will be in the
Introduction and/or on the ISO list of patent declarations received (see www .iso .org/ patents) or the IEC
list of patent declarations received (see https:// patents .iec .ch).
Any trade name used in this document is information given for the convenience of users and does not
constitute an endorsement.
For an explanation of the voluntary nature of standards, the meaning of ISO specific terms and
expressions related to conformity assessment, as well as information about ISO's adherence to the
World Trade Organization (WTO) principles in the Technical Barriers to Trade (TBT), see www .iso .org/
iso/ foreword .html. In the IEC, see www .iec .ch/ understanding -standards.
This document was prepared by Joint Technical Committee ISO/IEC JTC 1, Information technology,
Subcommittee SC 29, Coding of audio, picture, multimedia and hypermedia information.
A list of all parts in the ISO/IEC 19566 series can be found on the ISO and IEC websites.
Any feedback or questions on this document should be directed to the user’s national standards body. A
complete listing of these bodies can be found at www .iso .org/ members .html and www .iec .ch/ national
-committees.
© ISO/IEC 2021 – All rights reserved PROOF/ÉPREUVE iii

---------------------- Page: 3 ----------------------
ISO/IEC 19566-6:2019/Amd.1:2021(E)
Information technologies — JPEG systems —
Part 6:
JPEG 360
AMENDMENT 1: Addition of new JPEG 360 image types and
accelerated ROI rendering

3.2
Add the following abbreviations terms:
FOV field of view
URI uniform resource identifier

5.3
Add a new paragraph at the end of clause 5.3 as follows:
In addition, an accelerated viewport rendering to support an efficient and low latency viewport
transmission shall be done as defined in Annex C.

5.4
Renumber subclause 5.4 as 5.5 and add a new subclause 5.4 as follows:
5.4  Stereoscopic 360 image
5.4.1  General
A stereoscopic 360 image is a pair that consists of two images of the same scene or object but a slightly
different angle or perspective for the left and right eye. Each pair should be an image with an ERP
format. This pair is stored in three formats for JPEG 360 in addition to an existing monoscopic format
which provides the only single view.
5.4.2  Stereoscopic formats
The stereoscopic format indicates an arrangement of the left and right images. This subclause defines
three formats for organizing the pair of the stereoscopic 360 images as follows.
— Side-by-side: left- and right-eye images are packed horizontally.
© ISO/IEC 2021 – All rights reserved PROOF/ÉPREUVE 1

---------------------- Page: 4 ----------------------
ISO/IEC 19566-6:2019/Amd.1:2021(E)

a) Structure
b) Example of the format
Figure 11 — Side-by-side format
— Top-bottom: left- and right-eye images are packed vertically.
a) Structure b) Example of the format
Figure 12 — Top-bottom format
— Extended: one of the left- and right-eye images is stored in the form of a JPEG image, which contains
the metadata required to construct a stereoscopic scene. The metadata includes information that
identifies the location of the remaining image in both eyes. Figure 13 shows an example of the
extended format. Although this example shows the right-eye image is contained in the same JPEG
image file, the right-eye image may be referenced externally as a different JPEG image file, as per
ISO/IEC 19566-5.
2 PROOF/ÉPREUVE © ISO/IEC 2021 – All rights reserved

---------------------- Page: 5 ----------------------
ISO/IEC 19566-6:2019/Amd.1:2021(E)

Figure 13 — Example of the extended format
5.4.3   Viewport definition in the stereo vision model
Key
a f
Center of the baseline. Sphere.
b g
Left eye. Left 360-degree image.
c h
Right eye. Viewport mapped on the left image.
d i
Baseline. Viewport mapped on the right image.
e j
Viewport. Right 360-degree image.
Figure 14 — Viewport definition in the stereo vision model
Figure 14 illustrates the stereo vision model used for stereoscopic 360 images and how a viewport is
organized. The viewport is a rectangular sub-region of the sphere specified by the FOV span values
from the centre of the sphere that is supposed to be the centre of the two eyes in the model.
In this model, P, which is a point on the sphere with Cartesian coordinate, is mapped on to the left
and right images, P and P , differently depending on the configuration of the capture devices. This
L R
© ISO/IEC 2021 – All rights reserved PROOF/ÉPREUVE 3

---------------------- Page: 6 ----------------------
ISO/IEC 19566-6:2019/Amd.1:2021(E)

allows the human visual system to perceive the point P more realistically when left and right images
are projected on both eyes, respectively. In this case, the viewports for both eyes are not necessarily
defined for the left and right eyes separately but can be defined by the viewing direction from the centre
of both eyes. Therefore, the viewport is specified by the FOV span values at the centre of the sphere that
is considered as the centre of the two eyes in the model.
5.4.4   Compatible with a conventional 360 image viewer
An interaction modality, such as a head-mounted display, is able to present a stereoscopic scene while
a conventional 360 image viewer may parse only monoscopic JPEG 360 image and present a viewport.
However, when the conventional viewer loads the stereoscopic JPEG 360 image file, it is possible
to extract the left- or right-eye image from the file based on the metadata embedded in the file then
present it to the viewer.
Furthermore, when the stereoscopic JPEG 360 image is an extended format, the conventional viewer will
display one of the left- and right-eye images without additional processing. This follows the backward
compatible mechanism, as described in subclause 5.2, which allows that an image is decoded when the
file is opened by conventional JPEG viewing applications.

6.1
Change the number of Figure 11 to 15.

B.2
Replace the meaning of the BoxReference in Table B.1 with the following:
Refers to a label for either a JUMBF Codestream Content Type box or a JUMBF Embedded File Content
Type box, as per ISO/IEC 19566-5.

B.7
Replace the XMP expression with the following:

 
  
         xmlns:xmp="http://ns.adobe.com/xap/1.0/"
     xmlns:umf="http://ns.intel.com/umf/2.0">
    0
    
     
      
       
       JPEG360Metadata
        
         
          
           JPEG360ImageMetadata
           
            
             
              JPEG360Version
              integer
             
             
              MediaType
              string
             
4 PROOF/ÉPREUVE © ISO/IEC 2021 – All rights reserved

---------------------- Page: 7 ----------------------
ISO/IEC 19566-6:2019/Amd.1:2021(E)

             
              ProjectionType
              string
             
             
              PhiMin
              real
             
             
              PhiMax
              real
             
             
              ThetaMax
              real
             
             
              ThetaMin
              real
             
             
              PhiGravity
              real
             
             
              ThetaGravity
              real
             
             
              CompassPhi
              real
             
             
              BoxReference
              string
             
            
           
          
          
           JPEG360ViewportMetadata
           
            
             
              JPEG360ViewportNumber
              integer
             
             
              ViewportPhi
              real
             
             
              ViewportTheta
              real
             
             
              ViewportPhiFOV
              real
             
             
              ViewportThetaFOV
              real
             
             
              ViewportRoll
              real
             
            
           
          
         
© ISO/IEC 2021 – All rights reserved PROOF/ÉPREUVE 5

---------------------- Page: 8 ----------------------
ISO/IEC 19566-6:2019/Amd.1:2021(E)

        
       
      
     

     
     
      
       JPEG360Metadata
       
       
      
     
    

   
  

 


B.9
Replace the XMP expression with the following:

 
  
      xmlns:xmp="http://ns.adobe.com/xap/1.0/" mlns:umf="http://ns.intel.com/umf/2.0">
   3
   
    
    
    
     JPEG360Metadata
     
      
       
        JPEG360ImageMetadata
         
          
           
            JPEG360Version
            integer
           
           
            MediaType
            string
           
           
            ProjectionType
            string
           
           
            PhiMin
            real
           
           
            PhiMax
            real
           
           
            ThetaMax
            real
           
           
            ThetaMin
            real
           
6 PROOF/ÉPREUVE © ISO/IEC 2021 – All rights reserved

---------------------- Page: 9 ----------------------
ISO/IEC 19566-6:2019/Amd.1:2021(E)

           
            PhiGravity
            real
           
           
            ThetaGravity
            real
           
           
            CompassPhi
            real
           
           
            BoxReference
            string
           
          
         
        
        
         JPEG360ViewportMetadata
         
          
           
            JPEG360ViewportNumber
            integer
           
           
            ViewportPhi
            real
           
           
            ViewportTheta
            real
           
           
            ViewportPhiFOV
            real
           
           
            ViewportThetaFOV
            real
           
           
            ViewportRoll
             real
           
          
         
        
       
      
     
    
   

   
    
     
      JPEG360Metadata
       
        
         
          JPEG360ImageMetadata
          
           
            
             3
             
              
               
© ISO/IEC 2021 – All rights reserved PROOF/ÉPREUVE 7

---------------------- Page: 10 ----------------------
ISO/IEC 19566-6:2019/Amd.1:2021(E)

                1
                JPEG360Version
               
               
                 image/jpeg
                MediaType
               
                Equirectangular
                ProjectionType
               
                -180
                PhiMin
               
                180
                PhiMax
               
                90
                ThetaMax
               
                 ...

Questions, Comments and Discussion

Ask us and Technical Secretary will try to provide an answer. You can facilitate discussion about the standard in here.