ISO/IEC 23008-2:2015

Information technology - High efficiency coding and media delivery in heterogeneous environments - Part 2: High efficiency video coding

ISO/IEC 23008-2:2015 specifies high efficiency video coding.

Technologies de l'information — Codage à haute efficacité et livraison des medias dans des environnements hétérogènes — Partie 2: Codage vidéo à haute efficacité

General Information

• Status: Withdrawn
• Publication Date: 03-May-2015
• Withdrawal Date: 03-May-2015
• ICS: 35.040 - Information coding
• ICS: 35.040.40 - Coding of audio, video, multimedia and hypermedia information
• Technical Committee: ISO/IEC JTC 1/SC 29 - Coding of audio, picture, multimedia and hypermedia information
• Drafting Committee: ISO/IEC JTC 1/SC 29 - Coding of audio, picture, multimedia and hypermedia information
• Current Stage: 9599 - Withdrawal of International Standard
• Start Date: 09-Oct-2017
• Completion Date: 30-Oct-2025

Relations

• Amended By: ISO/IEC 23008-2:2015/Amd 1:2015 - Information technology - High efficiency coding and media delivery in heterogeneous environments - Part 2: High efficiency video coding - Amendment 1: 3D video extensions
• Effective Date: 26-Nov-2021
• Revised: ISO/IEC 23008-2:2017 - Information technology - High efficiency coding and media delivery in heterogeneous environments - Part 2: High efficiency video coding
• Effective Date: 05-Nov-2015
• Revises: ISO/IEC 23008-2:2013 - Information technology - High efficiency coding and media delivery in heterogeneous environments - Part 2: High efficiency video coding
• Effective Date: 18-Oct-2014

Standards Content (Sample)

INTERNATIONAL ISO/IEC
STANDARD 23008-2
Second edition
2015-05-01
Information technology — High efficiency
coding and media delivery in
heterogeneous environments
Part 2:
High efficiency video coding
Technologies de l'information — Codage à haute efficacité et livraison
des medias dans des environnements hétérogènes —
Partie 2: Codage vidéo à haute efficacité

Reference number
©
ISO/IEC 2015
©  ISO/IEC 2015
All rights reserved. Unless otherwise specified, no part of this publication may be reproduced or utilized otherwise in any form or by any
means, electronic or mechanical, including photocopying, or posting on the internet or an intranet, without prior written permission.
Permission can be requested from either ISO at the address below or ISO’s member body in the country of the requester.
ISO copyright office
Case postale 56  CH-1211 Geneva 20
Tel. + 41 22 749 01 11
Fax + 41 22 749 09 47
E-mail [e-mail]
Web www.iso.org
Published in Switzerland
ii © ISO/IEC 2015 – All rights reserved

CONTENTS
Page
0  Introduction. xvii
0.1  General . xvii
0.2  Prologue . xvii
0.3  Purpose . xvii
0.4  Applications . xvii
0.5  Publication and versions of this Specification . xvii
0.6  Profiles, tiers, and levels . xviii
0.7  Overview of the design characteristics . xviii
0.8  How to read this Specification . xviii
1  Scope . 1
2  Normative references . 1
2.1  General . 1
2.2  Identical Recommendations | International Standards . 1
2.3  Paired Recommendations | International Standards equivalent in technical content . 1
2.4  Additional references . 1
3  Definitions . 1
4  Abbreviations . 10
5  Conventions . 12
5.1  General . 12
5.2  Arithmetic operators . 12
5.3  Logical operators . 12
5.4  Relational operators . 12
5.5  Bit-wise operators . 12
5.6  Assignment operators . 13
5.7  Range notation . 13
5.8  Mathematical functions . 13
5.9  Order of operation precedence . 14
5.10  Variables, syntax elements, and tables . 15
5.11  Text description of logical operations . 15
5.12  Processes . 16
6  Bitstream and picture formats, partitionings, scanning processes, and neighbouring relationships . 17
6.1  Bitstream formats . 17
6.2  Source, decoded, and output picture formats . 17
6.3  Partitioning of pictures, slices, slice segments, tiles, coding tree units, and coding tree blocks . 19
6.3.1  Partitioning of pictures into slices, slice segments, and tiles . 19
6.3.2  Block and quadtree structures . 20
6.3.3  Spatial or component-wise partitionings . 21
6.4  Availability processes . 22
6.4.1  Derivation process for z-scan order block availability . 22
6.4.2  Derivation process for prediction block availability . 22
6.5  Scanning processes . 23
6.5.1  Coding tree block raster and tile scanning conversion process . 23
6.5.2  Z-scan order array initialization process . 24
6.5.3  Up-right diagonal scan order array initialization process . 25
6.5.4  Horizontal scan order array initialization process . 25
6.5.5  Vertical scan order array initialization process . 25
7  Syntax and semantics . 26
7.1  Method of specifying syntax in tabular form . 26
7.2  Specification of syntax functions and descriptors . 27
7.3  Syntax in tabular form . 28
7.3.1  NAL unit syntax . 28
Rec. ITU-T H.265 (2015 E) iii

7.3.1.1  General NAL unit syntax . 28
7.3.1.2  NAL unit header syntax . 29
7.3.2  Raw byte sequence payloads, trailing bits, and byte alignment syntax . 30
7.3.2.1  Video parameter set RBSP syntax . 30
7.3.2.2  Sequence parameter set RBSP syntax . 31
7.3.2.3  Picture parameter set RBSP syntax . 34
7.3.2.4  Supplemental enhancement information RBSP syntax . 36
7.3.2.5  Access unit delimiter RBSP syntax . 36
7.3.2.6  End of sequence RBSP syntax . 36
7.3.2.7  End of bitstream RBSP syntax . 36
7.3.2.8  Filler data RBSP syntax . 36
7.3.2.9  Slice segment layer RBSP syntax . 36
7.3.2.10  RBSP slice segment trailing bits syntax . 37
7.3.2.11  RBSP trailing bits syntax . 37
7.3.2.12  Byte alignment syntax . 37
7.3.3  Profile, tier and level syntax. 38
7.3.4  Scaling list data syntax . 40
7.3.5  Supplemental enhancement information message syntax . 40
7.3.6  Slice segment header syntax . 41
7.3.6.1  General slice segment header syntax . 41
7.3.6.2  Reference picture list modification syntax . 43
7.3.6.3  Weighted prediction parameters syntax . 44
7.3.7  Short-term reference picture set syntax . 45
7.3.8  Slice segment data syntax . 46
7.3.8.1  General slice segment data syntax . 46
7.3.8.2  Coding tree unit syntax . 46
7.3.8.3  Sample adaptive offset syntax . 46
7.3.8.4  Coding quadtree syntax. 48
7.3.8.5  Coding unit syntax . 49
7.3.8.6  Prediction unit syntax . 51
7.3.8.7  PCM sample syntax . 51
7.3.8.8  Transform tree syntax . 52
7.3.8.9  Motion vector difference syntax . 53
7.3.8.10  Transform unit syntax . 54
7.3.8.11  Residual coding syntax . 56
7.3.8.12  Cross-component prediction syntax . 58
7.4  Semantics . 58
7.4.1  General . 58
7.4.2  NAL unit semantics . 58
7.4.2.1  General NAL unit semantics . 58
7.4.2.2  NAL unit header semantics . 59
7.4.2.3  Encapsulation of an SODB within an RBSP (informative) . 62
7.4.2.4  Order of NAL units and association to coded pictures, access units, and coded video sequences . 63
7.4.3  Raw byte sequence payloads, trailing bits, and byte alignment semantics . 66
7.4.3.1  Video parameter set RBSP semantics . 66
7.4.3.2  Sequence parameter set RBSP semantics . 69
7.4.3.3  Picture parameter set RBSP semantics . 75
7.4.3.4  Supplemental enhancement information RBSP semantics . 79
7.4.3.5  Access unit delimiter RBSP semantics . 79
7.4.3.6  End of sequence RBSP semantics . 79
7.4.3.7  End of bitstream RBSP semantics . 80
7.4.3.8  Filler data RBSP semantics . 80
7.4.3.9  Slice segment layer RBSP semantics . 80
7.4.3.10  RBSP slice segment trailing bits semantics . 80
7.4.3.11  RBSP trailing bits semantics . 80
7.4.3.12  Byte alignment semantics . 80
7.4.4  Profile, tier, and level semantics . 80
7.4.5  Scaling list data semantics . 83
7.4.6  Supplemental enhancement information message semantics . 85
7.4.7  Slice segment header semantics . 85
7.4.7.1  General slice segment header semantics . 85
7.4.7.2  Reference picture list modification semantics . 90
7.4.7.3  Weighted prediction parameters semantics . 91
iv Rec. ITU-T H.265 (2015 E)
7.4.8  Short-term reference picture set semantics . 91
7.4.9  Slice segment data semantics . 94
7.4.9.1  General slice segment data semantics . 94
7.4.9.2  Coding tree unit semantics . 94
7.4.9.3  Sample adaptive offset semantics . 94
7.4.9.4  Coding quadtree semantics . 96
7.4.9.5  Coding unit semantics . 96
7.4.9.6  Prediction unit semantics . 98
7.4.9.7  PCM sample semantics . 98
7.4.9.8  Transform tree semantics . 99
7.4.9.9  Motion vector difference semantics . 99
7.4.9.10  Transform unit semantics . 100
7.4.9.11  Residual coding semantics . 101
7.4.9.12  Cross-component prediction semantics . 103
8  Decoding process . 103
8.1  General decoding process . 103
8.1.1  General . 103
8.1.2  CVSG decoding process . 104
8.1.3  Decoding process for a coded picture with nuh_layer_id equal to 0 . 104
8.2  NAL unit decoding process. 105
8.3  Slice decoding process . 105
8.3.1  Decoding process for picture order count . 105
8.3.2  Decoding process for reference picture set . 106
8.3.3  Decoding process for generating unavailable reference pictures . 110
8.3.3.1  General decoding process for generating unavailable reference pictures . 110
8.3.3.2  Generation of one unavailable picture . 111
8.3.4  Decoding process for reference picture lists construction . 111
8.3.5  Decoding process for collocated picture and no backward prediction flag . 112
8.4  Decoding process for coding units coded in intra prediction mode . 112
8.4.1  General decoding process for coding units coded in intra prediction mode . 112
8.4.2  Derivation process for luma intra prediction mode . 113
8.4.3  Derivation process for chroma intra prediction mode . 115
8.4.4  Decoding process for intra blocks . 116
8.4.4.1  General decoding process for intra blocks . 116
8.4.4.2  Intra sample prediction . 118
8.5  Decoding process for coding units coded in inter prediction mode . 124
8.5.1  General decoding process for coding units coded in inter prediction mode . 124
8.5.2  Inter prediction process . 124
8.5.3  Decoding process for prediction units in inter prediction mode . 127
8.5.3.1  General . 127
8.5.3.2  Derivation process for motion vector components and reference indices . 128
8.5.3.3  Decoding process for inter prediction samples . 142
8.5.4  Decoding process for the residual signal of coding units coded in inter prediction mode . 150
8.5.4.1  General . 150
8.5.4.2  Decoding process for luma residual blocks . 151
8.5.4.3  Decoding process for chroma residual blocks . 152
8.6  Scaling, transformation and array construction process prior to deblocking filter process . 153
8.6.1  Derivation process for quantization parameters . 153
8.6.2  Scaling and transformation process . 155
8.6.3  Scaling process for transform coefficients . 156
8.6.4  Transformation process for scaled transform coefficients . 157
8.6.4.1  General . 157
8.6.4.2  Transformation process . 158
8.6.5  Residual modification process for blocks using a transform bypass . 159
8.6.6  Residual modification process for transform blocks using cross-component prediction . 159
8.6.7  Picture construction process prior to in-loop filter process . 160
8.7  In-loop filter process . 160
8.7.1  General . 160
8.7.2  Deblocking filter process . 161
8.7.2.1  General . 161
8.7.2.2  Derivation process of transform block boundary . 162
8.7.2.3  Derivation process of prediction block boundary . 163
Rec. ITU-T H.265 (2015 E) v
8.7.2.4  Derivation process of boundary filtering strength. 164
8.7.2.5  Edge filtering process . 165
8.7.3  Sample adaptive offset process . 173
8.7.3.1  General . 173
8.7.3.2  Coding tree block modification process . 174
9  Parsing process . 175
9.1  General . 175
9.2  Parsing process for 0-th order Exp-Golomb codes . 176
9.2.1  General . 176
9.2.2  Mapping process for signed Exp-Golomb codes . 177
9.3  CABAC parsing process for slice segment data . 178
9.3.1  General . 178
9.3.2  Initialization process . 180
9.3.2.1  General . 180
9.3.2.2  Initialization process for context variables . 181
9.3.2.3  Storage process for context variables and Rice parameter initialization states . 190
9.3.2.4  Synchronization process for context variables and Rice parameter initialization states . 191
9.3.2.5  Initialization process for the arithmetic decoding engine . 191
9.3.3  Binarization process . 192
9.3.3.1  General . 192
9.3.3.2  Truncated Rice (TR) binarization process . 194
9.3.3.3  k-th order Exp-Golomb (EGk) binarization process . 195
9.3.3.4  Limited k-th order Exp-Golomb (EGk) binarization process . 195
9.3.3.5  Fixed-length (FL) binarization process . 196
9.3.3.6  Binarization process for part_mode . 196
9.3.3.7  Binarization process for intra_chroma_pred_mode . 197
9.3.3.8  Binarization process for inter_pred_idc . 197
9.3.3.9  Binarization process for cu_qp_delta_abs . 198
9.3.3.10  Binarization process for coeff_abs_level_remaining[ ] . 198
9.3.4  Decoding process flow . 199
9.3.4.1  General . 199
9.3.4.2  Derivation process for ctxTable, ctxIdx and bypassFlag . 200
9.3.4.3  Arithmetic decoding process . 206
9.3.5  Arithmetic encoding process (informative) . 212
9.3.5.1  General . 212
9.3.5.2  Initialization process for the arithmetic encoding engine (informative) . 212
9.3.5.3  Encoding process for a binary decision (informative) . 213
9.3.5.4  Renormalization process in the arithmetic encoding engine (informative) . 214
9.3.5.5  Bypass encoding process for binary decisions (informative) . 215
9.3.5.6  Encoding process for a binary decision before termination (informative) . 216
9.3.5.7  Byte stuffing process (informative) . 218
10  Sub-bitstream extraction process . 218
Annex A Profiles, tiers and levels . 219
A.1  Overview of profiles, tiers and levels . 219
A.2  Requirements on video decoder capability . 219
A.3  Profiles . 219
A.3.1  General . 219
A.3.2  Main profile . 219
A.3.3  Main 10 profile . 220
A.3.4  Main Still Picture profile . 221
A.3.5  Format range extensions profiles . 222
A.3.6  Format range extensions high throughput profiles . 226
A.4  Tiers and levels . 228
A.4.1  General tier and level limits . 228
A.4.2  Profile-specific level limits for the video profiles . 229
A.4.3  Effect of level limits on picture rate for the video profiles (informative) . 232
Annex B Byte stream format . 236
B.1  General . 236
B.2  Byte stream NAL unit syntax and semantics . 236
B.2.1  Byte stream NAL unit syntax . 236
vi Rec. ITU-T H.265 (2015 E)
B.2.2  Byte stream NAL unit semantics . 236
B.3  Byte stream NAL unit decoding process . 237
B.4  Decoder byte-alignment recovery (informative) . 237
Annex C Hypothetical reference decoder . 238
C.1  General . 238
C.2  Operation of coded picture buffer (CPB) . 242
C.2.1  General . 242
C.2.2  Timing of decoding unit arrival . 242
C.2.3  Timing of decoding unit removal and decoding of decoding unit . 244
C.3  Operation of the decoded picture buffer (DPB) . 246
C.3.1  General . 246
C.3.2  Removal of pictures from the DPB . 247
C.3.3  Picture output . 247
C.3.4  Current decoded picture marking and storage . 248
C.4  Bitstream conformance . 248
C.5  Decoder conformance . 249
C.5.1  General . 249
C.5.2  Operation of the output order DPB . 250
C.5.2.1  General . 250
C.5.2.2  Output and removal of pictures from the DPB . 251
C.5.2.3  Picture decoding, marking, additional bumping, and storage . 251
C.5.2.4  "Bumping" process . 252
Annex D Supplemental enhancement information . 253
D.1  General . 253
D.2  SEI payload syntax . 254
D.2.1  General SEI message syntax . 254
D.2.2  Buffering period SEI message syntax . 257
D.2.3  Picture timing SEI message syntax . 258
D.2.4  Pan-scan rectangle SEI message syntax . 258
D.2.5  Filler payload SEI message syntax . 259
D.2.6  User data registered by Rec. ITU-T T.35 SEI message syntax . 259
D.2.7  User data unregistered SEI message syntax . 259
D.2.8  Recovery point SEI message syntax . 259
D.2.9  Scene information SEI message syntax . 260
D.2.10  Picture snapshot SEI message syntax. 260
D.2.11  Progressive refinement segment start SEI message syntax . 260
D.2.12  Progressive refinement segment end SEI message syntax . 260
D.2.13  Film grain characteristics SEI message syntax . 261
D.2.14  Post-filter hint SEI message syntax . 261
D.2.15  Tone mapping information SEI message syntax . 262
D.2.16  Frame packing arrangement SEI message syntax . 263
D.2.17  Display orientation SEI message syntax . 263
D.2.18  Structure of pictures information SEI message syntax. 264
D.2.19  Decoded picture hash SEI message syntax . 264
D.2.20  Active parameter sets SEI message syntax . 264
D.2.21  Decoding unit information SEI message syntax . 265
D.2.22  Temporal sub-layer zero index SEI message syntax . 265
D.2.23  Scalable nesting SEI message
...