ISO/IEC 15938-5:2003/Amd 4:2012

Information technology — Multimedia content description interface — Part 5: Multimedia description schemes — Amendment 4: Social metadata

Technologies de l'information — Interface de description du contenu multimédia — Partie 5: Schémas de description multimédia — Amendement 4: Métadonnées sociales

General Information

• Status: Published
• Publication Date: 27-Sep-2012
• ICS: 35.040 - Information coding
• ICS: 35.040.40 - Coding of audio, video, multimedia and hypermedia information
• Technical Committee: ISO/IEC JTC 1/SC 29 - Coding of audio, picture, multimedia and hypermedia information
• Drafting Committee: ISO/IEC JTC 1/SC 29 - Coding of audio, picture, multimedia and hypermedia information
• Current Stage: 6060 - International Standard published
• Start Date: 28-Sep-2012
• Due Date: 29-May-2015
• Completion Date: 29-May-2015

Relations

• Amends: ISO/IEC 15938-5:2003 - Information technology — Multimedia content description interface — Part 5: Multimedia description schemes
• Effective Date: 31-Jul-2021

Overview

ISO/IEC 15938-5:2003/Amd 4:2012 is an international standard amendment focused on the description of social metadata within multimedia content description interfaces. Developed by ISO and IEC Joint Technical Committee JTC 1/SC 29, this amendment expands the MPEG-7 framework (Multimedia Content Description Interface) to include not only traditional multimedia metadata but also crucial social context, including user profiles, social relations, and collaborative content reviews. The goal is to facilitate interoperability, efficient content management, and enhanced user experiences in today's multimedia-rich and socially-networked environments.

Key Topics

Social Metadata Extension

• UserProfile DS: Describes individuals' profiles with elements such as public identifiers, personal descriptions, timezone, primary language, affiliations, social relations, and personal interests.
• Relations and Affiliations: Specifies classification schemes for social roles, affiliations (e.g., employer, educational institution), and personal relations (e.g., parent, friend, spouse).
• Personal Interests: Captures user activities, interests, and favorites, supporting richer recommendations and personalization.
• Instant Messaging Integration: Allows inclusion of instant messaging screen names linked with specific services for broader communication context.

Collaborative Media Review

• MediaReviewDescriptionType: Defines structures for annotating collaborative reviews and ratings of multimedia resources, supporting both individual and aggregated review types.
  • Free-text reviews, content tagging, quality assessment, and trust/identity ratings are included.
  • Aggregation: Support for summarizing multiple reviews over defined periods, providing consensus ratings and feedback.

Content Management Types

• Enriches standard content management schema with:
  • UserDescriptionType (user metadata)
  • MediaDescriptionType (media info)
  • CreationDescriptionType (origin details)
  • UsageDescriptionType (consumption history)
  • ClassificationSchemeDescriptionType (taxonomies)
• Enables comprehensive management, search, and retrieval strategies based on both content and user/social metadata.

Applications

The inclusion of social metadata transforms the practical value of multimedia description schemes in numerous fields:

• Social Networking Platforms: Enables the encoding of user interests, social connections, and personalized metadata, supporting enhanced friend/network recommendations and privacy-aware sharing.
• Collaborative Content Platforms: Standardizes the capture and aggregation of user reviews and content ratings, improving trust and content discovery.
• Media Asset Management: Facilitates robust tracking and retrieval of content based on both intrinsic metadata and user/community interactions.
• Personalized Search and Recommendation: Improves recommendation engines by enabling algorithms to leverage structured user interests and social connections.
• Content Authenticity and Anti-Piracy: The identity rating mechanism helps to flag fake or misattributed content, supporting content integrity.
• Cultural and Educational Repositories: Offers advanced indexing by social context, affiliations, and personal interest for better educational outreach.

Related Standards

• ISO/IEC 15938-1 through ISO/IEC 15938-7: Series covering the entire MPEG-7 Multimedia Content Description Interface, including schema specification, visual and audio descriptors, and reference software.
• ISO 8601: Standard referenced for timezone representations within user profiles.
• MPEG-7 Controlled Vocabularies: Such as AddressRoleCS, AffiliationRoleCS, RelationRoleCS, MediaRatingSchemeCS, and IdentityRatingSchemeCS for consistent metadata interpretation.
• Other metadata and content management standards: Including Dublin Core and XMP, which can be integrated with MPEG-7 social metadata for broader interoperability.

---

Keywords: ISO/IEC 15938-5, MPEG-7, social metadata, multimedia description schemes, collaborative content review, user profile, media rating, content management, multimedia standard, controlled vocabularies, social networking metadata.

Standards Content (Sample)

INTERNATIONAL ISO/IEC
STANDARD 15938-5
First edition
2003-05-15
AMENDMENT 4
2012-10-01
Information technology — Multimedia
content description interface —
Part 5:
Multimedia description schemes
AMENDMENT 4: Social metadata
Technologies de l'information — Interface de description du contenu
multimédia —
Partie 5: Schémas de description multimédia
AMENDEMENT 4: Métadonnées sociales

Reference number
ISO/IEC 15938-5:2003/Amd.4:2012(E)
©
ISO/IEC 2012
ISO/IEC 15938-5:2003/Amd.4:2012(E)

©  ISO/IEC 2012
All rights reserved. Unless otherwise specified, no part of this publication may be reproduced or utilized in any form or by any means,
electronic or mechanical, including photocopying and microfilm, without permission in writing from either ISO at the address below or
ISO's member body in the country of the requester.
ISO copyright office
Case postale 56  CH-1211 Geneva 20
Tel. + 41 22 749 01 11
Fax + 41 22 749 09 47
E-mail [e-mail]
Web www.iso.org
Published in Switzerland
ii © ISO/IEC 2012 – All rights reserved

ISO/IEC 15938-5:2003/Amd.4:2012(E)
Foreword
ISO (the International Organization for Standardization) and IEC (the International Electrotechnical
Commission) form the specialized system for worldwide standardization. National bodies that are members of
ISO or IEC participate in the development of International Standards through technical committees
established by the respective organization to deal with particular fields of technical activity. ISO and IEC
technical committees collaborate in fields of mutual interest. Other international organizations, governmental
and non-governmental, in liaison with ISO and IEC, also take part in the work. In the field of information
technology, ISO and IEC have established a joint technical committee, ISO/IEC JTC 1.
International Standards are drafted in accordance with the rules given in the ISO/IEC Directives, Part 2.
The main task of the joint technical committee is to prepare International Standards. Draft International
Standards adopted by the joint technical committee are circulated to national bodies for voting. Publication as
an International Standard requires approval by at least 75 % of the national bodies casting a vote.
Attention is drawn to the possibility that some of the elements of this document may be the subject of patent
rights. ISO and IEC shall not be held responsible for identifying any or all such patent rights.
Amendment 4 to ISO/IEC 15938-5:2003 was prepared by Joint Technical Committee ISO/IEC JTC 1,
Information technology, Subcommittee SC 29, Coding of audio, picture, multimedia and hypermedia
information.
This Amendment provides means for describing a person beyond the context of the Person DS. The
description especially targets the annotation of a person's interests in the context of social networking
platforms as well as the collaborative review and rating of media entities.

© ISO/IEC 2012 – All rights reserved iii

FINAL DRAFT AMENDMENT ISO/IEC 15938-5:2003/Amd.4:2012(E)

Information technology — Multimedia content description
interface —
Part 5:
Multimedia description schemes
AMENDMENT 4: Social metadata
In 4.4.1, replace the entire text of the subclause with the following text:
4.4.1 Introduction
This subclause specifies the top-level types. The top-level types are used in complete descriptions to describe
multimedia content and metadata related to content management. Each top-level type contains the description
tools that are relevant for a particular description task, i.e., describing an image or a video. The following
top-level types are defined in this subclause:
 CompleteDescriptionType (abstract): top-level type for complete descriptions.
o ContentDescriptionType (abstract): top-level type for complete descriptions of
multimedia content.
 ContentEntityType: top-level type for describing multimedia content entities such
as images, videos, audio, collections, and so forth.
 ContentAbstractionType (abstract): top-level type for describing abstractions of
multimedia content:
 SemanticDescriptionType: top-level type for describing semantics of
multimedia content.
 ModelDescriptionType: top-level type for describing models of multimedia
content.
 SummaryDescriptionType: top-level type for describing summaries of
multimedia content.
 ViewDescriptionType: top-level type for describing views and view
decompositions of audio-visual signals.
 VariationDescriptionType: top-level type for describing variations of
multimedia content.
o ContentManagementType (abstract): top-level type for describing metadata related to
content management:
 UserDescriptionType: top-level type for describing a user of a multimedia system.
© ISO/IEC 2012 – All rights reserved 1

ISO/IEC 15938-5:2003/Amd.4:2012(E)
 MediaDescriptionType: top-level type for describing the media information of
multimedia content.
 CreationDescriptionType: top-level type for describing the process of creating
multimedia content.
 UsageDescriptionType: top-level type for describing the usage of multimedia
content.
 ClassificationSchemeDescriptionType: top-level type for describing a
classification scheme for multimedia content.
 MediaReviewDescriptionType (abstract): top-level type for describing
collaborative media review and rating:
 IndividualMediaReviewDescriptionType: top-level type for describing
a review conducted by a single entity.
 AggregatedMediaReviewDescriptionType: top-level type for describing
a review that has been aggregated from several individual (or aggregated)
reviews.
The top-level types are organized under the type hierarchy shown in Figure 3. The
CompleteDescriptionType forms the root base type of the hierarchy. The top-level types
ContentDescriptionType and ContentManagementType extend CompleteDescriptionType. The
top-level types ContentEntityType and ContentAbstractionType extend
CompleteDescriptionType.
2 © ISO/IEC 2012 – All rights reserved

ISO/IEC 15938-5:2003/Amd.4:2012(E)
Complete
Description
(abstract)
Content Content
Description Management
(abstract) (abstract)
UserDescription MediaDescription
Content Content CreationDescription UsageDescription
Entity Abstraction
(abstract)
ClassificationSchemeDes. MediaReviewDescription
Audio-Visual content:  - SemanticDescription  - IndividualMediaReviewDes.
- Image  - ModelDescription  - AggregatedMediaReviewDes.
- Video  - SummaryDescription
- Audio  - ViewDescription
- AudioVisual  - VariationDescription
- MixedContent
- ContentCollection
Figure 3 — Illustration of the type derivation hierarchy for top-level types

In 4.4.4.2, replace schema definition by the following Schema text:
















minOccurs="0" maxOccurs="unbounded"/>
maxOccurs="unbounded"/>
© ISO/IEC 2012 – All rights reserved 3

ISO/IEC 15938-5:2003/Amd.4:2012(E)









maxOccurs="unbounded"/>









maxOccurs="unbounded"/>









maxOccurs="unbounded"/>









type="mpeg7:ClassificationSchemeType" maxOccurs="unbounded"/>
type="mpeg7:ClassificationSchemeBaseType" maxOccurs="unbounded"/>










4 © ISO/IEC 2012 – All rights reserved

ISO/IEC 15938-5:2003/Amd.4:2012(E)

maxOccurs="unbounded"/>
maxOccurs="unbounded"/>

maxOccurs="unbounded"/>





















maxOccurs="unbounded"/>





At the end of 4.4.4.3, add the following:
Semantics of the MediaReviewDescriptionType:
Name Definition
MediaReviewDescriptionType Top-level type for describing collaborative media review and rating.
MediaReviewDescriptionType extends
ContentManagementType.
ContentRef Reference to the content or identifier of the content that is
reviewed.
Tags Free text descriptive keywords about the content.
FreeTextReview Textual reviews of the content.
© ISO/IEC 2012 – All rights reserved 5

ISO/IEC 15938-5:2003/Amd.4:2012(E)
Name Definition
MediaRating
Rating of the media content (i.e., how much the User likes the
media content). RatingType is defined in 8.2.6.
Terms for the RatingScheme of the media rating are specified by
the MediaRatingSchemeCS.
IdentityRating Rating that indicates whether the content is the actual content it
should be (i.e., to mark fakes). RatingType is defined in 8.2.6.
Terms for the RatingScheme of the identity rating are specified by
the IdentityRatingSchemeCS.
QualityRating
Rating of the media quality of the content. MediaQualityType is
defined in 8.2.6.
The terms defined in the QualityRatingSchemeCS can be used
in the RatingScheme.
reviewTime Date and time when the review was conducted.

Semantics of the IndividualMediaReviewDescriptionType:
Name Definition
IndividualMediaReviewDescriptionType
Top-level type for a review conducted by a single
entity.
IndividualMediaReviewDescriptionType
extends MediaReviewDescriptionType.
Reviewer
Entity that performed the review. AgentType is
defined in 7.5.2.
Note: the RatingSource of the QualityRating should
not differ from the Reviewer.
ReviewerRef Reference to the entity that performed the review.
Note: the RatingSource of the QualityRating should
not differ from the ReviewerRef.

Semantics of the AggregatedMediaReviewDescriptionType:
Name Definition
AggregatedMediaReviewDescriptionType Top-level type for a review that has been aggregated
from several individual (or aggregated) reviews.
AggregatedMediaReviewDescriptionType
extends MediaReviewDescriptionType.
ObservationPeriod
Time period in which all individual reviews that this
6 © ISO/IEC 2012 – All rights reserved

ISO/IEC 15938-5:2003/Amd.4:2012(E)
Name Definition
aggregated review aggregates where conducted.
ReviewCount Number of all individual reviews that this aggregated
review aggregates.
At the end of 4.4.4.4, add the following:
The following example shows the use of the content management type MediaReviewDescriptionType for
describing media review information for an individual media review and for an aggregated media review.




0
href="urn:mpeg:mpeg7:cs:IdentityRatingSchemeCS:2012:1">
Identity




40.05
href="urn:mpeg:mpeg7:cs:QualityRatingSchemeCS:2001:2.3">
PSNR Y







Nice movie, but the end was quite sad.
Best movie I have seen in years.

4.5
href="urn:mpeg:mpeg7:cs:MediaRatingSchemeCS:2012:1">
Five-Star



2011-12-01T00:00:00
P1D

42


© ISO/IEC 2012 – All rights reserved 7

ISO/IEC 15938-5:2003/Amd.4:2012(E)
After 7.5.7,add 7.5.8:
7.5.8 UserProfile DS
7.5.8.1 Introduction
The UserProfile DS provides means for describing a person beyond the context of the Person DS. The
description especially targets the annotation of a person's interests in the context of social networking
platforms.
7.5.8.2 UserProfile DS syntax