ETSI SR 002 959 V1.1.1 (2011-08)

Electronic Working Tools; Roadmap including recommendations for the deployment and usage of electronic working tools in the ETSI standardization process

DSR/BOARD-00010

General Information

• Status: Published
• Publication Date: 31-Jul-2011
• Technical Committee: BOARD - Board
• Current Stage: 12 - Completion
• Due Date: 05-Aug-2011
• Completion Date: 01-Aug-2011

Standards Content (Sample)

Special Report
Electronic Working Tools;
Roadmap including recommendations for the deployment and
usage of electronic working tools
in the ETSI standardization process

2 ETSI SR 002 959 V1.1.1 (2011-08)

Reference
DSR/BOARD-00010
Keywords
audio, environment, quality, video
ETSI
650 Route des Lucioles
F-06921 Sophia Antipolis Cedex - FRANCE

Tel.: [phone]  Fax: [phone]
Siret N° 348 623 562 00017 - NAF 742 C
Association à but non lucratif enregistrée à la
Sous-Préfecture de Grasse (06) N° 7803/88

Important notice
Individual copies of the present document can be downloaded from:
http://www.etsi.org
The present document may be made available in more than one electronic version or in print. In any case of existing or
perceived difference in contents between such versions, the reference version is the Portable Document Format (PDF).
In case of dispute, the reference shall be the printing on ETSI printers of the PDF version kept on a specific network drive
within ETSI Secretariat.
Users of the present document should be aware that the document may be subject to revision or change of status.
Information on the current status of this and other ETSI documents is available at
http://portal.etsi.org/tb/status/status.asp
If you find errors in the present document, please send your comment to one of the following services:
http://portal.etsi.org/chaircor/ETSI_support.asp
Copyright Notification
No part may be reproduced except as authorized by written permission.
The copyright and the foregoing restriction extend to reproduction in all media.

© European Telecommunications Standards Institute 2011.
All rights reserved.
TM TM TM
DECT , PLUGTESTS , UMTS and the ETSI logo are Trade Marks of ETSI registered for the benefit of its Members.
TM
3GPP and LTE™ are Trade Marks of ETSI registered for the benefit of its Members and
of the 3GPP Organizational Partners.
GSM® and the GSM logo are Trade Marks registered and owned by the GSM Association.
ETSI
3 ETSI SR 002 959 V1.1.1 (2011-08)
Contents
Intellectual Property Rights . 5
Foreword . 5
Introduction . 5
1 Scope . 6
2 References . 6
2.1 Normative references . 6
2.2 Informative references . 6
3 Definitions and abbreviations . 7
3.1 Definitions . 7
3.2 Abbreviations . 8
4 Electronic working tools and their usage in the standardization work . 8
4.1 Electronic working tools . 9
4.1.1 Telephone conference . 9
4.1.1.1 Terminal equipment (for speech) . 9
4.1.1.2 Conference bridges/MCU . 9
4.1.1.3 Multimedia terminal equipments (for speech + video) . 9
4.1.2 Desktop Sharing . 10
4.2 Guidelines. 10
4.2.1 General . 10
4.2.2 Schedule a meeting . 10
4.2.3 Planning of the agenda for an electronic meeting . 10
4.2.3.1 Rough planning of the agenda for an electronic meeting . 10
4.2.3.2 Detailed planning of the agenda for an electronic meeting . 10
4.2.4 Meetings spanning over different time zones . 11
4.2.4.1 General . 11
4.2.4.2 Meetings with participants from North America and Europe . 11
4.2.4.3 Meetings with participants from Europe and Asia . 11
4.2.4.4 Meetings with participants from North America, Europe and Asia . 11
4.2.5 Duration of meetings . 12
4.2.6 Desktop sharing . 12
4.2.7 Hosting of standardization meetings . 12
4.2.8 Costs for participants . 12
5 Deployment roadmap for collaborative tools . 12
5.1 Introduction . 12
5.2 Step 1: Audio . 13
5.2.1 Guidelines . 13
5.2.2 Performance criteria . 13
5.2.3 Timescales for introduction . 13
5.2.4 Measured/estimated improvement . 14
5.3 Step 2: Desktop sharing . 14
5.3.1 Performance criteria . 14
5.3.2 Timescales for introduction . 14
5.3.3 Measured/estimated improvement . 14
5.4 Step 3: Desktop sharing plus only one participant on video . 14
5.4.1 Performance criteria . 14
5.4.2 Timescales for introduction . 14
5.4.3 Measured/estimated improvement . 15
5.5 Step 4: Desktop sharing plus multiple participants on video . 15
5.5.1 Performance criteria . 15
5.5.2 Timescales for introduction . 15
5.5.3 Measured/estimated improvement . 15
5.6 Step 5: Full videoconference - telepresence . 15
5.6.1 Performance criteria . 15
ETSI
4 ETSI SR 002 959 V1.1.1 (2011-08)
5.6.2 Timescales for introduction . 15
5.6.3 Measured/estimated improvement . 16
Annex A: Questionnaires for Quality of Remote meetings . 17
A.1 Overall opinion about the quality during the meeting . 17
A.1.1 What is your overall opinion about the quality of the tools provided by the meeting's system? . 17
A.1.2 Effort required to follow and participate to the discussions . 17
A.1.3 Connection (speech quality) you have just been using . 17
A.1.4 "How would you assess the sound quality of the other participants voices?" . 17
A.1.5 "How well did you understand what the other participants were saying ?". 18
A.1.6 "What level of effort did you need to understand what the other participants were saying ?" . 18
A.1.7 "How would you assess your level of effort to converse back and forth during the conversation?" . 18
A.1.8 "Did you detect Impairments?" . 18
A.1.9 "If yes, how annoying was it?" . 18
A.1.10 "How would you qualify the communication?" . 19
A.1.11 "Did you experience any echo?" . 19
A.1.12 "How would you judge the degradation from echo of your own voice?" . 19
A.2 Questions about the connection . 19
A.2.1 What kind of speech connection did you use? . 19
A.2.2 "Did you or the other participants have any difficulty in talking or hearing over the connection? . 20
A.2.3 How did you find the voices of the other participants? . 20
A.2.4 "If there was noise on the connection, how annoying was it?" . 20
A.3 Information on the meeting system . 20
A.4 Questions related to the user's overall impression of the system . 20
A.5 Other questions on the usage of electronic tools . 21
A.5.1 Prior to the meeting: - Electronic meeting arrangements: How was the Information about the meeting
arrange ment s? . 21
A.5.2 During the meeting . 21
A.5.3 After meeting . 21
Annex B: Additional elements to be taken into account . 22
B.1 Different types of equipment . 22
B.2 Lip synchronisation . 22
B.3 Speech bandwidth . 23
B.4 "Chat" . 23
B.5 Room acoustics and electroacoustic equipment positioning . 23
B.6 User experience . 24
Annex C: Bibliography . 25
C.1 For speech terminals . 25
C.2 User related QoS . 25
C.3 Speech quality (subjective assessment) . 25
C.4 Multimedia quality (subjective assessment) . 26
C.5 Audiovisual QoS for communication over IP networks . 26
History . 27

ETSI
5 ETSI SR 002 959 V1.1.1 (2011-08)
Intellectual Property Rights
IPRs essential or potentially essential to the present document may have been declared to ETSI. The information
pertaining to these essential IPRs, if any, is publicly available for ETSI members and non-members, and can be found
in ETSI SR 000 314: "Intellectual Property Rights (IPRs); Essential, or potentially Essential, IPRs notified to ETSI in
respect of ETSI standards", which is available from the ETSI Secretariat. Latest updates are available on the ETSI Web
server (http://ipr.etsi.org).
Pursuant to the ETSI IPR Policy, no investigation, including IPR searches, has been carried out by ETSI. No guarantee
can be given as to the existence of other IPRs not referenced in ETSI SR 000 314 (or the updates on the ETSI Web
server) which are, or may be, or may become, essential to the present document.
Foreword
This Special Report (SR) has been produced by the ETSI Board GREEN AGENDA strategic topic group.
Introduction
The present document describes high level guidance for the use of electronic working tools considering performance,
privacy and security with a phased introduction of the collaboration tools necessary for effective remote participation in
ETSI. The present document also takes into account the time zone differences to ensure the maximum participation of
members to electronic meetings.
ETSI
6 ETSI SR 002 959 V1.1.1 (2011-08)
1 Scope
The present document describes electronic working tools, and a roadmap for their implementation including guidelines
for the deployment and usage in the ETSI standardization process.
Annexes provide additional information on questionnaires to be completed by the users of these tools, concerning
technical issues and standards that could help manufacturers to develop such tools.
2 References
References are either specific (identified by date of publication and/or edition number or version number) or
non-specific. For specific references, only the cited version applies. For non-specific references, the latest version of the
reference document (including any amendments) applies.
Referenced documents which are not found to be publicly available in the expected location might be found at
http://docbox.etsi.org/Reference.
NOTE: While any hyperlinks included in this clause were valid at the time of publication, ETSI cannot guarantee
their long term validity.
2.1 Normative references
The following referenced documents are necessary for the application of the present document.
Not applicable.
2.2 Informative references
The following referenced documents are not necessary for the application of the present document but they assist the
user with regard to a particular subject area.
[i.1] EBU Recommendation R37-2007: "The relative timing of the sound and vision components of a
television signal".
Speech Terminals
[i.2] ETSI ES 202 740: "Speech and multimedia Transmission Quality (STQ);Transmission
requirements for wideband VoIP loudspeaking and handsfree terminals from a QoS perspective as
perceived by the user" .
[i.3] ETSI ES 202 739: "Speech and multimedia Transmission Quality (STQ);Transmission
requirements for wideband VoIP terminals (handset and headset) from a QoS perspective as
perceived by the user" .
[i.4] ETSI ES 202 738: "Speech and multimedia Transmission Quality (STQ);Transmission
requirements for narrowband VoIP loudspeaking and handsfree terminals from a QoS perspective
as perceived by the user" .
[i.5] ETSI ES 202 737: "Speech and multimedia Transmission Quality (STQ);Transmission
requirements for narrowband VoIP terminals (handset and headset) from a QoS perspective as
perceived by the user".
QoS and network performance metrics and measurement methods
[i.6] ETSI ES 202 765-2: "Speech and multimedia Transmission Quality (STQ); QoS and network
performance metrics and measurement methods; Part 2 : Transmission Quality Indicator
combining Voice Quality Metrics".
ETSI
7 ETSI SR 002 959 V1.1.1 (2011-08)
[i.7] ETSI ES 202 765-4: "Speech and multimedia Transmission Quality (STQ); QoS and network
performance metrics and measurement methods; Part 4: Indicators for supervision of Multiplay
services".
Specification and measurement of speech transmission quality
[i.8] ETSI EG 201 377-1: "Speech and multimedia Transmission Quality (STQ); Specification and
measurement of speech transmission quality; Part 1: Introduction to objective comparison
measurement methods for one-way speech quality across networks".
[i.9] ETSI ES 201 377-2: "Speech and multimediaTransmission Quality (STQ); Specification and
measurement of speech transmission quality; Part 2: Mouth-to-ear speech transmission quality
including terminals".
[i.10] ETSI EG 201 377-3: "Speech Processing, Transmission and Quality Aspects (STQ); Specification
and measurement of speech transmission quality; Part 3 : Non-intrusive objective measurement
methods applicable to networks and links with classes of services".
Audiovisual QoS for communication over IP networks
[i.11] ETSI ES 202 667: "Speech and multimedia Transmission Quality (STQ); Audiovisual QoS for
communication over IP networks".
[i.12] ITU-R Recommendation BT.1359-1: "Relative timing of sound and vision for broadcasting".
[i.13] ETSI ETS 300 807: "Integrated Services Digital Network (ISDN); Audio characteristics of
terminals designed to support conference services in the ISDN".
3 Definitions and abbreviations
3.1 Definitions
For the purposes of the present document, the following terms and definitions apply:
blog: type of website or part of a website
NOTE: Blogs are usually maintained by an individual with regular entries of commentary, descriptions of events,
or other material such as graphics or video. Entries are commonly displayed in reverse-chronological
order.
chairman/leader: person who manages the meeting and has the responsibility of drafting the agenda and production of
the report
chat: any kind of communication over the Internet, but is primarily meant to refer to direct one-on-one chat or
text-based group chat (formally also known as synchronous conferencing), using tools such as instant messengers,
Internet Relay Chat, talkers and possibly Multi-User Domains (MUD)s
NOTE: The expression online chat comes from the word chat which means "informal conversation".
co-located participants: participants located in the same room
conferencing terminals: terminals to be used by co-located participants
desktop sharing: common name for technologies and products that allow remote access and remote collaboration on a
person's computer desktop through a graphical terminal emulator.
NOTE: Desktop sharing, when used in conjunction with other components of multimedia communications such
as audio and video, creates the notion of virtual space where people can meet, socialize and work
together.
electronic mail: most commonly abbreviated to email or e-mail, is a method of exchanging digital messages
ETSI
8 ETSI SR 002 959 V1.1.1 (2011-08)
host of a physical meeting: when an electronic meeting is organized with co-located participants, the host of the
physical meeting has to ensure that the relevant conferencing terminals are available in the room
NOTE: The host also has to ensure that the necessary bandwidth is provided.
organizer: person in charge of the registration to electronic meetings, of the information of the potential participants
(prior to the meeting) and in charge of the availability of the electronic tools
remote access: access to a meeting through an electronic tool
remote collaboration: opportunity given to participants to be fully involved through an electronic tool
NOTE: This means that all the participants are able to listen, to talk and to exchange comments on shared
documents
remote participants: participants to a meeting through an electronic tool
secretary: person who has similar roles as in a normal physical meeting as a secretary
wiki: website that allows the easy creation and editing of any number of interlinked web pages via a web browser using
a simplified markup language or a WYSIWYG text editor
NOTE: Wikis are typically powered by wiki software and are often used to create collaborative websites, to
power community websites, for personal note taking, in corporate intranets, and in knowledge
management systems.
3.2 Abbreviations
For the purposes of the present document, the following abbreviations apply:
MCU Multipoint Control Unit
MUD Multi-User Domains
VoIP Voice over Internet Protocol
4 Electronic working tools and their usage in the
standardization work
Several kinds of electronic tools may be used.
Some of them are to be used in real-time and simultaneously by the participants, others do not need the participants to
be connected simultaneously.
The priority should be given, as far as possible, by ETSI to the provision and use of open and standardized tools. These
tools should avoid as much as possible any intrusion on the Personal computers of the participants. Privacy, security
and access for all should be also major criteria to be taken into account.
The ETSI STF 354 website contains guidelines derived from the main known empirical user test results when user
experience has been examined for one or more technical parameter. The user experience of an electronic working tool
can be expected to vary according to many characteristics of the users, their communication purpose, the
communication situation and technical parameters of the communication service. This information is available at:
http://portal.etsi.org/stfs/STF_HomePages/STF354/.
Detailed information on these guidelines are available in annex B.
ETSI
9 ETSI SR 002 959 V1.1.1 (2011-08)
4.1 Electronic working tools
As indicated in the introduction, different types of electronic working tools may be used depending on the types of
participations planned:
Case 1: If all the participants are located in different physical locations and are using individual tools,
these tools are mainly implemented on Personal Computers and are using the interfaces available
on the Personal Computer(or that may be connected to the PC, e.g. headsets) and may be
associated to phone terminals and conference bridges.
Case 2: If some participants are located in one meeting room, the other participants are using individual
tools, special attention should be paid to the equipment in the meeting room: all the participants in
the meeting room should be close to the microphones to avoid impairment from background noises
and room reverberation. The number of loudspeakers and their locations should be implemented to
ensure the best hearing to the local participants and to avoid any howling. The distant users will
use equipment similar to case 1. Note that in certain cases (e.g. remote participation to workshops)
muting of distant participants will be done during the presentations.
Case 3: When several groups of participants are located in different locations using group tools,
telepresence systems could be used.
4.1.1 Telephone conference
Telephone conference, used alone, or in conjunction with screen sharing is a very powerful tool as long as the speech
quality is good enough for all the participants.
4.1.1.1 Terminal equipment (for speech)
The participants to electronic meetings may use different types of terminal equipment. The quality provided by this
terminal equipment may have a strong impact on the quality.
References [i.2], [i.3], [i.4] and [i.5] provide requirements for speech terminals providing good speech quality.
Wider speech bandwidth may also improve the quality and, in particular, the intelligibility and the naturalness of the
participants speeches.
The different types of terminal equipment may be defined as:
For individual usage:
• Headsets (connected to personal computers or analogue/digital terminal),
• Handset terminals, and
• Handsfree terminals.
For collective usage: several users located in the same room:
• Group Audio Terminals,
• Conferencing systems (e.g. Telepresence systems). These conferencing systems may be audio only but most of
them combine audio and video facilities.
4.1.1.2 Conference bridges/MCU
The Multipoint Control Unit (MCU) is a device capable of mixing audio/video from multiple endpoints to create a
virtual meeting space. More detailed information is available in annex B.
4.1.1.3 Multimedia terminal equipments (for speech + video)
Multimedia terminals are terminals for multimedia services usually including video and/or audio and/or data.
ETSI
10 ETSI SR 002 959 V1.1.1 (2011-08)
4.1.2 Desktop S
...