SIST-TP CEN/TR 15369:2007
(Main)Postal services - Quality of service - Guide for the implementation of EN 14534 Measurement of the transit time of end-to-end services for bulk mail
Postal services - Quality of service - Guide for the implementation of EN 14534 Measurement of the transit time of end-to-end services for bulk mail
This Technical Report is an implementation guide to EN 14534 for use by postal operators, regulators and those responsible for commissioning, carrying out, or auditing the measurement of postal service quality. It gives information, which will facilitate the implementation of EN 14534. It gives an overview of the processes required and factors to consider when measuring quality of service. It provides guidance on alternative approaches allowed in the standard including how to select and calculate alternative or additional discriminant factors and methods for weighting of strata. It describes a process for implementation of the measurement system, and provides examples and clarification on specific requirements of EN 14534. It gives information on how to interpret the test results obtained by measurement according to the standard.
This Technical Report does not alter in any way the requirements of EN 14534. It is concerned with technical issues in the implementation of the measurement system. The Technical Report provides guidance but it does not specify how the regulators shall enforce and monitor the use of the standard since this is the responsibility of the European Commission and the national regulatory authorities themselves.
Postalische Dienstleistungen - Dienstqualität - Leitfaden für die Anwendung von EN 14534 Laufzeitmessung end-to-end für Massensendungen
Services postaux - Qualité de service - Guide pour la mise en oeuvre de l'EN 14534 Mesure de la qualité de service de bout en bout pour le courrier en nombre
Le présent Rapport Technique est un guide de mise en ouvre de l’EN 14534 destiné a etre utilisé par les opérateurs postaux, les régulateurs et les parties chargées de mettre en service, réaliser ou faire l'audit de la mesure de la qualité des services postaux. Il fournit des informations qui faciliteront la mise en oeuvre de l’EN 14534. Il donne un aperçu des processus requis et des facteurs a prendre en compte lors de la mesure de la qualité de service. Il fournit des indications sur les méthodes alternatives autorisées dans la norme, y compris la maniere de sélectionner et de calculer des facteurs discriminants alternatifs ou supplémentaires et des méthodes de pondération des strates. Il décrit un processus permettant la mise en oeuvre du systeme de mesure, et fournit des exemples et des éclaircissements relatifs a des exigences spécifiques de l'EN 14534. Il donne des informations sur la maniere d’interpréter les résultats d'échantillon test obtenus par une mesure conformément a la norme.
Le présent Rapport Technique ne modifie en aucune maniere les exigences de l’EN 14534. Il s’intéresse aux questions techniques soulevées par la mise en oeuvre du systeme de mesure. Le Rapport Technique fournit des recommandations, mais il ne spécifie pas la maniere dont les régulateurs doivent faire appliquer et contrôler l’utilisation de la norme, car cela releve de la responsabilité de la Commission Européenne et des autorités nationales de régulation elles-memes
Poštne storitve - Kakovost storitve - Vodilo za uvajanje EN 14534, Merjenje časa prenosa od sprejema do vročitve za masovno pošto
General Information
Relations
Standards Content (Sample)
SLOVENSKI STANDARD
SIST-TP CEN/TR 15369:2007
01-januar-2007
3RãWQHVWRULWYH.DNRYRVWVWRULWYH9RGLOR]DXYDMDQMH(10HUMHQMHþDVD
SUHQRVDRGVSUHMHPDGRYURþLWYH]DPDVRYQRSRãWR
Postal services - Quality of service - Guide for the implementation of EN 14534
Measurement of the transit time of end-to-end services for bulk mail
Postalische Dienstleistungen - Dienstqualität - Leitfaden für die Anwendung von EN
14534 Laufzeitmessung end-to-end für Massensendungen
Services postaux - Qualité de service - Guide pour la mise en oeuvre de l'EN 14534
Mesure de la qualité de service de bout en bout pour le courrier en nombre
Ta slovenski standard je istoveten z: CEN/TR 15369:2006
ICS:
03.240 Poštne storitve Postal services
SIST-TP CEN/TR 15369:2007 en
2003-01.Slovenski inštitut za standardizacijo. Razmnoževanje celote ali delov tega standarda ni dovoljeno.
---------------------- Page: 1 ----------------------
TECHNICAL REPORT
CEN/TR 15369
RAPPORT TECHNIQUE
TECHNISCHER BERICHT
May 2006
ICS 03.240
English Version
Postal services - Quality of service - Guide for the
implementation of EN 14534 Measurement of the transit time of
end-to-end services for bulk mail
Services postaux - Qualité de service - Guide pour la mise Postalische Dienstleistungen - Dienstqualität - Leitfaden für
en application de l'EN 14534 Mesure de la qualité de die Anwendung von EN 14534 Laufzeitmessung end-to-end
service de bout en bout pour courrier en nombre für Massensendungen
This Technical Report was approved by CEN on 25 February 2006. It has been drawn up by the Technical Committee CEN/TC 331.
CEN members are the national standards bodies of Austria, Belgium, Cyprus, Czech Republic, Denmark, Estonia, Finland, France,
Germany, Greece, Hungary, Iceland, Ireland, Italy, Latvia, Lithuania, Luxembourg, Malta, Netherlands, Norway, Poland, Portugal, Romania,
Slovakia, Slovenia, Spain, Sweden, Switzerland and United Kingdom.
EUROPEAN COMMITTEE FOR STANDARDIZATION
COMITÉ EUROPÉEN DE NORMALISATION
EUROPÄISCHES KOMITEE FÜR NORMUNG
Management Centre: rue de Stassart, 36 B-1050 Brussels
© 2006 CEN All rights of exploitation in any form and by any means reserved Ref. No. CEN/TR 15369:2006: E
worldwide for CEN national Members.
---------------------- Page: 2 ----------------------
CEN/TR 15369:2006 (E)
Contents Page
Foreword.3
Introduction .4
1 Scope .5
2 Purpose and use of postal quality of service standards.5
3 Considerations before implementing the EN 14534.7
4 Implementing the standard.8
5 Information regarding the interpretation of specific clauses and formulae in EN 14534 .14
Annex A Implementation timetable.23
2
---------------------- Page: 3 ----------------------
CEN/TR 15369:2006 (E)
Foreword
This Technical Report (CEN/TR 15369:2006) has been prepared by Technical Committee CEN/TC 331
“Postal services”, the secretariat of which is held by NEN.
3
---------------------- Page: 4 ----------------------
CEN/TR 15369:2006 (E)
Introduction
This Technical Report is supplementary to EN 14534 Postal services - Quality of service - Measurement of
transit time of end-to-end services for bulk mail. It provides information to be considered when implementing
the EN 14534. It has been developed to guide postal operators and regulators as to the use, benefits and
restrictions of EN 14534. The first part of this report contains general information to guide regulators and
operators in their decision on how and when to implement the standard. The second part of the report
contains detailed information on how to interpret specific clauses in EN 14534 and should be read in parallel
with the standard.
In addition to referencing this Technical Report, those seeking to implement the standard are advised to
consult requirements and guidance from the national regulators and legislation that apply in their jurisdictions.
EN 14534 provides a defined set of minimum requirements to satisfy the information interests of the national
regulatory authorities, postal customers and postal service providers for quality of service measurement, and
to allow postal service providers to comply with the requirements of the 1997 Postal Directive of the European
Commission.
4
---------------------- Page: 5 ----------------------
CEN/TR 15369:2006 (E)
1 Scope
This Technical Report is an implementation guide to EN 14534 for use by postal operators, regulators and
those responsible for commissioning, carrying out, or auditing the measurement of postal service quality. It
gives information, which will facilitate the implementation of EN 14534. It gives an overview of the processes
required and factors to consider when measuring quality of service. It provides guidance on alternative
approaches allowed in the standard including how to select and calculate alternative or additional discriminant
factors and methods for weighting of strata. It describes a process for implementation of the measurement
system, and provides examples and clarification on specific requirements of EN 14534. It gives information on
how to interpret the test results obtained by measurement according to the standard.
This Technical Report does not alter in any way the requirements of EN 14534. It is concerned with technical
issues in the implementation of the measurement system. The Technical Report provides guidance but it does
not specify how the regulators shall enforce and monitor the use of the standard since this is the responsibility
of the European Commission and the national regulatory authorities themselves.
2 Purpose and use of postal quality of service standards
2.1 General
EN 14534 Postal services - Quality of service - Measurement of transit time of end-to-end services for bulk
mail has been developed in order to provide a standardised method that can be used throughout Europe for
measuring the transit time of end-to-end mail services and to assist postal service providers in complying with
the requirements of the 1997 Postal Directive of the European Commission.
For the implementation of EN 14534 and to guide the user of this and other quality of service standards the
following facts and precautions may be considered.
EN 14534 contains a number of requirements, which may be agreed with or should be approved by national
postal regulators.
EN 14534 specifies technical requirements for the measurement including the preparation of reports on the
results of measurement. However EN 14534 does not state how and when results should be shared with
postal customers and users, who will order measurement to take place, and who will pay for the
measurement; these subjects are outside the standard and will be determined by legal and regulatory
requirements.
2.2 Benefits of the quality of service standards
The standardised quality of service measuring methods provides a uniform way for measuring the end-to-end
transit time of postal items. Postal regulators can refer to the standard when requiring information about
quality of service for postal operators. For any minimum service levels required by the European Commission
or by national Directives for operators in the universal service, requirements can be made that the service be
measured according to EN 14534.
Standardised measurement methods may help to keep the cost of measuring down. They could also make it
easier to find contractors familiar with the methods and to evaluate the work of contractors for measuring and
auditing. The standardised measuring methods may also eliminate debates and uncertainties about results
from varying measuring methods.
Using standardised measuring methods will assure that the measurement will be done in an objective and
equal way for all operators in accordance with the requirements of the 1997 Postal Directive of the European
Commission.
5
---------------------- Page: 6 ----------------------
CEN/TR 15369:2006 (E)
The use of standards will ensure that reliable and correct information can be collected which can be presented
to regulators and the public in an understandable way. It also allows the regulator to collect this information.
2.3 Limitations of EN 14534
EN 14534 considers only the measurement of transit time (expressed as the percentage of mail delivered
within J + n day’s end-to-end) and does not consider other aspects of service performance. For example, the
date of deposit is defined by the last collection of the day but the standard does not measure whether the
timing of the last collection of the day meets customers’ requirement, nor how the times compare for different
service providers. Similarly EN 14534 considers the date of delivery but does not take into account the time of
day when the item was delivered, whether or not there are more than one delivery each day, the condition of
items when delivered or the queuing time at post offices etc.
The method for end-to-end measuring specified in EN 14534 is not designed to provide for detailed results for
the measuring parts of the distribution chain, when more than one operator is involved in the collection,
processing and delivery of mail.
Although the EN 14534 specifies a method that will be used by many postal operators, it shall be noted that
the overall transit time quality of service result does not measure the postal operator’s overall performance in
a way that provides direct comparison of postal service operators.
2.4 Interpretation of results
Results from the quality of service measuring cannot always be used for direct comparison of the overall
quality of service. Neither can the results be used to compare the service of each operator in multiple operator
environments.
Direct comparison of two operators can be difficult to make. Frequently one is interested in comparing two
operators covering the same geographical area, i.e. the quality that a customer receives when using one or
other of the operators for collecting and distributing mail within an area. To do this, it is necessary to compare
the transit time of the operators over similar studies of domains. The two overall figures of the operators’ on-
time performance may be misleading. Considerations in case of multiple operators are described in 4.2.
When interpreting the results from the measurement it is important also to consider the stratification and
national and other peculiarities that apply in each specific case.
2.5 Use of survey results for quality improvement
EN 14534 sets out minimum requirements in order to produce one overall figure. It is recognised that
operators or other bodies may wish to go beyond these minimum requirements in order to produce information
to identify and correct specific areas of poor performance. The survey design can be expanded to collect this
information.
EN 14534 provides minimum requirements and allows measurement systems to be enhanced. It should be
noted that other methods are available to find problematic areas and that the standard may not be the only
method to use for this purpose.
EN 14534 allows the use of test items containing electronic chips or other advanced technology so that each
test item can be monitored at pre-defined points or throughout its whole journey to allow for more detailed
diagnostic analysis of the transit time. If these are used, the organisation operating the measuring system
shall take steps to ensure that the diagnostic system does not introduce biases in the end-to-end
measurement system.
When using the results of end-to-end measurements according to EN 14534 for quality improvements in a
multiple operator environment additional considerations regarding causes of delays and their allocations to
operators are to be made in order to see how each part of the process affect the total end-to-end quality of
service.
6
---------------------- Page: 7 ----------------------
CEN/TR 15369:2006 (E)
3 Considerations before implementing the EN 14534
3.1 Regulations
The standard itself is not meant to specify how the regulators shall enforce and monitor the use of EN 14534.
This is to be done through the European and national regulatory work. In particular it does not specify how
results shall be published by the regulator.
3.2 Measuring body (Contractors for survey operation)
EN 14534 states that measurement shall be carried out by an independent performance-monitoring
organisation. This is defined as a body charged with the monitoring of the quality of service which is “external
to, and having no links of ownership or control with the postal service provider thus monitored”. The
independent performance-monitoring organisation is responsible for undertaking the survey. Usually this
performance-monitoring organisation will act as a contractor for a sponsoring organisation which may be, for
example, the postal service provider itself or a national regulatory authority.
The independent performance monitoring organisation provides a guarantee that results of the measurement
have not been wrongly influenced by the postal service provider. Factors normally taken into account in
choosing a performance monitoring organisation include the capability - with strong emphasis of panel
management skills -, experience and reputation of the organisation as well as any legal or regulatory
requirements and, of course, cost. To cover all these points it is common to go through a formal tender
process. Organisations which may have undertaken quality of service measurement include e.g. research
institutes, consultancies, market research companies, universities and government organisations.
The performance monitoring organisation is required to ensure that the panel of senders and receivers is
independent of postal operators and to manage the panel according to the International Chamber of
Commerce/ESOMAR International Code of Marketing and Social Research Practice. This is intended to
ensure that the postal operator cannot influence either the behaviour or reporting of the panellists, or the
quality of service provided specifically to them. These codes of practice also require among other things that
the identity of the panellists is not revealed to anyone outside the monitoring organisation, except with the
prior permission of those panellists (see the comments on 5.1 in Clause 5 in this Technical Report).
3.3 Real mail information
The purpose of real mail studies is to collect information on the flows and other characteristics of mail.
Management systems or surveys specifically designed for the purpose may be used. In a multiple operator
environment there may be no real mail information available for all parts of the chain. In this case the standard
cannot be used.
It may not be necessary to wait for all real mail information before starting to use the standard as weighting
can be applied after the event.
5.5 of EN 14534:2003 “Real mail studies” lays down that the frequency of real mail studies shall be
determined in accordance with the national regulatory authority and shall be performed at a minimum once
every third year. For smaller mail flows, measured according to the extended measuring time as described in
the Annex G in the EN 14534 Amd 1 and the collection of real mail information may take up to 3 years.
The reason why real mail studies shall be repeated at intervals is that type of senders, type of mail,
distribution channels, volumes of posted mail and other factors may have changed over time.
The review of the real mail studies aims at reflecting changes in the postal environment. Reasons to review
and perform new real mail studies may be the following events:
a) General
7
---------------------- Page: 8 ----------------------
CEN/TR 15369:2006 (E)
substantial increase/decrease of the economy in general; and,
substantial increase/decrease of the number of (a specific type of) postal items.
b) Operational
introduction of new postal products with considerable market share;
introduction of new logistics that affect the acceptance/distribution of mail or the weight/number of strata;
and,
change of tariff structure.
c) Legislative
decrease of the reserved area; and,
increase/decrease of the universal service area.
d) Others
increasing/decreasing market share of other postal operators with branch or regional oriented customers
and/or specialised services;
substantial changes in distribution between rural and urban populations (e.g. drift to the city); and,
changes in multiple operator environments.
This list is only exemplary. There might be many more reasons based on national peculiarities and/or general
effects that may prove the need for the performance of additional real mail studies.
Real mail studies can be expensive which is why EN 14534 allows up to 3 years between studies.
Nevertheless there may be situations where real mail studies should be made more often, such as rapidly
changing events in the areas a) to d) above. It is also necessary to consider the effect on the measured
quality of any changes in the real mail parameters. If a factor is not very discriminant in practice then big
changes in the real mail parameter may have little effect and three years would be sufficiently frequent.
However, if a factor is very discriminant then small changes in the real mail parameter could have such a big
effect on quality of service that more frequent real mail studies are needed.
4 Implementing the standard
4.1 Steps to consider before implementation
In principle the following steps are required in order to implement quality of service measurement in
accordance with the EN 14534. Indicative time periods are shown for each stage. GANTT charts showing the
different stages are contained in Annex A.
a) Study the EN 14534 and this implementation guide and produce an outline specification for the survey. This
specification should identify, in particular, the geographical stratification that will be used and the discriminant
parameters that will need to be considered (up to 6 months);
b) Organise real mail studies to collect the information required for the survey. The real mail study shall cover
different days of the week and periods of the year (between 6 and 12 months);
8
---------------------- Page: 9 ----------------------
CEN/TR 15369:2006 (E)
c) It is possible to proceed with call for tender processes, the selection of an independent survey operator, and
begin contract negotiations before the final results of the real mail studies are known (preliminary estimates
can be used instead) (up to12 months, at the same time as b) is performed);
d) Once full results of the real mail studies are available the design of the survey can be finalised and
contractual negotiations with the survey operator completed (up to 4 months); and,
e) A period will be necessary for set up and testing of the survey (up to 9 months).
The timetable for activities a) through e) should be planned so as to have them completed at the end of a
calendar year.
f) Full survey operation will start at the beginning of a calendar year and is required to last for 12, 24 or 36
months in order to meet the requirements of EN 14534 (12 months); and,
g) Reports shall be available within 3 months of the end of a measurement period of 12 months for large sized
cross-border mail flows. For medium sized cross-border mail flows reports shall be available within 3 months
of the end of a measurement period of 24 months. For small sized cross-border mail flows reports shall be
available within 3 months of the end of a measurement period of 36 months (up to 3 months).
Many universal service providers already have some system in place for measuring end-to-end quality of
service.
If there is no existing real mail study in place but a system to measure quality of service already exists, it may
be possible to speed up the collection of information on real mail by using existing management information
available to the postal service provider. In other words the real mail studies would run in parallel with the
quality of service survey, and the results of the quality of service survey would be adjusted retrospectively
using weighting at the end of the first year of operation. It could then take 16 to 24 months to the start of the
measurement period and a further 15 months before results for the calendar year are available (see Table
A.1).
In a number of cases faster implementation may be possible:
— if a system to measure quality of service already exists with a design already based on real mail studies
and concepts, with minor modifications required, it should be possible to make the modifications required for
compliance with EN 14534 with little delay (6 to 12 months to start of measurement period, see Table A.2);
and,
— if a system to measure quality of service already exists with a design already based on real mail studies
and concepts, but major modifications are required before the survey is compliant with EN 14534, there may
be significant contractual issues with the survey operator. Time will have to be allowed for this, more time
being required for a bigger survey (12 to 18 months to start of measurement period, see Table A.3).
Where there is neither systems to measure quality of service nor existing real mail studies in place it could
take up to about 30 months to the start of the measurement period and a further 15 months or more before
results for the calendar year are available (see Table A.4).
In a multiple operator environment, longer implementation times may be necessary.
4.2 Considerations in case of multiple operators
4.2.1 General
EN 14534 can be used both by universal service providers and by other postal service providers operating in
a liberated market for the measurement of the full process of the pipeline end to end.
9
---------------------- Page: 10 ----------------------
CEN/TR 15369:2006 (E)
4.2.2 Field of study
The first step in designing the measurement system is to decide on the field of study. EN 14534 provides for a
number of alternatives.
— For domestic services, the field of study defines the parts of the country in which items will be posted and
the parts of the country where they will be delivered. Thus if a postal service provider only offers a service in
certain parts of the country, the field of study may be restricted to those parts of the country. On the other
hand it is important to make sure that all parts of the country served by the service provider are covered in the
field of study, including those parts served through collection or delivery agents.
— For cross border services, the posting or the delivery field of study may, for example, be defined as the
whole of a single country or as a group of countries. It may be useful to measure the overall service to/from a
group of countries in order to reduce the work in the case of an operator forwarding or receiving small
amounts of mail to/from several countries.
— For both domestic and cross-border services the standard may also be used to measure the service
provided by a group of operators.
4.2.3 How and when to use EN 14534 or other quality of service standards
For technical reasons EN 14534 may not in all parts be suitable for the measurement of very small volumes of
mail and for operators with limited coverage. For these reasons the following technical points should be
considered by service providers operating in a liberated market:
— geographical stratification and discriminant factors should be examined to ensure that they are appropriate.
For example, addressing characteristics may be highly discriminant if the operation is highly automated. EN
14534 allows discriminant characteristics to be changed if necessary;
— types and numbers of customers who can take part in the survey should be examined. If an operator is only
offering service to limited numbers of customers, it may be difficult to recruit sufficient panellists, particularly
since the survey requires co-operation from customers;
— types of induction should be examined. For example, if preferential treatment is offered to certain classes of
customers, then the class of customer becomes an important discriminant characteristic;
— it is important to consider how dates of induction and delivery can be recorded accurately and without bias.
For example, if receivers receive high volumes of real mail each day there may be problems in intercepting
test items. Alternatively if the volume of real mail per poster or receiver is very low, it may become noticeable
to the postal operator that a panellist in the survey is sending or receiving test letters with a consequent risk of
bias to the survey results;
— information on real mail will be required for geographical stratification and the discriminant characteristics.
In a multiple operator environment real mail information for the total pipeline may be difficult to obtain and an
estimation should be made;
— if operators are using an end-to-end track and trace systems it may be more appropriate to obtain quality of
service information from the track and trace systems;
— for cross-border mail, real mail information is required for both the posting and delivery countries. In many
cases the operators in the two countries will collect and share information on real mail flows in their own
countries. If shared information is unavailable the operator commissioning the survey will have to collect
information about the flows in both countries;
if more than one operator is involved in the total operation, information may be obtained similarly as for
cross-border mail shared information on real mail flows; and,
10
---------------------- Page: 11 ----------------------
CEN/TR 15369:2006 (E)
other ways of collecting real mail information in a multiple operator environment is used by electronic tags
for the whole chain.
Note that in the above, it is assumed throughout that the measurement is carried out end to end from the
customer perspective. This may be the measurement of the end to end service provided by:
an individual operator providing a fully end to end service;
a group of parallel operators, all providing fully end to end services (parallel operations);
more than one operator, who, in combination, provide an end to end service, each carrying out only part
of the pipeline (partial pipelines); and,
a group of operators, who, in various combinations, provide end to end services, with different operators
carrying out different parts of the pipeline (may include both parallel and partial pipelines).
For an example of the third alternative above, operator A might collect, process, and partially distribute the
mail, whilst operator B and C might further distribute and deliver the mail in different parts of the country. From
the customer’s perspective, they are only interested in the end to end service provided. EN 14534 would be
suitable to measure this service, but would not in itself be suitable to measure the service provided within this
pipeline by the individual operators.
To measure the transit time for only part of pipeline would require additional information about the handover
point that is not covered in EN 14534. If such measurement is desired, it would be necessary to decide
whether reliable information can be provided (e.g. by the use of electronic tags), or, if not, to consider whether
another standard, such as the bulk mail standard would be more useful.
The results from the quality of service measurement will provide as a minimum a single overall figure for each
operator. When interpreting the quality offered by different operators (see 2.4) it should be borne in mind that
there may be several factors affecting the comparison. For example, one operator may be providing a service
for local mail posted and delivered within a city whilst another operator offers a national service. Similarly two
operators may both offer a national service but in practice have different patterns of real mail.
For closer comparisons between operators, it may be necessary to compare their performance in similar
circumstances. EN 14534 allows this to be done by calculating transit times for particular study domains which
form subsets of the field of study. The geographical stratification, e.g. local mail, long distance mail, or rural
mail, and the methods of induction and delivery may be useful as study domains.
Note that EN 14534 allows for quality of service measurements that are not transit time, e.g. delivered within a
specified period.
4.3 Extension to a wider EU
4.3.1 General
In May 2004 the European Union was enlarged by the accession of a number of additional European
countries, making it necessary to adjust EN 14534 to suit the needs for the additional countries and for any
future expansion and to cover for flows with smaller mail volumes in an enlarged EU. In parallel with the
revision of this report an
...
Questions, Comments and Discussion
Ask us and Technical Secretary will try to provide an answer. You can facilitate discussion about the standard in here.