ISO/TC 46/SC 8 - Quality - Statistics and performance evaluation

This document specifies guidelines for the archives community on the collection and reporting of statistics for the following purposes: — strategic planning and internal management of archives; — aggregating and comparing operational and performance statistics at regional, national, and international levels; — reporting to stakeholders such as funding institutions, politicians, researchers, and the general public; — promoting the role and value of archives for advancing learning and research, education and culture, and social and economic life; — improving the management of processes, reinforcing transparency and supporting good governance. This document does not apply to records centres responsible for records that are still in the legal custody of the organization that created or received them, although it is recognized that some archives also have responsibilities for appraising, acquiring, and managing the current records of organizations that can or not be transferred to the archives for permanent retention. When applying this document to archives that also perform records management functions, the archives can exclude statistics that pertain to its records management functions, including measures pertaining to holdings and their usage and preservation, funding and expenditures, space and facilities, staffing and management.

This document specifies a set of key indicators for assessing the quality of museums: — for the purpose of strategic planning and internal management of museums; — for reporting to stakeholders such as funding institutions, policy makers, or the public; — to promote the museums' role and value for learning and research, education and culture, social and economic life; — for comparing results over time and between museums. The aim of this document is to provide a selection of key indicators applicable to a wide range of museums. It is recognized that not all indicators are pertinent for each individual museum category or each individual museum. Limitations on the applicability of individual indicators are listed in the scope clause of the description of each indicator (see Annex A). This document is not intended to exclude the use of other indicators not specified in it.

This document defines terms for the quality assessment of national libraries and specifies the following methods for the assessment: — performance measurement, and — impact assessment. The results of both methods are of special interest for comparison over time within the same library. Comparisons between libraries are possible if differences in the mandate, tasks and constituencies of the libraries are taken into account. Not all methods described in this document apply to all national libraries. Limitations of the applicability of individual methods are specified in the descriptions. This document is not intended to exclude the use of performance indicators or of methods for impact assessment not specified in it. This document does not cover web archiving, but refers to ISO/TR 14873 for statistics and quality issues for this new task of national libraries.

ISO 18461:2016 specifies rules for the museum community on the collection and reporting of statistics. It provides definitions and counting procedures for all types of resources and services that museums offer to their users. It is recognized that not all measures specified in this International Standard can be collected by museums of different type and size. The aim is to ensure that, where a particular statistic is collected, the same definitions and methods are used. ISO 18461:2016 is not intended to exclude the use of methods not specified in it. There are many different types of museums, with different tasks and audiences, having a range of unique characteristics (structure, funding, governance, etc.), and affected by a number of situational factors. Since there is such a wide variation around the world, it is important to understand that not all methods described in this International Standard may be required by or useful to all museums.

ISO 11620:2014 is applicable to all types of libraries in all countries. However, not all performance indicators apply to all libraries. Limitations on the applicability of individual performance indicators are listed in the scope clause of the description of each indicator. Performance indicators can be used for comparison over time within the same library. Comparisons between libraries can also be made, but only with caution. Comparisons between libraries will need to take into account any differences in the constituencies of the libraries and library attributes, with a good understanding of the indicators used, limitations to comparisons, and careful interpretation of the data). ISO 11620:2014 offers accepted, tested, and publicly accessible (i.e. non-proprietary) methodologies and approaches to measuring a range of library service performance.

ISO 16439:2014 defines terms for impact assessment of libraries and specifies methods for such assessment: for the purpose of strategic planning and internal quality management of libraries; to facilitate comparison of library impact over time and between libraries of similar type and mission; to promote the libraries' role and value for learning and research, education and culture, social and economic life; to support political decisions on levels of service and strategic goals for libraries. ISO 16439:2014 considers the impact of libraries on individuals, institutions and society. It is applicable to all types of libraries in all countries. However, not all methods described apply to all libraries. Limitations on the applicability of individual methods are specified in the descriptions.

ISO/TR 14873:2013 defines statistics, terms and quality criteria for Web archiving. It considers the needs and practices across a wide range of organisations such as libraries, archives, museums, research centres and heritage foundations. ISO/TR 14873:2013 is intended for professionals directly involved in Web archiving. It is also useful for Web archiving institutions' funding authorities and external stakeholders. The terminology used in ISO/TR 14873:2013 attempts to reflect the wide range of interests and expertise of the audiences, striking a balance between computer science, management and librarianship. ISO/TR 14873:2013 essentially focuses on Web archiving principles and methods and does not encompass alternative ways of collecting Internet resources.

ISO 2789:2013 specifies rules for the library and information services community on the collection and reporting of statistics: for the purposes of international reporting; to ensure conformity between countries for those statistical measures that are frequently used by library managers, but do not qualify for international reporting; to encourage good practice in the use of statistics for the management of library and information services.

ISO/TR 11219:2012 specifies data for the planning of library buildings. It also provides guidance on the selection of technical building equipment for the different functional areas of libraries. ISO/TR 11219:2012 is applicable to all types of libraries in all countries, but especially to academic and public libraries.

ISO/TR 28118:2009 establishes the performance indicators for national libraries. It is also applicable to libraries with regional tasks and without a defined population to be served, as many of their evaluation problems correspond to those of national libraries. The performance indicators are of special interest for comparison over time within the same library. Comparisons between libraries are possible, if differences in the tasks and constituencies of the libraries are taken into account. ISO/TR 28118:2009 does not include performance indicators for evaluating the outcomes or impact of library services either on individuals, on the communities that libraries serve, or on society at this time. Since this is an evolving area of performance measurement for libraries, such performance indicators can be added at a later date. ISO/TR 28118:2009 is not intended to exclude the use of any performance indicators which have not been specified herein.

ISO 9707:2008 gives guidance on the keeping of national statistics to provide standardized information on various aspects of the production and distribution of printed, electronic and micro-publications (essentially books, newspapers and periodicals). In addition, ISO 9707:2008 provides recommendations on subject classification. ISO 9707:2008 is not applicable to the following types of publications: publications issued for advertising purposes, where the literary or scientific text is subsidiary and the publications are distributed free of charge, including trade catalogues, prospectuses and other types of commercial, industrial and tourist advertising, and publications advertising products or services supplied by the publisher, even though they might describe activities or technical progress in some branch of industry or commerce; publications considered to be of a transitory character; typical examples are timetables, price-lists, telephone directories, programmes of entertainments, exhibitions, fairs, company regulations, reports and directives and circulars, calendars, and electronic texts under development; publications in which the text is not the most important part, including printed music documents where the music is more important than the words, and maps and charts (with the exception of atlases), e.g. astronomical charts, hydrographical and geographical maps, wall maps, road maps, geological surveys in map form and topographical plans.

ISO 9230:2007 specifies a method for the determination of price indexes relating to the prices of print and electronic media acquired by libraries. It is not meant for calculating a price index of the national media production. The media included are restricted to books, serials and databases. It is intended primarily for use by the library community, although it is accepted that other organizations may also find it useful. It focuses on compiling price indexes on the base of national and international sources, relevant to one country or region and different types of libraries. Different indexes will be appropriate to different types of library, according to the types of material in their collections. ISO 9230:2007 presents a methodology allowing for a general index which could be calculated from subsets of data, and could be weighted according to local needs. It introduces sampling methods for the selection of materials on which to base calculations. Note that ISO 9230:2007 describes indexes of prices, not of costs. Local cost indexes can be compiled instead of price indexes where there is insufficient uniformity of pricing structures to permit the calculation of price indexes, or as an additional tool for libraries. Guidelines for the calculation of local cost indexes are given in Annex B.

ISO 11620:2008 specifies the requirements of a performance indicator for libraries and establishes a set of performance indicators to be used by libraries of all types. It also provides guidance on how to implement performance indicators in libraries where such performance indicators are not already in use. The list and descriptions of the performance indicators are also summarized. ISO 11620:2008 provides a standardized terminology and concise definitions of the performance indicators. Furthermore, ISO 11620:2008 contains concise descriptions of the performance indicators and of the collection and the analysis of data needed. ISO 11620:2008 is applicable to all types of libraries in all countries. However, not all performance indicators are applicable to all libraries. Limitations on the applicability of individual performance indicators are also listed for each performance indicator. ISO 11620:2008 does not specify performance indicators for all services, activities, and uses of the resources of the library, either because such performance indicators had not been proposed and tested at the time of formulation of ISO 11620:2008, or because they did not fulfil the criteria specified.

ISO 2789:2006 specifies rules for the library and information services community on the collection and reporting of statistics for the purposes of international reporting, to ensure conformity between countries for those statistical measures that are frequently used by library managers but do not qualify for international reporting, to encourage good practice in the use of statistics for the management of library and information services, and to specify data provision required by ISO 11620.

ISO/TR 20983:2003 is applicable to all types of libraries in all countries. Limitations on the applicability of individual performance indicators are listed in the scope clause of the description of each indicator. Indicators may be used for comparison over time for the services provided by the same library. Comparisons between libraries and services should only be made with caution, taking into account differences in the constituencies of the libraries, with good understanding of the indicators used, and careful interpretation of the data. ISO/TR 20983:2003 does not include indicators for the evaluation of the impact of libraries either on individuals or on society.

ISO 2789:2003 provides guidance for the library and information services community on the collection and reporting of statistics for the purposes of international reporting, to ensure conformity between countries for those statistical measures that are frequently used by library managers but do not qualify for international reporting, to encourage good practice in the use of statistics for the management of library and information services, and to specify data provision required by ISO 11620.

Specifies a method for the determination of price indexes intended for use by the library community. Gives terms (also in French) and definitions. Annexes A, B and C are for information only.

Does not apply to the following types of publications: publications issued for advertising purposes; publications considered to be of a transitory character; publications in which the text is not the most important part. Annex A is for information only.

This second edition cancels and replaces the first edition (ISO 2789:1974). Aims at giving guidance to the international library community on the keeping of library statistics for the purposes of international reporting. ISO 2789 was prepared in a close cooperation between UNESCO and ISO. It will have the effect that statistics produced by different libraries will be more directly comparable. The definitions presented are designed for statistical purposes only.