ASTM E3016-18
(Guide)Standard Guide for Establishing Confidence in Digital and Multimedia Evidence Forensic Results by Error Mitigation Analysis
Standard Guide for Establishing Confidence in Digital and Multimedia Evidence Forensic Results by Error Mitigation Analysis
SIGNIFICANCE AND USE
3.1 Digital and multimedia evidence forensics is a complex field that is heavily reliant on algorithms that are embedded in automated tools and used to process evidence. Weaknesses or errors in these algorithms, tools, and processes can potentially lead to incorrect findings. Indeed, errors have occurred in a variety of contexts, demonstrating the need for more scientific rigor in digital and multimedia evidence forensics. This guide proposes a disciplined approach to mitigating potential errors in evidence processing to reduce the risk of inaccuracies, oversights, or misinterpretations in digital and multimedia evidence forensics. This approach provides a scientific basis for confidence in digital and multimedia evidence forensic results.
3.2 Error rates are used across the sciences to characterize the likelihood that a given result is correct. The goal is to explain to the reader (or receiver of the result) the confidence the provider of the result has that it is correct. Many forensic disciplines use error rates as a part of how they communicate their results. Similarly, digital and multimedia evidence forensics needs to communicate how and why there is confidence in the results. Because of intrinsic difference between the biological and chemical sciences and computer science, it is necessary to go beyond error rates. One difference between chemistry and computer science is that digital technology is constantly changing and individuals put their computers to unique uses, making it infeasible to develop a representative sample to use for error rate calculations. Furthermore, a digital and multimedia evidence forensic method may work well in one environment but fail completely in a different environment.
3.3 This guide provides a disciplined and structured approach for addressing and explaining potential errors and error rates associated with the use of digital and multimedia evidence forensic tools/processes in any given environment. This approach to establi...
SCOPE
1.1 This guide provides a process for recognizing and describing both errors and limitations associated with tools, techniques, and methods used to support digital and multimedia evidence forensics. This is accomplished by explaining how the concepts of errors and error rates should be addressed in digital and multimedia evidence forensics. It is important for practitioners and stakeholders to understand that digital and multimedia evidence forensic techniques and tools have known limitations, but those limitations have differences from errors and error rates in other forensic disciplines. This guide proposes that confidence in digital and multimedia evidence forensic results is best achieved by using an error mitigation analysis approach that focuses on recognizing potential sources of error and then applying techniques used to mitigate them, including trained and competent personnel using tested and validated methods and practices. Sources of error not directly related to tool usage are beyond the scope of this guide.
1.2 This international standard was developed in accordance with internationally recognized principles on standardization established in the Decision on Principles for the Development of International Standards, Guides and Recommendations issued by the World Trade Organization Technical Barriers to Trade (TBT) Committee.
General Information
Buy Standard
Standards Content (Sample)
This international standard was developed in accordance with internationally recognized principles on standardization established in the Decision on Principles for the
Development of International Standards, Guides and Recommendations issued by the World Trade Organization Technical Barriers to Trade (TBT) Committee.
Designation:E3016 −18 An American National Standard
Standard Guide for
Establishing Confidence in Digital and Multimedia Evidence
1
Forensic Results by Error Mitigation Analysis
This standard is issued under the fixed designation E3016; the number immediately following the designation indicates the year of
original adoption or, in the case of revision, the year of last revision.Anumber in parentheses indicates the year of last reapproval.A
superscript epsilon (´) indicates an editorial change since the last revision or reapproval.
1. Scope SWGDE Standards and ControlsPosition Paper
SWGDE/SWGIT Proficiency TestProgram Guidelines
1.1 This guide provides a process for recognizing and
SWGDE/SWGIT Guidelines & Recommendations for
describing both errors and limitations associated with tools,
Training in Digital & Multimedia Evidence
techniques, and methods used to support digital and multime-
dia evidence forensics. This is accomplished by explaining
3. Significance and Use
how the concepts of errors and error rates should be addressed
indigitalandmultimediaevidenceforensics.Itisimportantfor
3.1 Digital and multimedia evidence forensics is a complex
practitioners and stakeholders to understand that digital and
field that is heavily reliant on algorithms that are embedded in
multimediaevidenceforensictechniquesandtoolshaveknown
automated tools and used to process evidence. Weaknesses or
limitations, but those limitations have differences from errors
errors in these algorithms, tools, and processes can potentially
and error rates in other forensic disciplines. This guide pro-
lead to incorrect findings. Indeed, errors have occurred in a
poses that confidence in digital and multimedia evidence
variety of contexts, demonstrating the need for more scientific
forensic results is best achieved by using an error mitigation
rigor in digital and multimedia evidence forensics. This guide
analysisapproachthatfocusesonrecognizingpotentialsources
proposes a disciplined approach to mitigating potential errors
of error and then applying techniques used to mitigate them,
in evidence processing to reduce the risk of inaccuracies,
including trained and competent personnel using tested and
oversights, or misinterpretations in digital and multimedia
validated methods and practices. Sources of error not directly
evidence forensics. This approach provides a scientific basis
related to tool usage are beyond the scope of this guide.
for confidence in digital and multimedia evidence forensic
1.2 This international standard was developed in accor-
results.
dance with internationally recognized principles on standard-
3.2 Error rates are used across the sciences to characterize
ization established in the Decision on Principles for the
the likelihood that a given result is correct. The goal is to
Development of International Standards, Guides and Recom-
explain to the reader (or receiver of the result) the confidence
mendations issued by the World Trade Organization Technical
the provider of the result has that it is correct. Many forensic
Barriers to Trade (TBT) Committee.
disciplines use error rates as a part of how they communicate
their results. Similarly, digital and multimedia evidence foren-
2. Referenced Documents
sicsneedstocommunicatehowandwhythereisconfidencein
2
2.1 ISO Standard:
theresults.Becauseofintrinsicdifferencebetweenthebiologi-
ISO/IEC 17025General Requirements for the Competence
calandchemicalsciencesandcomputerscience,itisnecessary
of Testing and Calibration Laboratories
togobeyonderrorrates.Onedifferencebetweenchemistryand
3
2.2 SWGDE Standards:
computer science is that digital technology is constantly
SWGDE Model Quality Assurance Manualfor Digital Evi-
changing and individuals put their computers to unique uses,
dence
making it infeasible to develop a representative sample to use
for error rate calculations. Furthermore, a digital and multime-
dia evidence forensic method may work well in one environ-
1
This guide is under the jurisdiction of ASTM Committee E30 on Forensic
ment but fail completely in a different environment.
Sciences and is the direct responsibility of Subcommittee E30.12 on Digital and
Multimedia Evidence.
3.3 This guide provides a disciplined and structured ap-
Current edition approved June 1, 2018. Published June 2018. Originally
ɛ1
proach for addressing and explaining potential errors and error
approved in 2015. Last previous edition approved as E3016 – 15 .DOI: 10.1520/
E3016-18.
rates associated with the use of digital and multimedia evi-
2
Available fromAmerican National Standards Institute (ANSI), 25 W. 43rd St.,
dence forensic tools/processes in any given environment. This
4th Floor, New
...
This document is not an ASTM standard and is intended only to provide the user of an ASTM standard an indication of what changes have been made to the previous version. Because
it may not be technically possible to adequately depict all changes accurately, ASTM recommends that users consult prior editions as appropriate. In all cases only the current version
of the standard as published by ASTM is to be considered the official document.
´1
Designation: E3016 − 15 E3016 − 18
Standard Guide for
Establishing Confidence in Digital and Multimedia Evidence
1
Forensic Results by Error Mitigation Analysis
This standard is issued under the fixed designation E3016; the number immediately following the designation indicates the year of
original adoption or, in the case of revision, the year of last revision. A number in parentheses indicates the year of last reapproval. A
superscript epsilon (´) indicates an editorial change since the last revision or reapproval.
1
ε NOTE—Editorial changes were made throughout in September 2016.
1. Scope
1.1 This guide provides a process for recognizing and describing both errors and limitations associated with tools tools,
techniques, and methods used to support digital and multimedia evidence forensics. This is accomplished by explaining how the
concepts of errors and error rates should be addressed in digital and multimedia evidence forensics. It is important for practitioners
and stakeholders to understand that digital and multimedia evidence forensic techniques and tools have known limitations, but
those limitations have differences from errors and error rates in other forensic disciplines. This guide proposes that confidence in
digital and multimedia evidence forensic results is best achieved by using an error mitigation analysis approach that focuses on
recognizing potential sources of error and then applying techniques used to mitigatingmitigate them, including trained and
competent personnel using tested and validated methods and practices. Sources of error not directly related to tool usage are
beyond the scope of this guide.
1.2 This international standard was developed in accordance with internationally recognized principles on standardization
established in the Decision on Principles for the Development of International Standards, Guides and Recommendations issued
by the World Trade Organization Technical Barriers to Trade (TBT) Committee.
2. Referenced Documents
2
2.1 ISO Standard:
ISO/IEC 17025 General Requirements for the Competence of Testing and MeasurementCalibration Laboratories
3
2.2 SWGDE Standards:
SWGDE Model Quality Assurance Manual for Digital Evidence
SWGDE Standards and Controls Position Paper
SWGDE/SWGIT Proficiency Test Program Guidelines
SWGDE/SWGIT Guidelines & Recommendations for Training in Digital & Multimedia Evidence
3. Significance and Use
3.1 Digital and multimedia evidence forensics is a complex field that is heavily reliant on algorithms that are embedded in
automated tools and used to process evidence. Weaknesses or errors in these algorithms, tools, and processes can potentially lead
to incorrect findings. Indeed, errors have occurred in a variety of contexts, demonstrating the need for more scientific rigor in
digital and multimedia evidence forensics. This guide proposes a disciplined approach to mitigating potential errors in evidence
processing to reduce the risk of inaccuracies, oversights, or misinterpretations in digital and multimedia evidence forensics. This
approach provides a scientific basis for confidence in digital and multimedia evidence forensic results.
3.2 Error rates are used across the sciences to explain the amount of uncertainty or the limitation of a given result. characterize
the likelihood that a given result is correct. The goal is to explain to the reader (or receiver of the result) the confidence the provider
of the result has that it is correct. Many forensic disciplines use error rates as a part of how they communicate their results.
Similarly, digital and multimedia evidence forensics needs to communicate how and why there is confidence in the results. Because
of intrinsic difference between the biological and chemical sciences and computer science, it is necessary to go beyond error rates.
1
This guide is under the jurisdiction of ASTM Committee E30 on Forensic Sciences and is the direct responsibility of Subcommittee E30.12 on Digital and Multimedia
Evidence.
Current edition approved May 1, 2015June 1, 2018. Published June 2015June 2018. DOI: 10.1520/E3016-15E01.Originally approved in 2015. Last previous edition
ɛ1
approved as E3016 – 15 .DOI: 10.1520/E3016-18.
2
Available from American National Standards Institute (ANSI), 25 W. 43rd St., 4th Floor, New York, NY 10036, http://www.ansi.org.
3
Available from the Scientific Working Group on Digital Evidence (SWDGE), https://www.swgde.org.
Copyright © ASTM International, 100 Barr Harbor Drive, PO Box C700, West Conshohocken, PA 19428-2959. United States
1
-----------------
...
Questions, Comments and Discussion
Ask us and Technical Secretary will try to provide an answer. You can facilitate discussion about the standard in here.