ASTM E1355-12

Standard Guide for Evaluating the Predictive Capability of Deterministic Fire Models

SIGNIFICANCE AND USE
The process of model evaluation is critical to establishing both the acceptable uses and limitations of fire models. It is not possible to evaluate a model in total; instead, this guide is intended to provide a methodology for evaluating the predictive capabilities for a specific use. Validation for one application or scenario does not imply validation for different scenarios. Several alternatives are provided for performing the evaluation process including: comparison of predictions against standard fire tests, full-scale fire experiments, field experience, published literature, or previously evaluated models.
The use of fire models currently extends beyond the fire research laboratory and into the engineering, fire service and legal communities. Sufficient evaluation of fire models is necessary to ensure that those using the models can judge the adequacy of the scientific and technical basis for the models, select models appropriate for a desired use, and understand the level of confidence which can be placed on the results predicted by the models. Adequate evaluation will help prevent the unintentional misuse of fire models.
This guide is intended to be used in conjunction with other guides under development by Committee E05. It is intended for use by:
Model Developers—To document the usefulness of a particular calculation method perhaps for specific applications. Part of model development includes identification of precision and limits of applicability, and independent testing.
Model Users—To assure themselves that they are using an appropriate model for an application and that it provides adequate accuracy.  
Developers of Model Performance Codes—To be sure that they are incorporating valid calculation procedures into codes.
Approving Officials—To ensure that the results of calculations using mathematical models stating conformance to this guide, cited in a submission, show clearly that the model is used within its applicable limits and has an accept...
SCOPE
1.1 This guide provides a methodology for evaluating the predictive capabilities of a fire model for a specific use. The intent is to cover the whole range of deterministic numerical models which might be used in evaluating the effects of fires in and on structures.
1.2 The methodology is presented in terms of four areas of evaluation:
1.2.1 Defining the model and scenarios for which the evaluation is to be conducted,
1.2.2 Verifying the appropriateness of the theoretical basis and assumptions used in the model,
1.2.3 Verifying the mathematical and numerical robustness of the model, and
1.2.4 Quantifying the uncertainty and accuracy of the model results in predicting of the course of events in similar fire scenarios.
1.3 This standard does not purport to address all of the safety concerns, if any, associated with its use. It is the responsibility of the user of this standard to establish appropriate safety and health practices and determine the applicability of regulatory limitations prior to use.
1.4 This fire standard cannot be used to provide quantitative measures.

General Information

• Status: Historical
• Publication Date: 31-Mar-2012
• ICS: 13.220.01 - Protection against fire in general
• Technical Committee: E05 - Fire Standards
• Drafting Committee: E05.33 - Fire Safety Engineering

Relations

• Replaces: ASTM E1355-11 - Standard Guide for Evaluating the Predictive Capability of Deterministic Fire Models
• Effective Date: 01-Apr-2012
• Referred By: ASTM E2061-23 - Standard Guide for Fire Hazard Assessment of Rail Transportation Vehicles
• Effective Date: 01-Apr-2012
• Referred By: ASTM E603-23 - Standard Guide for Room Fire Experiments
• Effective Date: 01-Apr-2012
• Referred By: ASTM E2280-21 - Standard Guide for Fire Hazard Assessment of the Effect of Upholstered Seating Furniture Within Patient Rooms of Health Care Facilities
• Effective Date: 01-Apr-2012
• Referred By: ASTM E176-21ae1 - Standard Terminology of Fire Standards
• Effective Date: 01-Apr-2012
• Referred By: ASTM E2891-20 - Standard Guide for Multivariate Data Analysis in Pharmaceutical Development and Manufacturing Applications
• Effective Date: 01-Apr-2012

Standards Content (Sample)

NOTICE: This standard has either been superseded and replaced by a new version or withdrawn.
Contact ASTM International (www.astm.org) for the latest information
Designation: E1355 − 12 An American National Standard
Standard Guide for
Evaluating the Predictive Capability of Deterministic Fire
1
Models
This standard is issued under the fixed designation E1355; the number immediately following the designation indicates the year of
original adoption or, in the case of revision, the year of last revision.Anumber in parentheses indicates the year of last reapproval.A
superscript epsilon (´) indicates an editorial change since the last revision or reapproval.
3
1. Scope 2.2 International Standards Organization Standards:
ISO/IEC Guide 98 (2008)Uncertainty of measurement –
1.1 This guide provides a methodology for evaluating the
Part 3: Guide to the expression of uncertainty in measure-
predictive capabilities of a fire model for a specific use. The
ment
intent is to cover the whole range of deterministic numerical
ISO 13943 (2008)Fire safety – Vocabulary
modelswhichmightbeusedinevaluatingtheeffectsoffiresin
ISO 16730 (2008)Fire safety engineering – Assessment,
and on structures.
verification and validation of calculation methods
1.2 The methodology is presented in terms of four areas of
evaluation:
3. Terminology
1.2.1 Defining the model and scenarios for which the
3.1 Definitions:For definitions of terms used in this guide
evaluation is to be conducted,
and associated with fire issues, refer to terminology contained
1.2.2 Verifying the appropriateness of the theoretical basis
in Terminology E176 and ISO 13943. In case of conflict, the
and assumptions used in the model,
definitions given in Terminology E176 shall prevail.
1.2.3 Verifying the mathematical and numerical robustness
3.2 Definitions of Terms Specific to This Standard:
of the model, and
1.2.4 Quantifyingtheuncertaintyandaccuracyofthemodel 3.2.1 model evaluation—the process of quantifying the
results in predicting of the course of events in similar fire
accuracy of chosen results from a model when applied for a
scenarios.
specific use.
1.3 This standard does not purport to address all of the
3.2.2 model validation—the process of determining the
safety concerns, if any, associated with its use. It is the
degree to which a calculation method is an accurate represen-
responsibility of the user of this standard to establish appro-
tation of the real world from the perspective of the intended
priate safety and health practices and determine the applica-
uses of the calculation method.
bility of regulatory limitations prior to use.
3.2.2.1 Discussion—The fundamental strategy of validation
1.4 Thisfirestandardcannotbeusedtoprovidequantitative
is the identification and quantification of error and uncertainty
measures.
in the conceptual and computational models with respect to
intended uses.
2. Referenced Documents
2
3.2.3 model verification—the process of determining that
2.1 ASTM Standards:
the implementation of a calculation method accurately repre-
E176Terminology of Fire Standards
sents the developer’s conceptual description of the calculation
E603Guide for Room Fire Experiments
method and the solution to the calculation method.
E1591Guide for Obtaining Data for Deterministic Fire
3.2.3.1 Discussion—The fundamental strategy of verifica-
Models
tion of computational models is the identification and quanti-
fication of error in the computational model and its solution.
3.2.4 The precision of a model refers to the deterministic
1
capability of a model and its repeatability.
ThisguideisunderthejurisdictionofASTMCommitteeE05onFireStandards
andisthedirectresponsibilityofSubcommitteeE05.33onFireSafetyEngineering.
3.2.5 The accuracy refers to how well the model replicates
Current edition approved April 1, 2012. Published April 2012. Originally
the evolution of an actual fire.
approved in 1990. Last previous edition approved in 2011 as E1355–11. DOI:
10.1520/E1355-12.
2
For referenced ASTM standards, visit the ASTM website, www.astm.org, or
contact ASTM Customer Service at [e-mail]. For Annual Book of ASTM
3
Standards volume information, refer to the standard’s Document Summary page on Available from American National Standards Institute, 11 West 42nd Street,
the ASTM website. 13th Floor, New York, NY 10036.
Copyright © ASTM International, 100 Barr Harbor Drive, PO Box C700, West Conshohocken, PA 19428-2959. United States
1

---------------------- Page: 1 ----------------------
E1355 − 12
4. Summary of Guide 5.5 The emphasis of this guide is numerical models of fire
evolution.
4.1 A recommended process for evaluating the predictive
5.5.1 The precision of a model refers to the deterministic
capability of fire models is described. This process includes a
capability of a model and its repeatability.
brief description of the model and the scenarios for which
5.5.2 The accuracy of a model refers to how well the model
evaluation is sought. Then, methodologies for conducting an
replica
...

This document is not anASTM standard and is intended only to provide the user of anASTM standard an indication of what changes have been made to the previous version. Because
it may not be technically possible to adequately depict all changes accurately, ASTM recommends that users consult prior editions as appropriate. In all cases only the current version
of the standard as published by ASTM is to be considered the official document.
An American National Standard
Designation:E1355–11 Designation:E1355–12
Standard Guide for
Evaluating the Predictive Capability of Deterministic Fire
1
Models
This standard is issued under the fixed designation E1355; the number immediately following the designation indicates the year of
original adoption or, in the case of revision, the year of last revision.Anumber in parentheses indicates the year of last reapproval.A
superscript epsilon (´) indicates an editorial change since the last revision or reapproval.
1. Scope
1.1 This guide provides a methodology for evaluating the predictive capabilities of a fire model for a specific use. The intent
is to cover the whole range of deterministic numerical models which might be used in evaluating the effects of fires in and on
structures.
1.2 The methodology is presented in terms of four areas of evaluation:
1.2.1 Defining the model and scenarios for which the evaluation is to be conducted,
1.2.2 Verifying the appropriateness of the theoretical basis and assumptions used in the model,
1.2.3 Verifying the mathematical and numerical robustness of the model, and
1.2.4 Quantifyingtheuncertaintyandaccuracyofthemodelresultsinpredictingofthecourseofeventsinsimilarfirescenarios.
1.3 This standard does not purport to address all of the safety concerns, if any, associated with its use. It is the responsibility
of the user of this standard to establish appropriate safety and health practices and determine the applicability of regulatory
limitations prior to use.
1.4This guide assumes understanding of the use and limitations of the model under analysis as detailed in Guide E1895.
1.5This fire standard cannot be used to provide quantitative measures.
1.4 This fire standard cannot be used to provide quantitative measures.
2. Referenced Documents
2
2.1 ASTM Standards:
E176 Terminology of Fire Standards
E603 Guide for Room Fire Experiments E1472Guide for Documenting Computer Software for Fire Models
E1591 Guide for Obtaining Data for Deterministic Fire Models
E1895Guide for Determining Uses and Limitations of Deterministic Fire Models Guide for Obtaining Data for Deterministic
Fire Models
3
2.2 International Standards Organization Standards:
ISO/IEC Guide 98 (2008) Uncertainty of measurement – Part 3: Guide to the expression of uncertainty in measurement
ISO 13943 (2008) Fire safety – Vocabulary
ISO 16730 (2008) Fire safety engineering – Assessment, verification and validation of calculation methods
3. Terminology
3.1 Definitions: For definitions of terms used in this guide and associated with fire issues, refer to terminology contained in
Terminology E176 and ISO 13943. In case of conflict, the definitions given in Terminology E176 shall prevail.
3.2 Definitions of Terms Specific to This Standard:
3.2.1 model evaluation—theprocessofquantifyingtheaccuracyofchosenresultsfromamodelwhenappliedforaspecificuse.
3.2.2 model validation—the process of determining the degree to which a calculation method is an accurate representation of
the real world from the perspective of the intended uses of the calculation method.
3.2.2.1 Discussion—The fundamental strategy of validation is the identification and quantification of error and uncertainty in
the conceptual and computational models with respect to intended uses.
3.2.3 model verification—the process of determining that the implementation of a calculation method accurately represents the
developer’s conceptual description of the calculation method and the solution to the calculation method.
1
This guide is under the jurisdiction of ASTM Committee E05 on Fire Standards and is the direct responsibility of Subcommittee E05.33 on Fire Safety Engineering.
Current edition approved Jan.April 1, 2011.2012. Published January 2011.April 2012. Originally approved in 1990. Last previous edition approved in 20052011 as
E1355–05a.E1355–11. DOI: 10.1520/E1355-112.
2
ForreferencedASTMstandards,visittheASTMwebsite,www.astm.org,[e-mail] Annual Book of ASTM Standards
volume information, refer to the standard’s Document Summary page on the ASTM website.
3
Available from American National Standards Institute, 11 West 42nd Street, 13th Floor, New York, NY 10036.
Copyright © ASTM International, 100 Barr Harbor Drive, PO Box C700, West Conshohocken, PA 19428-2959, United States.
1

---------------------- Page: 1 ----------------------
E1355–12
3.2.3.1 Discussion—The fundamental strategy of verification of computational models is the identification and quantification
of error in the computational model and its
...