ISO/TC 22/SC 33/WG 9 - Test scenarios of automated driving systems

This document defines a methodology to evaluate scenarios and provides a procedure for extending test scenarios to test cases. This document also defines the necessary characteristics of test cases, which include but are not limited to unified identifiers, test objectives, inputs, steps, platforms and expected results. This document describes methods and criteria to evaluate test cases (e.g. frequency, criticality, complexity of a scenario), the coverage concerning functional and technical requirements, operational domain (OD), test criteria, and also the optimization of sets of prioritized test cases. This document is applicable to Level 3 and higher ADSs as defined in ISO/SAE PAS 22736. The focus of this document is on scenarios, which will be tested to evaluate safety (functional safety and safety of the intended functionality (SOTIF)). The content, in general, is also applicable to non-safety related test scenarios.

This document defines an approach for the categorization of scenarios by providing tags that carry information about the scenarios. This document is applicable to SAE level 3 to SAE level 5 Automated Driving System (ADS)[19].

This document specifies the requirements for the hierarchical taxonomy for specifying operating conditions which enable the definition of an operational design domain (ODD) of an automated driving system (ADS). This document also specifies requirements for the definition format of an ODD using the taxonomy. The ODD comprises specific conditions (which include the static and dynamic attributes) within which an ADS is designed to function. This document is mainly applicable to level 3 and level 4 ADS. An ODD for level 5 ADS is unlimited (i.e. operation is possible everywhere). This document can be used by organizations taking part in developing safety cases for automated vehicles, in particular, for organizations conducting trials, testing and commercial deployment. This document can also be used by manufacturers of level 3/4 ADS to define the ADS’ operating capability. It may also be of interest to insurers, regulators, service providers, national, local and regional governments to enable them to understand possible ADS deployments and capabilities. This document does not cover the basic test procedures for attributes of the ODD. It does not cover the monitoring requirements of the ODD attributes.

This document provides guidance for a scenario-based safety evaluation framework for automated driving systems (ADSs). The framework elaborates a scenario-based safety evaluation process that is applied during product development. The guidance for the framework is intended to be applied to ADS defined in ISO/SAE PAS 22736 and to vehicle categories 1 and 2 according to Reference [10]. This scenario-based safety evaluation framework for ADS is applicable for limited access highways. This document does not address safety-related issues involving misuse, human machine interface and cybersecurity. This document does not address non-safety related issues involving comfort, energy efficiency or traffic flow efficiency.

The document defines terms in the context of test scenarios for automated driving systems (ADS). The document is applicable to ADS of Level 3 and above defined in ISO/SAE PAS 22736.

This document provides guidelines for a comprehensive qualification scheme for VTE used in the evaluation of ADS. It specifies the criteria and procedures for assessing the VTE. This document is applicable to Open-Loop as well as Closed-Loop environments. Examples are Model-in-the-Loop (MiL) and Software-in-the-Loop (SiL) testing methodologies and may extend to hybrid testing techniques such as Hardware-in-the-Loop (HiL) and Vehicle-in-the-Loop (ViL). This document does not address the validation or assessment of individual simulation models, such as sensor or vehicle dynamics models, nor does it evaluate the ADS themselves. This document is intended for ADS developers, testing organizations, and regulatory bodies responsible for ensuring that VTE can provide reliable and adequate representations of real-world test environments.