ASTM E3408/E3408M-23

Standard Test Method for Evaluating Ground Response Robot Capabilities: Dexterity: Linear Inspection

SIGNIFICANCE AND USE
5.1 This test method is part of an overall suite of related test methods that provide repeatable measures of human-system interaction capability including robotic system mobility, dexterity, inspection, remote operator proficiency, and situational awareness. In particular, the operator control unit (OCU) design and interface features may impact the operator’s ability to perform movement and inspection tasks with the robot.  
5.2 The test apparatuses are low cost and easy to fabricate so they can be widely replicated. The procedure is also simple to conduct. This eases comparisons across various testing locations, dates, and times to determine best-in-class systems and operators.  
5.3 Evaluation—This test method can be used in a controlled environment to measure baseline capabilities. It can also be embedded into operational training scenarios to measure degradation due to uncontrolled variables in lighting, weather, radio communications, GPS accuracy, etc.  
5.4 Procurement—This test method can be used to identify inherent capability trade-offs in systems, make informed purchasing decisions, and verify performance during acceptance testing. This aligns requirement specifications and user expectations with existing capability limits.  
5.5 Training—This test method can be used to focus operator training, as a repeatable practice task or as an embedded task within training scenarios. The resulting measures of remote operator proficiency enable tracking of perishable skills over time, along with comparisons of performance across squads, regions, or national averages.  
5.6 Innovation—This test method can be used to inspire technical innovation, demonstrate break-through capabilities, and measure the reliability of systems performing specific tasks within an overall mission sequence. Combining or sequencing multiple test methods can guide manufacturers toward implementing the combinations of capabilities necessary to perform essential mission tasks.
SCOPE
1.1 This test method is intended for remotely operated ground robots operating in complex, unstructured, and often hazardous environments. It specifies the apparatuses, procedures, and performance metrics necessary to measure the capability of a robot to dexterously inspect objects of interest in the environment at various heights, depths, orientations, and confinement. This test method is one of several related dexterity tests that can be used to evaluate overall system capabilities.  
1.2 The robotic system typically includes a remote operator in control of all functionality, so an onboard camera and remote operator display are typically required. Assistive features or autonomous behaviors may improve the effectiveness or efficiency of the overall system.  
1.3 Different user communities can set their own thresholds of acceptable performance within this test method for various mission requirements.  
1.4 Performing Location—This test method may be performed anywhere the specified apparatuses and environmental conditions can be implemented.  
1.5 Units—The International System of Units (SI Units) and U.S. Customary Units (Imperial Units) are used throughout this test method. They are not mathematical conversions. Rather, they are approximate equivalents in each system of units to enable use of readily available materials in different countries. The differences between the stated dimensions in each system of units are insignificant for the purposes of comparing test method results, so each system of units is separately considered standard within this test method.  
1.6 This standard does not purport to address all of the safety concerns, if any, associated with its use. It is the responsibility of the user of this standard to establish appropriate safety, health, and environmental practices and determine the applicability of regulatory limitations prior to use.  
1.7 This international standard was developed in accordance with inter...

General Information

• Status: Published
• Publication Date: 14-Sep-2023
• Technical Committee: E54 - Homeland Security Applications
• Drafting Committee: E54.09 - Response Robots

Standards Content (Sample)

This international standard was developed in accordance with internationally recognized principles on standardization established in the Decision on Principles for the
Development of International Standards, Guides and Recommendations issued by the World Trade Organization Technical Barriers to Trade (TBT) Committee.
Designation: E3408/E3408M − 23
Standard Test Method for
Evaluating Ground Response Robot Capabilities: Dexterity:
1
Linear Inspection
This standard is issued under the fixed designation E3408/E3408M; the number immediately following the designation indicates the year
of original adoption or, in the case of revision, the year of last revision. A number in parentheses indicates the year of last reapproval.
A superscript epsilon (´) indicates an editorial change since the last revision or reapproval.
INTRODUCTION
The robotics community needs ways to measure whether a particular robot is capable of performing
specific missions in complex, unstructured, and often hazardous environments. These missions require
various combinations of elemental robot capabilities. Each capability can be represented as a test
method with an associated apparatus to provide tangible challenges for various mission requirements
and performance metrics to communicate results. These test methods can then be combined and
sequenced to evaluate essential robot capabilities and remote operator proficiencies necessary to
successfully perform intended missions.
The ASTM International Standards Committee on Homeland Security Applications (E54) specifies
these standard test methods to facilitate comparisons across different testing locations and dates for
diverse robot sizes and configurations. These standards support robot researchers, manufacturers, and
user organizations in different ways. Researchers use the standards to understand mission
requirements, encourage innovation, and demonstrate break-through capabilities. Manufacturers use
the standards to evaluate design decisions, integrate emerging technologies, and harden systems.
Emergency responders and soldiers use them to guide purchasing decisions, align deployment
expectations, and focus training with standard measures of operator proficiency. Associated usage
guides describe how these standards can be applied to support various objectives.
Several suites of standards address these elemental capabilities including maneuvering, mobility,
dexterity, sensing, energy, communications, durability, proficiency, autonomy, and logistics. This
standard is part of the dexterity suite of test methods.
1. Scope 1.3 Different user communities can set their own thresholds
of acceptable performance within this test method for various
1.1 This test method is intended for remotely operated
mission requirements.
ground robots operating in complex, unstructured, and often
hazardous environments. It specifies the apparatuses, 1.4 Performing Location—This test method may be per-
procedures, and performance metrics necessary to measure the formed anywhere the specified apparatuses and environmental
capability of a robot to dexterously inspect objects of interest conditions can be implemented.
in the environment at various heights, depths, orientations, and
1.5 Units—The International System of Units (SI Units) and
confinement. This test method is one of several related dexter-
U.S. Customary Units (Imperial Units) are used throughout this
ity tests that can be used to evaluate overall system capabilities.
test method. They are not mathematical conversions. Rather,
1.2 The robotic system typically includes a remote operator they are approximate equivalents in each system of units to
in control of all functionality, so an onboard camera and remote
enable use of readily available materials in different countries.
operator display are typically required. Assistive features or The differences between the stated dimensions in each system
autonomous behaviors may improve the effectiveness or effi-
of units are insignificant for the purposes of comparing test
ciency of the overall system. method results, so each system of units is separately considered
standard within this test method.
1.6 This standard does not purport to address all of the
1
This test method is under the jurisdiction of ASTM Committee E54 on
safety concerns, if any, associated with its use. It is the
Homeland Security Applications and is the direct responsibility of Subcommittee
responsibility of the user of this standard to establish appro-
E54.09 on Response Robots.
priate safety, health, and environmental practices and deter-
Current edition approved Sept. 15, 2023. Published October 2023. DOI:
10.1520/E3408_E3408M-23. mine the applicability of regulatory limitations prior to use.
Copyright © ASTM International, 100 Barr Harbor Drive, PO Box C700, West Conshohocken, PA 19428-2959. United States
1

---------------------- Page: 1 ----------------------
E3408/E3408M − 23
1.7 This international standard was developed in accor-
dance with inte
...