Standard Practice for Measurement of Positional Accuracy of Computer-Assisted Surgical Systems

SIGNIFICANCE AND USE
5.1 The purpose of this practice is to provide data that can be used for evaluation of the accuracy of different CAS systems.  
5.2 The use of surgical navigation and robotic positioning systems is becoming increasingly common. In order to make informed decisions about the suitability of such systems for a given procedure, their accuracy capability needs to be evaluated under clinical application and compared to the requirements. As the performance of a whole system is constrained by those of its subparts, a preliminary step must be to objectively characterize the accuracy of the tracking subsystem in a controlled environment under controlled conditions.  
5.3 In order to make comparisons within and between systems, a standardized way of measuring and reporting accuracy is needed. Parameters such as coordinate system, units of measurement, terminology, and operational conditions must be standardized.
SCOPE
1.1 This document provides procedures for measurement and reporting of basic static performance of surgical navigation and/or robotic positioning devices under defined conditions. They can be performed on a subsystem (for example, tracking only) or a full computer-aided surgery system as would be used clinically. Testing a subsystem does not mean that the whole system has been tested. The functionality to be tested based on this practice is limited to the performance (accuracy in terms of bias and precision) of the system regarding point localization in space by means of a pointer. A point in space has no orientation; only multidimensional objects have orientation. Therefore, orientation of objects is not within the scope of this practice. However, in localizing a point the different orientations of the pointer can produce errors. These errors and the pointer orientation are within the scope of this practice. The aim is to provide a standardized measurement of performance variables by which end users can compare within a system (for example, with different reference elements or pointers) and between different systems (for example, from different manufacturers). Parameters to be evaluated include (based upon the features of the system being evaluated):
(1) Accuracy of a single point relative to a coordinate system.
(2) Sensitivity of tracking accuracy due to changes in pointer orientation.
(3) Relative point-to-point accuracy.  
1.1.1 This method covers all configurations of the evaluated system as well as extreme placements across the measurement volume.  
1.2 This practice defines a standardized reporting format, which includes definition of the coordinate systems to be used for reporting the measurements, and statistical measures (for example, mean, RMS, and maximum error).  
1.3 The values stated in SI units are to be regarded as standard. No other units of measurement are included in this standard, except for angular measurements, which may be reported in terms of radians or degrees.  
1.4 This standard does not purport to address all of the safety concerns, if any, associated with its use. It is the responsibility of the user of this standard to establish appropriate safety, health, and environmental practices and determine the applicability of regulatory limitations prior to use.  
1.5 This international standard was developed in accordance with internationally recognized principles on standardization established in the Decision on Principles for the Development of International Standards, Guides and Recommendations issued by the World Trade Organization Technical Barriers to Trade (TBT) Committee.

General Information

Status
Published
Publication Date
31-Aug-2022
Current Stage
Ref Project

Buy Standard

Standard
ASTM F2554-22 - Standard Practice for Measurement of Positional Accuracy of Computer-Assisted Surgical Systems
English language
9 pages
sale 15% off
Preview
sale 15% off
Preview
Standard
REDLINE ASTM F2554-22 - Standard Practice for Measurement of Positional Accuracy of Computer-Assisted Surgical Systems
English language
9 pages
sale 15% off
Preview
sale 15% off
Preview

Standards Content (Sample)

This international standard was developed in accordance with internationally recognized principles on standardization established in the Decision on Principles for the
Development of International Standards, Guides and Recommendations issued by the World Trade Organization Technical Barriers to Trade (TBT) Committee.
Designation: F2554 − 22
Standard Practice for
Measurement of Positional Accuracy of Computer-Assisted
1
Surgical Systems
This standard is issued under the fixed designation F2554; the number immediately following the designation indicates the year of
original adoption or, in the case of revision, the year of last revision. A number in parentheses indicates the year of last reapproval. A
superscript epsilon (´) indicates an editorial change since the last revision or reapproval.
1. Scope standard, except for angular measurements, which may be
reported in terms of radians or degrees.
1.1 This document provides procedures for measurement
1.4 This standard does not purport to address all of the
andreportingofbasicstaticperformanceofsurgicalnavigation
safety concerns, if any, associated with its use. It is the
and/or robotic positioning devices under defined conditions.
responsibility of the user of this standard to establish appro-
They can be performed on a subsystem (for example, tracking
priate safety, health, and environmental practices and deter-
only)orafullcomputer-aidedsurgerysystemaswouldbeused
mine the applicability of regulatory limitations prior to use.
clinically. Testing a subsystem does not mean that the whole
1.5 This international standard was developed in accor-
system has been tested. The functionality to be tested based on
dance with internationally recognized principles on standard-
thispracticeislimitedtotheperformance(accuracyintermsof
ization established in the Decision on Principles for the
biasandprecision)ofthesystemregardingpointlocalizationin
Development of International Standards, Guides and Recom-
space by means of a pointer. A point in space has no
mendations issued by the World Trade Organization Technical
orientation; only multidimensional objects have orientation.
Barriers to Trade (TBT) Committee.
Therefore, orientation of objects is not within the scope of this
practice. However, in localizing a point the different orienta-
2. Referenced Documents
tions of the pointer can produce errors. These errors and the
2
pointer orientation are within the scope of this practice. The
2.1 ASTM Standards:
aim is to provide a standardized measurement of performance
E456 Terminology Relating to Quality and Statistics
variables by which end users can compare within a system (for
E2281 Practice for Process Capability and Performance
example, with different reference elements or pointers) and
Measurement
between different systems (for example, from different manu-
3
2.2 Other References:
facturers). Parameters to be evaluated include (based upon the
ISO 10360 Geometrical Product Specifications (GPS)—
features of the system being evaluated):
Acceptance and Reverification Tests for Coordinate Mea-
(1) Accuracy of a single point relative to a coordinate
suring Machines (CMM)
system.
(2) Sensitivity of tracking accuracy due to changes in
3. Terminology
pointer orientation.
(3) Relative point-to-point accuracy.
3.1 Definitions:
1.1.1 This method covers all configurations of the evaluated 3.1.1 accuracy, n—the closeness of agreement between a
system as well as extreme placements across the measurement
measurement result and an accepted reference value. E456
volume. 3.1.1.1 Discussion—In the context of this standard, with the
definitions of bias and precision (see below), it can be
1.2 This practice defines a standardized reporting format,
considered that the accuracy of a measurement of a point will
which includes definition of the coordinate systems to be used
be subject to some bias error and some precision error.
for reporting the measurements, and statistical measures (for
3.1.2 bias, n—the difference between the expectation of the
example, mean, RMS, and maximum error).
measurement results and an accepted reference value. E456
1.3 The values stated in SI units are to be regarded as
standard. No other units of measurement are included in this
1 2
ThispracticeisunderthejurisdictionofASTMCommitteeF04onMedicaland For referenced ASTM standards, visit the ASTM website, www.astm.org, or
Surgical Materials and Devices and is the direct responsibility of Subcommittee contact ASTM Customer Service at service@astm.org. For Annual Book of ASTM
F04.38 on Computer Assisted Orthopaedic Surgical Systems. Standards volume information, refer to the standard’s Document Summary page on
Current edition approved Sept. 1, 2022. Published September 2022. Originally the ASTM website.
3
approved in 2010. Last previous edition approved in 2018 as F2554 – 18. DOI Available fromAmerican National Standards Institute (ANSI), 25 W. 43rd St.,
10.1520/F2554-22. 4th Floor, New York, NY 10036, http://www.ansi.org.
Copyright
...

This document is not an ASTM standard and is intended only to provide the user of an ASTM standard an indication of what changes have been made to the previous version. Because
it may not be technically possible to adequately depict all changes accurately, ASTM recommends that users consult prior editions as appropriate. In all cases only the current version
of the standard as published by ASTM is to be considered the official document.
Designation: F2554 − 18 F2554 − 22
Standard Practice for
Measurement of Positional Accuracy of Computer Assisted
1
Computer-Assisted Surgical Systems
This standard is issued under the fixed designation F2554; the number immediately following the designation indicates the year of
original adoption or, in the case of revision, the year of last revision. A number in parentheses indicates the year of last reapproval. A
superscript epsilon (´) indicates an editorial change since the last revision or reapproval.
1. Scope
1.1 This practice addresses the techniques of document provides procedures for measurement and reporting of basic static
performance (accuracy, repeatability, and so forth) of surgical navigation and/or robotic positioning devices under defined
conditions. The scope covers the tracking subsystem, testing only in this practice the accuracy and repeatabilityThey can be
performed on a subsystem (for example, tracking only) or a full computer-aided surgery system as would be used clinically. Testing
a subsystem does not mean that the whole system has been tested. The functionality to be tested based on this practice is limited
to the performance (accuracy in terms of bias and precision) of the system to locate individual points in space. regarding point
localization in space by means of a pointer. A point in space has no orientation; only multi-dimensionalmultidimensional objects
have orientation. Therefore, orientation of objects is not within the scope of this practice. However, in localizing a point the
different orientations of the localization tool pointer can produce errors. These errors and the orientation of the localization tool
pointer orientation are within the scope of this practice. The aim is to provide a standardized measurement of performance variables
by which end-users end users can compare within a system (for example, with different fixed reference frameselements or stylus
tools) pointers) and between different systems (for example, different manufacturers) different systems. from different
manufacturers). Parameters to be evaluated include (based upon the features of the system being evaluated):
(1) LocationAccuracy of a single point relative to a coordinate system.
(2) Relative point to point accuracy (linear).Sensitivity of tracking accuracy due to changes in pointer orientation.
(3) Repeatability of coordinates of a single point.Relative point-to-point accuracy.
(4) For an optically based system, the range of visible orientations of the reference frames or tools.
(5) This method covers all configurations of tool arrays in the system.
1.1.1 This method covers all configurations of the evaluated system as well as extreme placements across the measurement
volume.
1.2 The system as defined in this practice includes only the tracking subsystem (optical, magnetic, mechanical, and so forth) stylus,
computer, and necessary hardware and software. As such, this practice incorporates tests that can be applied to a prescribed
phantom model in a laboratory or controlled setting.
1.2 This practice defines a standardized reporting format, which includes definition of the coordinate systems to be used for
reporting the measurements, and statistical measures (for example, mean, standard deviation,RMS, and maximum error).
1.4 This practice will serve as the basis for subsequent standards for specific tasks (cutting, drilling, milling, reaming, biopsy
needle placement, and so forth) and surgical applications.
1
This practice is under the jurisdiction of ASTM Committee F04 on Medical and Surgical Materials and Devices and is the direct responsibility of Subcommittee F04.38
on Computer Assisted Orthopaedic Surgical Systems.
Current edition approved Nov. 1, 2018Sept. 1, 2022. Published December 2018September 2022. Originally approved in 2010. Last previous edition approved in 20102018
as F2554F2554 – 18.–10. DOI 10.1520/F2554–18.10.1520/F2554-22.
Copyright © ASTM International, 100 Barr Harbor Drive, PO Box C700, West Conshohocken, PA 19428-2959. United States
1

---------------------- Page: 1 ----------------------
F2554 − 22
1.3 The values stated in SI units are to be regarded as standard. No other units of measurement are included in this
standard.standard, except for angular measurements, which may be reported in terms of radians or degrees.
1.4 This standard does not purport to address all of the safety concerns, if any, associated with its use. It is the responsibility
of the user of this standard to establish appropriate safety, health, and environmental practices
...

Questions, Comments and Discussion

Ask us and Technical Secretary will try to provide an answer. You can facilitate discussion about the standard in here.