ASTM F2554-10
(Practice)Standard Practice for Measurement of Positional Accuracy of Computer Assisted Surgical Systems
Standard Practice for Measurement of Positional Accuracy of Computer Assisted Surgical Systems
SIGNIFICANCE AND USE
The purpose of this practice is to provide data that can be used for evaluation of the accuracy of different CAS systems.
The use of surgical navigation and robotic positioning systems is becoming increasingly common and requires a degree of trust by the user that the data provided by the system meets necessary accuracy requirements. In order to evaluate the potential use of these systems, and to make informed decisions about suitability of a system for a given procedure, objective performance data of such systems are necessary. While the end user will ultimately want to know the accuracy parameters of a system under clinical application, the first step must be to characterize the digitization accuracy of the tracking subsystem in a controlled environment under controlled conditions.
In order to make comparisons within and between systems, a standardized way of measuring and reporting accuracy is needed. Parameters such as coordinate system, units of measure, terminology, and operational conditions must be standardized.
SCOPE
1.1 This practice addresses the techniques of measurement and reporting of basic static performance (accuracy, repeatability, and so forth) of surgical navigation and/or robotic positioning devices under defined conditions. The scope covers the tracking subsystem, testing only in this practice the accuracy and repeatability of the system to locate individual points in space. A point in space has no orientation; only multi-dimensional objects have orientation. Therefore, orientation of objects is not within the scope of this practice. However, in localizing a point the different orientations of the localization tool can produce errors. These errors and the orientation of the localization tool are within the scope of this practice. The aim is to provide a standardized measurement of performance variables by which end-users can compare within (for example, different fixed reference frames or stylus tools) and between (for example, different manufacturers) different systems. Parameters to be evaluated include (based upon the features of the system being evaluated):
(1) Location of a point relative to a coordinate system.
(2) Relative point to point accuracy (linear).
(3) Repeatability of coordinates of a single point.
(4) For an optically based system, the range of visible orientations of the reference frames or tools.
(5) This method covers all configurations of tool arrays in the system.
1.2 The system as defined in this practice includes only the tracking subsystem (optical, magnetic, mechanical, and so forth) stylus, computer, and necessary hardware and software. As such, this practice incorporates tests that can be applied to a prescribed phantom model in a laboratory or controlled setting.
1.3 This practice defines a standardized reporting format, which includes definition of the coordinate systems to be used for reporting the measurements, and statistical measures (for example, mean, standard deviation, maximum error).
1.4 This practice will serve as the basis for subsequent standards for specific tasks (cutting, drilling, milling, reaming, biopsy needle placement, and so forth) and surgical applications.
1.5 The values stated in SI units are to be regarded as standard. No other units of measurement are included in this standard.
1.6 This standard does not purport to address all of the safety concerns, if any, associated with its use. It is the responsibility of the user of this standard to establish appropriate safety and health practices and determine the applicability of regulatory limitations prior to use.
General Information
Relations
Standards Content (Sample)
NOTICE: This standard has either been superseded and replaced by a new version or withdrawn.
Contact ASTM International (www.astm.org) for the latest information
Designation: F2554 − 10
Standard Practice for
Measurement of Positional Accuracy of Computer Assisted
1
Surgical Systems
This standard is issued under the fixed designation F2554; the number immediately following the designation indicates the year of
original adoption or, in the case of revision, the year of last revision.Anumber in parentheses indicates the year of last reapproval.A
superscript epsilon (´) indicates an editorial change since the last revision or reapproval.
1. Scope 1.4 This practice will serve as the basis for subsequent
standards for specific tasks (cutting, drilling, milling, reaming,
1.1 This practice addresses the techniques of measurement
biopsy needle placement, and so forth) and surgical applica-
and reporting of basic static performance (accuracy,
tions.
repeatability,andsoforth)ofsurgicalnavigationand/orrobotic
positioningdevicesunderdefinedconditions.Thescopecovers 1.5 The values stated in SI units are to be regarded as
the tracking subsystem, testing only in this practice the standard. No other units of measurement are included in this
accuracy and repeatability of the system to locate individual standard.
points in space. A point in space has no orientation; only
1.6 This standard does not purport to address all of the
multi-dimensional objects have orientation. Therefore, orien-
safety concerns, if any, associated with its use. It is the
tation of objects is not within the scope of this practice.
responsibility of the user of this standard to establish appro-
However, in localizing a point the different orientations of the
priate safety and health practices and determine the applica-
localization tool can produce errors. These errors and the
bility of regulatory limitations prior to use.
orientation of the localization tool are within the scope of this
practice. The aim is to provide a standardized measurement of
2. Referenced Documents
performance variables by which end-users can compare within
2
2.1 ASTM Standards:
(for example, different fixed reference frames or stylus tools)
E456Terminology Relating to Quality and Statistics
and between (for example, different manufacturers) different
E2281Practice for Process and Measurement Capability
systems. Parameters to be evaluated include (based upon the
Indices
features of the system being evaluated):
2.2 Other References:
(1)Location of a point relative to a coordinate system.
ISO 10360Geometrical Product Specifications (GPS)—
(2)Relative point to point accuracy (linear).
Acceptance and Reverification Tests for Coordinate Mea-
(3)Repeatability of coordinates of a single point.
suring Machines (CMM)
(4)For an optically based system, the range of visible
orientations of the reference frames or tools.
3. Terminology
(5)This method covers all configurations of tool arrays in
the system. 3.1 Definition of Terms Specific to Accuracy Reporting:
3.1.1 accuracy, n—the closeness of agreement between a
1.2 The system as defined in this practice includes only the
measurement result and an accepted reference value. E456
tracking subsystem (optical, magnetic, mechanical, and so
3.1.1.1 Discussion—The term accuracy, when applied to a
forth) stylus, computer, and necessary hardware and software.
set of measurement results, involves a combination of a
As such, this practice incorporates tests that can be applied to
random component and of a common systematic error or bias
a prescribed phantom model in a laboratory or controlled
component.
setting.
3.1.2 bias, n—the difference between the expectation of the
1.3 This practice defines a standardized reporting format,
measurement results and an accepted reference value. E456
which includes definition of the coordinate systems to be used
3.1.2.1 Discussion—Bias is the total systematic error as
for reporting the measurements, and statistical measures (for
contrasted to random error. There may be one or more
example, mean, standard deviation, maximum error).
systematic error components contributing to the bias. A larger
1
ThispracticeisunderthejurisdictionofASTMCommitteeF04onMedicaland
2
Surgical Materials and Devices and is the direct responsibility of Subcommittee For referenced ASTM standards, visit the ASTM website, www.astm.org, or
F04.38 on Computer Assisted Orthopaedic Surgical Systems. contact ASTM Customer Service at service@astm.org. For Annual Book of ASTM
Current edition approved Dec. 1, 2010. Published January 2011. DOI 10.1520/ Standards volume information, refer to the standard’s Document Summary page on
F2554–10. the ASTM website.
Copyright © ASTM International, 100 Barr Harbor Drive, PO Box C700, West Conshohocken, PA 19428-2959. United States
1
---------------------- Page: 1 ----------------------
F2554 − 10
systematic difference from the accepted reference value is shows the location of the distribution, the variance indicates
refl
...
Questions, Comments and Discussion
Ask us and Technical Secretary will try to provide an answer. You can facilitate discussion about the standard in here.