Abstract
Tracking of the position and orientation of a moving object by a camera can be accomplished by attaching a 2D marker with a specific pattern on the object. Recently, we have developed a projection-based surgical navigation system that can accurately guide in real-time the pre-operative plan of resection in orthopedic surgery, such as joint replacement or wide-resection of osteosarcoma (bone tumor). To this end, it is important to study the accuracy of registration and tracking due to various sources of errors, such as the printing resolution and quality of the 2D marker. In this study, we investigate and provide analysis of error and uncertainty for real-time tracking using a 2D marker with a camera. Experiments and computational simulations were conducted to quantify the estimation of errors in position and orientation due to the printing error of 2D markers using a 600-dpi laser printer. In addition, a theory of uncertainty propagation in a form of congruence transformation was derived for such systems and is illustrated with experimental results.
Issue Section:
Research Papers
References
1.
Garrido-Jurado
,
S.
,
Muñoz-Salinas
,
R.
,
Madrid-Cuevas
,
F. J.
, and
Marín-Jiménez
,
M. J.
, 2014
, “
Automatic Generation and Detection of Highly Reliable Fiducial Markers Under Occlusion
,” Pattern Recognit.
,
47
(6
), pp. 2280
–2292
.10.1016/j.patcog.2014.01.0052.
Babinec
,
A.
,
Jurišica
,
L.
,
Hubinský
,
P.
, and
Duchoň
,
F.
, 2014
, “
Visual Localization of Mobile Robot Using Artificial Markers
,” Procedia Eng.
,
96
(28
), pp. 1
–9
.10.1016/j.proeng.2014.12.0913.
Avola
,
D.
,
Cinque
,
L.
,
Foresti
,
G. L.
,
Mercuri
,
C.
, and
Pannone
,
D.
, 2016,
“
A Practical Framework for the Development of Augmented Reality Applications by Using Aruco Markers
,” International Conference on Pattern Recognition Applications and Methods
, Vol. 2,
SciTePress
, Rome, Italy, Feb. 24–26, pp. 645
–654
.10.5220/00057558064506544.
Hayat
,
A. A.
,
Boby
,
R. A.
, and
Saha
,
S. K.
, 2019
, “
A Geometric Approach for Kinematic Identification of an Industrial Robot Using a Monocular Camera
,” Rob. Comput.-Integr. Manuf.
,
57
(6
), pp. 329
–346
.10.1016/j.rcim.2018.11.0085.
Malham
,
G. M.
, and
Wells-Quinn
,
T.
, 2019
, “
What Should my Hospital Buy Next?-Guidelines for the Acquisition and Application of Imaging, Navigation, and Robotics for Spine Surgery
,” J. Spine Surg.
,
5
(1
), pp. 155
–165
.10.21037/jss.2019.02.046.
Johnston
,
G.
, 2021
, private communication.7.
He
,
G.
,
Dai
,
A. Z.
,
Mustahsan
,
V. M.
,
Shah
,
A. T.
,
Li
,
L.
,
Khan
,
J. A.
, and
Bielski
,
M. R.
, , 2022
, “
A Novel Method of Light Projection and Modular Jigs to Improve Accuracy in Bone Sarcoma Resection
,” J. Orthop. Res.
,
40
(11
), pp. 2522
–2536
.10.1002/jor.253008.
He
,
G.
,
Dai
,
A. Z.
,
Mustahsan
,
V. M.
,
Shah
,
A. T.
,
Li
,
L.
,
Khan
,
J. A.
,
Bielski
,
M. R.
,
Komatsu
,
D. E.
,
Kao
,
I.
, and
Khan
,
F. A.
, 2022
, “
A Novel Intraoperative Method to Project Osteotomy Lines for Accurate Resection of Primary Bone Sarcomas
,” J. Orthop.
,
32
(4
), pp. 60
–67
.10.1016/j.jor.2022.04.0189.
He
,
G.
,
Mustahsan
,
V. M.
,
Bielski
,
M. R.
,
Kao
,
I.
, and
Khan
,
F. A.
, 2021
, “
Report on a Novel Bone Registration Method: A Rapid, Accurate, and Radiation-Free Technique for Computer-and Robotic-Assisted Orthopedic Surgeries
,” J. Orthop.
,
23
(1
), pp. 227
–232
.10.1016/j.jor.2021.01.01010.
He
,
G.
,
Ricca
,
J. M.
,
Dai
,
A. Z.
,
Mustahsan
,
V. M.
,
Cai
,
Y.
,
Bielski
,
M. R.
,
Kao
,
I.
, and
Khan
,
F. A.
, 2022
, “
A Novel Bone Registration Method Using Impression Molding and Structured-Light 3d Scanning Technology
,” J. Orthop. Res.
,
40
(10
), pp. 2340
–2349
.10.1002/jor.2527511.
Khan
,
F.
,
Bielski
,
M.
,
Khan
,
J.
,
Kao
,
I.
, and
He
,
G.
, 2020
, “
System and method to conduct bone surgery
,” U.S. patent application 16/854,804.12.
Khan
,
F.
,
Pearle
,
A.
,
Lightcap
,
C.
,
Boland
,
P. J.
, and
Healey
,
J. H.
, 2013
, “
Haptic Robot-Assisted Surgery Improves Accuracy of Wide Resection of Bone Tumors: A Pilot Study
,” Clin. Orthop. Relat. Res.
,
471
(3
), pp. 851
–859
.10.1007/s11999-012-2529-713.
Hadi
,
M.
,
Barlow
,
T.
,
Ahmed
,
I.
,
Dunbar
,
M.
,
McCulloch
,
P.
, and
Griffin
,
D.
, 2015
, “
Does Malalignment Affect Revision Rate in Total Knee Replacements: A Systematic Review of the Literature
,” Springerplus
,
4
(1
), pp. 1
–12
.10.1186/s40064-015-1604-414.
Kato
,
H.
, and
Billinghurst
,
M.
, 1999
, “
Marker Tracking and Hmd Calibration for a Video-Based Augmented Reality Conferencing System
,” Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99
),
IEEE
, San Francisco, CA, Oct. 20–21, pp. 85
–94
.10.1109/IWAR.1999.80380915.
Fiala
,
M.
, 2010
, “
Designing Highly Reliable Fiducial Markers
,” IEEE Trans. Pattern Analysis Mach. Intell.
,
32
(7
), pp. 1317
–1324
.10.1109/TPAMI.2009.14616.
Wagner
,
D.
, and
Schmalstieg
,
D.
, 2007
, “
Artoolkitplus for Pose Tracking on Mobile Devices
,” Proceedings of 12th Computer Vision Winter Workshop
, St. Lambrecht, Austria, Feb. 6–8, pp. 114
–121
.https://www.researchgate.net/publication/216813818_ARToolKitPlus_for_Pose_Tracking_on_Mobile_Devices17.
Tanaka
,
H.
,
Sumi
,
Y.
, and
Matsumoto
,
Y.
, 2012
, “
A High-Accuracy Visual Marker Based on a Microlens Array
,” 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems, IEEE
,
Vilamoura, Portugal, Oct. 7–12
, pp. 4192
–4197
.10.1109/IROS.2012.638605218.
Tanaka
,
H.
,
Sumi
,
Y.
, and
Matsumoto
,
Y.
, 2012
, “
Avisual Marker for Precise Pose Estimation Based on Lenticular Lenses
,” 2012 IEEE International Conference on Robotics and Automation, IEEE
,
St Paul, MN, May 14–18
, pp. 5222
–5227
.10.1109/ICRA.2012.622511419.
Huang
,
B.
,
Tang
,
Y.
,
Ozdemir
,
S.
, and
Ling
,
H.
, 2020
, “
A Fast and Flexible Projector-Camera Calibration System
,” IEEE Transactions on Automation Science and Engineering
, 18(3), pp. 1049
–1063
.10.1109/TASE.2020.299422320.
Moreno
,
D.
, and
Taubin
,
G.
, 2012
, “
Simple, Accurate, and Robust Projector-Camera Calibration
,” 2012 Second International Conference on 3D Imaging, Modeling, Processing, Visualization & Transmission
,
IEEE, Zurich, Switzerland, Oct. 13–15
, pp. 464
–471
.10.1109/3DIMP VT.2012.7721.
He
,
G.
,
Dai
,
A. Z.
,
Mustahsan
,
V. M.
,
Blum
,
C. L.
,
Kao
,
I.
, and
Khan
,
F. A.
, 2022
, “
A Novel 3d Light Assisted Drawing (3d-Lad) Method to Aid Intraoperative Reproduction of Osteotomy Lines Surrounding a Bone Tumor During Wide Resection: An Experimental Study
,” Orthopedic Res. Rev.
,
14
, pp. 101
–109
.10.2147/ORR.S34924022.
Förstner
,
W.
, and
Gülch
,
E.
, 1987
, “
A Fast Operator for Detection and Precise Location of Distinct Points, Corners and Centres of Circular Features
,” Proceedings of Intercommission Conference on Fast Processing of Photogrammetric Data
, Interlaken, Switzerland, 2–4 June, pp. 281
–305
.23.
Prince
,
S. J.
, 2012
, Computer Vision: Models, Learning, and Inference
,
Cambridge University Press
, Cambridge, UK.24.
Gao
,
X.-S.
,
Hou
,
X.-R.
,
Tang
,
J.
, and
Cheng
,
H.-F.
, 2003
, “
Complete Solution Classification for the Perspective-Three-Point Problem
,” IEEE Trans. Pattern Anal. Mach. Intel.
,
25
(8
), pp. 930
–943
.25.
Drap
,
P.
, and
Lefèvre
,
J.
, 2016
, “
An Exact Formula for Calculating Inverse Radial Lens Distortions
,” Sensors
,
16
(6
), p. 807
.10.3390/s1606080726.
Craig
,
J. J.
, 2005
, Introduction to Robotics: Mechanics and Control
,
Pearson Education
, Upper Saddle River, NJ.27.
Bradski
,
G.
, 2000
, “
The OpenCV Library
,” Dr. Dobb's J. Software Tools, 120(11), pp. 122
–125
.28.
Hasegawa
,
M.
,
Naito
,
Y.
,
Tone
,
S.
, and
Sudo
,
A.
, 2022
, “
Accuracy of a Novel Accelerometer-Based Navigation (Naviswiss) for Total Hip Arthroplasty in the Supine Position
,” BMC Musculoskeletal Disord.
,
23
(1
), pp. 1
–7
.29.
Hoff
,
W.
, and
Vincent
,
T.
, 2000
, “
Analysis of Head Pose Accuracy in Augmented Reality
,” IEEE Trans. Visualization Comput. Graph.
,
6
(4
), pp. 319
–334
.10.1109/2945.89587730.
Förstner
,
W.
, and
Wrobel
,
B. P.
, 2016
, Photogrammetric Computer Vision
,
Springer, Springer International Publishing Switzerland.31.
ASME
, 2013
, Test Uncertainty, Vol. Performance Test Codes
,
American Society of Mechanical Engineers
,
New York
.32.
Coleman
,
H. W.
, and
Steele
,
W. G.
, 2018
, Experimentation, Validation, and Uncertainty Analysis for Engineers
,
Wiley
, Hoboken, NJ.33.
Roache
,
P. J.
, 2013
, Fundamentals of Verification and Validation
,
Hermosa Publishers
,
New York/Socorro, NM
.Copyright © 2023 by ASME
You do not currently have access to this content.
