This paper represents a hybrid Vision/INS system in a microsurgical tool tracking application. Surgical MEMS devices must not only cope with all of the challenges that conventional MEMS devices have, but also address the integration of electronics and signal processing, calibration, reliability, accuracy and testing. A hybrid Vision/INS system with the integration of the Extended Kalman Filter precisely calculates 6D position-orientation of a microsurgical tool during surgery. This configuration guarantees the real-time tracking of the instrument. Ultimately, the vision system supports the IMU to deal with the drift problem but the position error increases dramatically in the absence of the vision system. In this paper, the tool motion modeling is proposed to bind the error in the acceptable range for a short period of missing data. The motion of the tool is modeled and updated at any time that the instrument is in the camera view field. This model is applied to the estimation algorithm whenever the camera is not in line of site and the optical data is missing.

Volume Subject Area:
Dynamic Systems and Control
Topics:
Algorithms, Calibration, Electronics, Errors, Instrumentation, Kalman filters, Microelectromechanical systems, Modeling, Reliability, Sensors, Signal processing, Surgery, Surgical tools, Testing
1.
Ang, W.T., Riviere, C.N., and Khosala, K. 2001. “Design and Implementation of Active Error Cancelling in Handheld Microsurgical Instrument“, Proceedings of IEEE/RSJ International Con. on Intelligent Robots and Systems, pp. 1106–1111.
2.
Ang, W.T., Khosala, K., and Riviere, C.N. 2003, “Design of All-Accelerometer Inertial Measurement Unit for Tremor Sensing in Hand-held Microsurgical Instrument“, Proceedings of IEEE International Con. on Robots & Automation, pp.1781–1786.
3.
Gaylor, D., and Lightsey, E. 2003. “GPS/INS Kalman Filter Design for Spacecraft Operating in the Proximity of International Space Station“, Proc. of AIAA Guidance, Navigation, and Control Conference and Exhibit.
4.
Ang, W.T. 2004, “Active Tremor Compensation in Handheld Instrument for Microsurgery“, PhD Thesis, Carnegie Mellon University.
5.
Tao, Y., Hu, H., Zhou, H. 2005. “Integration of Vision and Inertial Sensors for Home-based Rehabilitation“, Proceedings of IEEE International Conference on Robotics & Automation.
6.
Rehbinder, H., Hu, X. 2001. “Drift-Free Attitude Estimation for Accelerated Rigid Bodies“, Proceedings of IEEE International Conference on Robotics & Automation, pp. 4244–4249.
7.
Luinge, H.J. 2002. “Inertial Sensing of Human Movement“, PhD. Thesis, University of Twente, University Press.
8.
Bachmann, E.R., Yun, X., McKinney, D., McGhee, R.B., and Zyda, M.J. 2003. “Design and Implementation of MARG Sensors for 3DOF Orientation Measurement of Rigid Bodies“, Proceedings of IEEE International Con. on Robots & Automation, pp.1171–1178.
9.
Yun, X., Lizarrage, M. Bachmann, E.R., and McGhee. 2003. “An Improved Quaternion-Based Kalman Filter for Real-Time Tracking of Rigid Body Orientation“, Proceedings of IEEE/RSJ International Con. on Intelligent Robots and Systems, pp. 1074–1079.
10.
Foxlin
E.
,
Harrington
M.
, and
Altshuler
Y.
1998
. “
Miniature 6-DOF inertial system for tracking HMDs
” In
SPIE
Vol.
3362
, Helmet and Head-Mounted Displays III, AeroSense 98, pp.
214
–
228
.
11.
Foxlin, E., and Naimark, L. 2003. “VIS-Tracker: A Wearable Vision-Inertial Self-Tracker”, Proceedings of IEEE Virtual Reality, pp. 199–206.
12.
Huster, A. 2003. “Relative Position Sensing by Fusing Monocular Vision and Inertial Rate Sensors“, PhD. Thesis, Stanford University.
13.
Persa
S.
, and
Jonker
P.
2002
. “
Multi-sensor Robot Navigation System
”,
Proc. SPIE Int. Soc. Opt. Eng.
, Vol.
4573
,
187
–
194
.
14.
Farrell, J.A., and Barth, M. 1999. “The Global Positioning System & Inertial Navigation“, McGraw-Hill.
15.
Friedland
B.
1978
. “
Analysis Strapdown Navigation Using Quaternions
”,
IEEE Transaction on Aerospace and Electronics Systems
, Vol.
14
, No.
5
, pp.
764
–
768
.
16.
Foley, J., van dam, A., Feiner, S., and Hughes, J. 1996. “Computer Graphics: Principle and Practice in C“, Second Edition, Addison-Wesley.
17.
http://www.vision.caltech.edu/bouguetj/calib_doc/.
18.
Rittscher, J., and Blake, A. 1999. “Classification of human body motion“, Proc. Int. Conf. Computer Vision, pp. 634–639.
19.
Isard
M.
, and
Blake
A.
1998
. “
Condensation-Conditional Density Propagation for Visual Tracking
”,
Int. Journal of Computer Vision
, Vol.
29
, No.
1
, pp.
5
–
28
.
20.
Blake, A., and Isard, M. 1998. “Active Contours“, Springer-Verlag.
This content is only available via PDF.
Copyright © 2006
 by ASME
You do not currently have access to this content.