Medical Engineering & Physics
Volume 31, Issue 8 , Pages 887-898 , October 2009

Review on aspects of artificial tactile feedback in laparoscopic surgery

  • Sebastian Schostek

      Affiliations

    • novineon Healthcare Technology Partners GmbH, Tübingen, Germany
    • Section for Minimally Invasive Surgery, Eberhard-Karls University Tuebingen, Tuebingen, Germany
    • Corresponding Author InformationCorresponding author at: novineon Healthcare Technology Partners GmbH, Dorfackerstrasse 26, 72074 Tübingen, Germany. Tel.: +49 7071 7704514.
    • ,
  • Marc O. Schurr

      Affiliations

    • novineon Healthcare Technology Partners GmbH, Tübingen, Germany
    • ,
  • Gerhard F. Buess

      Affiliations

    • Section for Minimally Invasive Surgery, Eberhard-Karls University Tuebingen, Tuebingen, Germany

Received 21 May 2008 ,Revised 10 June 2009 ,Accepted 12 June 2009.

References 

  1. Velanovich V. Laparoscopic vs open surgery: a preliminary comparison of quality-of-life outcomes. Surg Endosc. 2000;14:16–21
  2. Cuschieri A. Whither minimal access surgery: tribulations and expectations. Am J Surg. 1995;169:9–19
  3. Cuschieri A, Buess G. Introduction and historical aspects. In:  Cuschieri A,  Buess G,  Périssat J editor. Operative manual of endoscopic surgery. Berlin Heidelberg: Springer-Verlag; 1992;
  4. McWilliams A. Trends in the noninvasive and minimally invasive medical device market. BCC Res. 2006;
  5. Ruurda JP, van Vroonhoven TJ, Broeders IA. Robot-assisted surgical systems: a new era in laparoscopic surgery. Ann R Coll Surg Engl. 2002;84:223–226
  6. Buess GF, Schurr MO, Fischer SC. Robotics and allied technologies in endoscopic surgery. Arch Surg. 2000;135:229–235
  7. Schurr MO, Buess G, Neisius B, Voges U. Robotics and telemanipulation technologies for endoscopic surgery. A review of the ARTEMIS project. Advanced robotic telemanipulator for minimally invasive surgery. Surg Endosc. 2000;14:375–381
  8. Camarillo DB, Krummel TM, Salisbury JK. Robotic technology in surgery: past, present, and future. Am J Surg. 2004;188:2S–15S
  9. Mokwa W. Medical implants based on microsystems. Meas Sci Technol. 2007;18:R47–57
  10. Schostek S, Fischer H, Kalanovic D, Schurr MO. Microsystems in medicine. 1st ed.. Stuttgart/Berlin: Steinbeis Edition; 2006;107 pp.
  11. Schurr MO, Schostek S, Ho CN, Rieber F, Menciassi A. Microtechnologies in medicine, an overview. Minim Invasive Ther Allied Technol. 2007;16:76–86
  12. Rattner DW, Park A. Advanced devices for the operating room of the future. Semin Laparosc Surg. 2003;10:85–89
  13. Schurr MO. Sensors in minimally invasive therapy—a technology coming of age. Minim Invasive Ther Allied Technol. 2004;13:67
  14. Reyes DA, Tang B, Cuschieri A. Minimal access surgery (MAS)-related surgeon morbidity syndromes. Surg Endosc. 2006;20:1–13
  15. Berguer R, Forkey DL, Smith WD. Ergonomic problems associated with laparoscopic surgery. Surg Endosc. 1999;13:466–468
  16. Alarcon A, Berguer R. A comparison of operating room crowding between open and laparoscopic operations. Surg Endosc. 1996;10:916–919
  17. Cao CG, Zhou M, Jones DB, Schwaitzberg SD. Can surgeons think and operate with haptics at the same time?. J Gastrointest Surg. 2007;11:1564–1569
  18. Reiner M. Seeing through touch: the role of haptic information in visualization. In:  Gilbert JK,  Reiner M,  Nakhleh M editor. Visualization: theory and practice in science education. Springer; 2008;
  19. Craig JC, Rollman GB. Somesthesis. Annu Rev Psychol. 1999;50:305–331
  20. Kálmán M, Csillag A. The skin and diffuse sensory systems. In:  Csillag A editors. Atlas of the sensory organs. Humana Press; 2005;
  21. Loomis JM, Lederman SJ. Tactual perception. In:  Boff KR,  Kaufman L,  Thomas JP editor. Handbook of perception and human performance. Wiley-Interscience; 1982;p. 1–41
  22. van Bergen P, Kunert W, Buess GF. The effect of high-definition imaging on surgical task efficiency in minimally invasive surgery: an experimental comparison between three-dimensional imaging and direct vision through a stereoscopic TEM rectoscope. Surg Endosc. 2000;14:71–74
  23. Frank TG, Hanna GB, Cuschieri A. Technological aspects of minimal access surgery. Proc Inst Mech Eng [H]. 1997;211:129–144
  24. Stassen HG, Dankelman J, Grimbergen KA, Meijer DW. Man–machine aspects of minimally invasive surgery. Ann Rev Control. 2001;25:111–122
  25. Rasmussen J. Skills, rules, and knowledge; signals, signs and symbols, and other distinctions in human performance models. IEEE Trans Sys Man Cybern. 1983;13:257–266
  26. Wentink M, Stassen LP, Alwayn I, Hosman RJ, Stassen HG. Rasmussen's model of human behavior in laparoscopy training. Surg Endosc. 2003;17:1241–1246
  27. Stassen HG, Johannsen G, Moray N. Internal representation, internal model, human performance model and mental workload. Automatica. 1990;26:811–820
  28. Hale KS, Stanney KM. Deriving haptic design guidelines from human physiological, psychophysical, and neurological foundations. IEEE Comput Graph Appl. 2004;24:33–39
  29. Breedveld P, Stassen HG, Meijer DW, Jakimowicz JJ. Observation in laparoscopic surgery: overview of impeding effects and supporting aids. J Laparoendosc Adv Surg Tech A. 2000;10:231–241
  30. Dankelman , Wentink , Stassen . Human reliability and training in minimally invasive surgery. Minim Invasive Ther Allied Technol. 2003;12:129–135
  31. Jones DB, Brewer JD, Soper NJ. The influence of three-dimensional video systems on laparoscopic task performance. Surg Laparosc Endosc. 1996;6:191–197
  32. Breedveld P, Wentink M. Eye–hand coordination in laparoscopy—an overview of experiments and supporting aids. Minim Invas Ther Allied Technol. 2001;10:155–162
  33. Mueglitz J, Kunad G, Dautzenberg P, Neisius B, Trapp R. Kinematic problems of manipulators for minimal invasive surgery. Endosc Surg Allied Technol. 1993;1:160–164
  34. Breedveld P, Stassen HG, Meijer DW, Jakimowicz JJ. Manipulation in laparoscopic surgery: overview of impeding effects and supporting aids. J Laparoendosc Adv Surg Tech A. 1999;9:469–480
  35. Picod G, Jambon AC, Vinatier D, Dubois P. What can the operator actually feel when performing a laparoscopy?. Surg Endosc. 2005;19:95–100
  36. van den Dobbelsteen JJ, Schooleman A, Dankelman J. Friction dynamics of trocars. Surg Endosc. 2007;21:1338–1343
  37. Tirabassi MV, Wadie G, Tashjian DB, Moriarty KP. Improving tactile sensation in minimally invasive pediatric surgery. J Laparoendosc Adv Surg Tech A. 2007;17:501–503
  38. Zhou M, Perreault J, Schwaitzberg SD, Cao CG. Effects of experience on force perception threshold in minimally invasive surgery. Surg Endosc. 2007;22:510–515
  39. den Boer KT, Herder JL, Sjoerdsma W, Meijer DW, Gouma DJ, Stassen HG. Sensitivity of laparoscopic dissectors. Surg Endosc. 1999;13:869–873
  40. Heijnsdijk EA, Dankelman J, Gouma DJ. Effectiveness of grasping and duration of clamping using laparoscopic graspers. Surg Endosc. 2002;16:1329–1331
  41. Bholat OS, Haluck RS, Murray WB, Gorman PJ, Krummel TM. Tactile feedback is present during minimally invasive surgery. J Am Coll Surg. 1999;189:349–355
  42. Tholey G, Desai JP, Castellanos AE. Force feedback plays a significant role in minimally invasive surgery: results and analysis. Ann Surg. 2005;241:102–109
  43. Tavakoli M, Aziminejad A, Patel RV, Moallem M. Multi-sensory force/deformation cues for stiffness characterization in soft-tissue palpation. Conf Proc IEEE Eng Med Biol Soc. 2006;1:837–840
  44. Ballantyne GH. Robotic surgery, telerobotic surgery, telepresence, and telementoring. Review of early clinical results. Surg Endosc. 2002;16:1389–1402
  45. Tavakoli M, Aziminejad A, Patel RV, Moallem M. Methods and mechanisms for contact feedback in a robot-assisted minimally invasive environment. Surg Endosc. 2006;20:1570–1579
  46. Hashizume M, Shimada M, Tomikawa M, et al. Early experiences of endoscopic procedures in general surgery assisted by a computer-enhanced surgical system. Surg Endosc. 2002;16:1187–1191
  47. Sung GT, Gill IS. Robotic laparoscopic surgery: a comparison of the Da Vinci and Zeus systems. Urology. 2001;58:893–898
  48. Omata S, Murayama Y, Constantinou CE. Real time robotic tactile sensor system for the determination of the physical properties of biomaterials. Sens Actuators A. 2004;112:278–285
  49. King CH, Higa AT, Culjat MO, et al. A pneumatic haptic feedback actuator array for robotic surgery or simulation. Stud Health Technol Inform. 2007;125:217–222
  50. Tavakoli M, Patel RV. Haptics in telerobotic systems for minimally invasive surgery. In:  Kumar S,  Marescaux J editor. Telesurgery. Berlin, Heidelberg: Springer-Verlag; 2008;
  51. Bethea BT, Okamura AM, Kitagawa M, et al. Application of haptic feedback to robotic surgery. J Laparoendosc Adv Surg Tech A. 2004;14:191–195
  52. Rassweiler J, Frede T, Seemann O, Stock C, Sentker L. Telepresence surgery: first experiences with laparoscopic radical prostatectomy. Minim Invasive Ther Allied Technol. 2001;10:261–270
  53. Katkhouda N, Mason RJ, Mavor E, et al. Laparoscopic finger-assisted technique (fingeroscopy) for treatment of complicated appendicitis. J Am Coll Surg. 1999;189:131–133
  54. Van de Walle P, Blomme Y, Van Outryve L. Hand-assisted staging laparoscopy for suspected malignancies of the pancreas. Acta Chir Belg. 2002;102:183–186
  55. Baumann I, Plinkert PK, Kunert W, Buess GF. Vibrotactile characteristics of different tissues in endoscopic otolaryngologic surgery—in vivo and ex vivo measurements. Minim Invasive Ther Allied Technol. 2001;10:323–327
  56. Miyaji K, Furuse A, Nakajima J, et al. The stiffness of lymph nodes containing lung carcinoma metastases: a new diagnostic parameter measured by a tactile sensor. Cancer. 1997;80:1920–1925
  57. Memon MA, Fitzgibbons RJ. Hand-assisted laparoscopic surgery (HALS): a useful technique for complex laparoscopic abdominal procedures. J Laparoendosc Adv Surg Tech A. 1998;8:143–150
  58. Gaar E. Errors in laparoscopic surgery. J Surg Oncol. 2004;88:153–160
  59. Connor S, Garden OJ. Bile duct injury in the era of laparoscopic cholecystectomy. Br J Surg. 2006;93:158–168
  60. Williams EJ, Green J, Beckingham I, Parks R, Martin D, Lombard M. Guidelines on the management of common bile duct stones (CBDS). Gut. 2008;57:1004–1021
  61. Cartmill JA, Shakeshaft AJ, Walsh WR, Martin CJ. High pressures are generated at the tip of laparoscopic graspers. Aust N Z J Surg. 1999;69:127–130
  62. Marucci DD, Shakeshaft AJ, Cartmill JA, Cox MR, Adams SG, Martin CJ. Grasper trauma during laparoscopic cholecystectomy. Aust N Z J Surg. 2000;70:578–581
  63. de Visser H, Heijnsdijk EA, Herder JL, Pistecky PV. Forces and displacements in colon surgery. Surg Endosc. 2002;16:1426–1430
  64. Howe RD, Peine WJ, Kontarinis DA, Son JS. Remote palpation technology. IEEE Eng Med Biol. 1995;14:318–323
  65. Johansson RS, Vallbo AB. Tactile sensibility in the human hand: relative and absolute densities of four types of mechanoreceptive units in glabrous skin. J Physiol. 1979;286:283–300
  66. Dargahi J, Najarian S. Human tactile perception as a standard for artificial tactile sensing—a review. Int J Med Robot. 2004;1:23–35
  67. Johnson KO. The roles and functions of cutaneous mechanoreceptors. Curr Opin Neurobiol. 2001;11:455–461
  68. Pawluk D, Howe RD. A holistic model of human touch. In: 5th annual CNS meeting. 1996;
  69. Lee MH, Nicholls HR. Tactile sensing for mechatronics—a state of the art survey. Mechatronics. 1999;9:1–31
  70. Westebring-van der Putten EP, Goossens RH, Jakimowicz JJ, Dankelman J. Haptics in minimally invasive surgery—a review. Minim Invasive Ther Allied Technol. 2008;17:3–16
  71. Etlaib MEH, Hewit JR. Tactile sensing technology for minimal access surgery—a review. Mechatronics. 2003;13:1163–1177
  72. Puangmali P, Althoefer K, Seneviratne LD, Murphy D, Dasgupta P. State-of-the-art in force and tactile sensing for minimally invasive surgery. IEEE Sens J. 2008;8:371–381
  73. Heijnsdijk EA, de Visser H, Dankelman J, Gouma DJ. Slip and damage properties of jaws of laparoscopic graspers. Surg Endosc. 2004;18:974–979
  74. Ho CN, Schostek S, Fuchsberger A, Kalanovic D, Schurr MO. System design of a tactile instrument for use in minimally invasive surgery based on an international market study. Biomed Tech (Berl). 2004;49(Suppl. 1):44–45
  75. Bicchi A, Scilingo EP, De Rossi D. Haptic discrimination of softness in teleoperation: the role of the contact area spread rate. IEEE Trans Rob Automat. 2000;16:496–504
  76. Hu T, Tholey G, Desai JP, Castellanos AE. Evaluation of a laparoscopic grasper with force feedback. Surg Endosc. 2004;18:863–867
  77. Bicchi A, Canepa G, De Rossi D, Iacconi P, Scilingo EP. A sensorized minimally invasive surgery tool for detecting tissutal elastic properties. In: IEEE international conference on robotics and automation. Minneapolis, MN, US. 1996;p. 884–888
  78. van Hemert tot Dingshof V, Lazeroms V, van der Ham A, Jongkind W, Honderd G. Force reflection for a laparoscopic grasper. In: 18th annual conference of the IEEE engineering in medicine and biology society. Amsterdam, Holland. 1996;p. 210–211
  79. Sedaghati R, Dargahi J, Singh H. Design and modeling of an endoscopic piezoelectric tactile sensor. Int J Solids Struct. 2005;42:5872–5886
  80. Najarian S, Dargahi J, Zheng XZ. A novel method in measuring the stiffness of sensed objects with applications for biomedical robotic systems. Int J Med Robot. 2006;2:84–90
  81. Petter E, Biehl M, Meyer J-U. Vibrotactile palpation instrument for use in minimally invasive surgery. In: 18th annual international conference of the IEEE engineering in medicine and biology society. Amsterdam, Holland. 1996;
  82. Stroop R, Uribe DO, Martinez MO, Brökelmann M, Hemsel T, Wallaschek J. Tactile tissue characterisation by piezoelectric systems. J Electroceram. 2008;20:237–241
  83. Sakai N, Tatsuta M, Yano H, Iishi H, Ishiguro S. Diagnosis of the extent of gastric cancers by a new endoscopic ultrasonic tactile sensor. Gastrointest Endosc. 2000;51:69–73
  84. Yoshida T, Inoue H, Kawano T, Takeshita K, Iwai T. The ultrasonic tactile sensor: in vivo clinical application for evaluation of depth of invasion in esophageal squamous cell carcinomas. Endoscopy. 1999;31:442–446
  85. Ohtsuka T, Furuse A, Kohno T, Nakajima J, Yagyu K, Omata S. Application of a new tactile sensor to thoracoscopic surgery: experimental and clinical study. Ann Thorac Surg. 1995;60:610–613[discussion 4]
  86. Shikida M, Shimizu T, Sato K, Itoigawa K. Active tactile sensor for detecting contact force and hardness of an object. Sens Actuators A. 2003;103:213–218
  87. Tanaka M, Furubayashi M, Tanahashi Y, Chonan S. Development of an active palpation sensor for detecting prostatic cancer and hypertrophy. Smart Mater Struct. 2000;9:878–884
  88. Hasegawa Y, Shikida M, Shimizu T, et al. A micromachined active tactile sensor for hardness detection. Sens Actuators A. 2004;114:141–146
  89. Gierke HE, Oestreicher HL, Franke EK, Parrack HO, Wittern WW. Physics of vibrations in living tissues. J Appl Physiol. 1952;4:886–900
  90. Johnson KO, Yoshioka T, Vega-Bermudez F. Tactile functions of mechanoreceptive afferents innervating the hand. J Clin Neurophysiol. 2000;17:539–558
  91. Dargahi J, Najarian S. Theoretical and experimental analysis of a piezoelectric tactile sensor for use in endoscopic surgery. Sens Rev. 2004;24:74–83
  92. Kattavenos N, Lawreson B, Frank TG, Pridham MS, Keatch RP, Cuschieri A. Force-sensitive tactile sensor for minimal access surgery. Minim Invasive Ther Allied Technol. 2004;13:42–46
  93. Leineweber M, Pelz G, Schmidt M, Kappert H, Zimmer G. New tactile sensor chip with silicone rubber cover. Sens Actuators. 2000;84:236–245
  94. Ottermo MV, Ovstedal M, Lango T, et al. The role of tactile feedback in laparoscopic surgery. Surg Laparosc Endosc Percutan Tech. 2006;16:390–400
  95. Ottermo MV, Stavdahl O, Johansen TA. Palpation instrument for augmented minimally invasive surgery. In: IEEE/RSJ international conference on intelligent robots and systems 4. 2004;p. 3960–3964
  96. Schostek S, Ho CN, Kalanovic D, Schurr MO. Artificial tactile sensing in minimally invasive surgery—a new technical approach. Minim Invasive Ther Allied Technol. 2006;15:296–304
  97. Dargahi J, Najarian S. A supported membrane type sensor for medical tactile mapping. Sens Rev. 2004;24:284–297
  98. Dargahi J. A piezoelectric tactile sensor with three sensing elements for robotic, endoscopic and prosthetic applications. Sens Actuators A. 2000;80:23–30
  99. Gray BL, Fearing RS. A surface micromachined microtactile sensor array. In: IEEE international conference on robotics and automation. Minneapolis, MN. 1996;p. 1–6
  100. Sugiyama S, Kawahata K, Yoneda M, Igarashi I. Tactile image detection using a 1k-element silicon pressure sensor array. Sens Actuators. 1990;A21–A23:397–400
  101. Peine WJ, Son JS, Howe RD. A palpation system for artery localization in laparoscopic surgery. In: First international symposium on medical robotics and computer-assisted surgery. Pittsburgh, PA. 1994;
  102. Beasley RA, Howe RD. Tactile tracking of arteries in robotic surgery. In: IEEE international conference on robotics and automation, 4. 2002;p. 3801–3806
  103. Glavic Z, Begic L, Rozman R. A new device for the detection and recognition of blood vessels in laparoscopic surgery. Surg Endosc. 2002;16:1197–1200
  104. Kaczmarek KA, Webster JG, Bach-y-Rita P, Tompkins WJ. Electrotactile and vibrotactile displays for sensory substitution systems. IEEE Trans Biomed Eng. 1991;38:1–16
  105. Bach-y-Rita PSWK. Sensory substitution and the human–machine interface. Trends Cogn Sci. 2003;7:541–546
  106. Bitterman N. Technologies and solutions for data display in the operating room. J Clin Monit Comput. 2006;20:165–173
  107. Dargahi J, Najarian S. An endoscopic force-position sensor grasper with minimum sensors. Can J Electr Comp Eng. 2003;28:155–161
  108. Tavakoli M, Patel RV, Moallem M. Haptic feedback and sensory substitution during telemanipulated suturing. In: First joint eurohaptics conference and symposium on haptic interfaces for virtual environment and teleoperator systems. Pisa, Italy. 2005;p. 543–544
  109. Kitagawa M, Dokko D, Okamura AM, Yuh DD. Effect of sensory substitution on suture-manipulation forces for robotic surgical systems. J Thorac Cardiovasc Surg. 2005;129:151–158
  110. Reiley CE, Akinbiyi T, Burschka D, Chang DC, Okamura AM, Yuh DD. Effects of visual force feedback on robot-assisted surgical task performance. J Thorac Cardiovasc Surg. 2008;135:196–202
  111. Mahvash M, Gwilliam J, Agarwal R, et al. Force-feedback surgical teleoperator: controller design and palpation experiments. In: Symposium on haptic interfaces for virtual environments and teleoperator systems. Reno, NE. 2008;p. 465–471
  112. Dargahi J, Najarian S, Ramezanifard R. Graphical display of tactile sensing data with application in minimally invasive surgery. Can J Electr Comput Eng. 2007;32:151–155
  113. Schostek S, Rieber F, Ho CN, Schurr MO. Microtechnologies in surgery. In:  Nawrat Z editors. Advances in biomedical technology. Poland: Zabrze; 2007;p. 157–171
  114. Miller AP, Peine WJ, Son JS, Hammoud ZT. Tactile imaging system for localizing lung nodules during video assisted thoracoscopic surgery. In: IEEE international conference on robotics and automation. Rome, Italy. 2007;p. 2996–3001
  115. Scilingo EP, Bicchi A, De Rossi D, Iacconi P. Haptic display able to replicate the rheological behaviour of surgical tissues. In: 20th annual conference of the IEEE engineering in medicine and biology society. Hong Kong. 1998;
  116. Klein D, Freimuth H, Monkman GJ, et al. Eletrorheological tactel elements. Mechatronics. 2005;15:883–897
  117. Moy G, Wagner C, Fearing RS. A compliant tactile display for teletaction. In: IEEE international conference on robotics and automation. San Francisco, CA. 2000;p. 3409–3415
  118. King CH, Culjat MO, Franco ML, Bisley JW, Dutson E, Grundfest WS. Optimization of a pneumatic balloon tactile display for robot-assisted surgery based on human perception. IEEE Trans Biomed Eng. 2008;55:2593–2600
  119. Peine WJ, Wellman PS, Howe RD. Temporal bandwidth requirements for tactile shape displays. In: IMECE haptics symposium. 1997;
  120. Wagner CR, Lederman SJ, Howe RD. A tactile shape display using servo motors. In: Tenth symposium of haptic interfaces for virtual environment and teleoperator systems. 2002;
  121. Ottermo MV, Stavdahl O, Johansen TA. Electromechanical design of a miniature tactile shape display for minimally invasive surgery. In: First joint eurohaptics conference and symposium on haptic interfaces for virtual environment and teleoperator systems. Pisa, Italy. 2005;
  122. Santamore DC, Cleaver TG. The sounds of saturation. J Clin Monit Comput. 2004;18:89–92
  123. Yao HY, Hayward V, Ellis RE. A tactile enhancement instrument for minimally invasive surgery. Comput Aided Surg. 2005;10:233–239
  124. Reynaerts D, Van Brussel H. Tactile sensing data interpretation for object manipulation. Sens Actuators A. 1993;37–38:268–273
  125. Schmidt PA, Mael E, Würtz RP. A sensor for dynamic tactile information with applications in human–robot interaction and object manipulation. Rob Autonom Sys. 2006;54:1005–1014
  126. Muthukrishnan C, Smith D, Myers D, Rebman J, Koivo A. Edge detection in tactile images. In: IEEE international conference on robotics and automation. 1987;p. 1500–1505
  127. Caiti A, Canepa G, De Rossi D, Germagnoli F, Magenes G, Parisini T. Towards the realization of an artificial tactile system: fine-form discrimination by a tensorial tactile sensor array and neural inversion algorithms.. IEEE Trans Sys Man Cybern. 1995;25:933–946

PII: S1350-4533(09)00126-X

doi: 10.1016/j.medengphy.2009.06.003

Medical Engineering & Physics
Volume 31, Issue 8 , Pages 887-898 , October 2009

Article Tools

* Image Usage & Resolution