Aim: The aim of this study was to evaluate the utility of navigation surgery using augmented reality technology (AR-based NS) for pancreatectomy. Methods: The 3D reconstructed images from CT were created by segmentation. The initial registration was performed by using the optical location sensor. The reconstructed images were superimposed onto the real organs in the monitor display. Of the 19 patients who had undergone hepatobiliary and pancreatic surgery using AR-based NS, the accuracy, visualization ability, and utility of our system were assessed in five cases with pancreatectomy. Results: The position of each organ in the surface-rendering image corresponded almost to that of the actual organ. Reference to the display image allowed for safe dissection while preserving the adjacent vessels or organs. The locations of the lesions and resection line on the targeted organ were overlaid on the operating field. The initial mean registration error was improved to approximately 5 mm by our refinements. However, several problems such as registration accuracy, portability and cost still remain. Conclusion: AR-based NS contributed to accurate and effective surgical resection in pancreatectomy. The pancreas appears to be a suitable organ for further investigations. This technology is promising to improve surgical quality, training, and education.

Keywords:
Navigation surgery, Augmented reality, Pancreatectomy
1.
Lamadé W, Vetter M, Hassenpflug P, et al: Navigation and image-guided HBP surgery: a review and preview. J Hepatobiliary Pancreat Surg 2002;9:592-599.
2.
Shuhaiber JH: Augmented reality in surgery. Arch Surg 2004;139:170-174.
3.
Lang H, Radtke A, Hindennach M, et al: Impact of virtual tumor resection and computer-assisted risk analysis on operation planning and intraoperative strategy in major hepatic resection. Arch Surg 2005;140:629-638; discussion 638.
4.
Nicolau S, Soler L, Mutter D, Marescaux J: Augmented reality in laparoscopic surgical oncology. Surg Oncol 2011;20:189-201.
5.
Mezger U, Jendrewski C, Bartels M: Navigation in surgery. Langenbecks Arch Surg 2013;398:501-514.
6.
Grunert P, Darabi K, Espinosa J, Filippi R: Computer-aided navigation in neurosurgery. Neurosurg Rev 2003;26:73-99; discussion 100-101.
7.
Markiewicz MR, Bell RB: Traditional and contemporary surgical approaches to the orbit. Oral Maxillofac Surg Clin North Am 2012;24:573-607.
8.
Okamoto T, Onda S, Matsumoto M, et al: Utility of augmented reality system in hepatobiliary surgery. J Hepatobiliary Pancreat Sci 2013;20:249-253.
9.
Onda S, Okamoto T, Kanehira M, et al: Short rigid scope and stereo-scope designed specifically for open abdominal navigation surgery: clinical application for hepatobiliary and pancreatic surgery. J Hepatobiliary Pancreat Sci 2013;20:448-453.
10.
Onda S, Okamoto T, Kanehira M, et al: Identification of inferior pancreaticoduodenal artery during pancreaticoduodenectomy using augmented reality-based navigation system. J Hepatobiliary Pancreat Sci 2014;21:281-287.
11.
Hughes-Hallett A, Mayer EK, Marcus HJ, et al: Augmented reality partial nephrectomy: examining the current status and future perspectives. Urology 2014;83:266-273.
12.
Matsuda T: Recent advances in urologic laparoscopic surgeries: laparoendoscopic single-site surgery, natural orifice transluminal endoscopic surgery, robotics and navigation. Asian J Endosc Surg 2013;6:68-77.
13.
Ohashi K, Murakami Y, Maruyama M, et al: Four cases of ‘mucin-producing' cancer of the pancreas on specific findings of the papilla of Vater (in Japanese). Prog Dig Endosc 1982;20:348-351.
14.
Tanaka M, Fernández-del Castillo C, Adsay V, et al: International consensus guidelines 2012 for the management of IPMN and MCN of the pancreas. Pancreatology 2012;12:183-197.
15.
Furukawa T, Klöppel G, Volkan Adsay N, et al: Classification of types of intraductal papillary-mucinous neoplasm of the pancreas: a consensus study. Virchows Arch 2005;447:794-799.
16.
Bassi C, Sarr MG, Lillemoe KD, et al: Natural history of intraductal papillary mucinous neoplasms (IPMN): current evidence and implications for management. J Gastrointest Surg 2008;12:645-650.
17.
Käppeli RM, Müller SA, Hummel B, et al: IPMN: surgical treatment. Langenbecks Arch Surg 2013;398:1029-1037.
18.
Mori Y, Ohtsuka T, Tamura K, et al: Intraoperative irrigation cytology of the remnant pancreas to detect remnant distinct pancreatic ductal adenocarcinoma in patients with intraductal papillary mucinous neoplasm undergoing partial pancreatectomy. Surgery 2014;155:67-73.
19.
Tamura K, Ohtsuka T, Ideno N, et al: Treatment strategy for main duct intraductal papillary mucinous neoplasms of the pancreas based on the assessment of recurrence in the remnant pancreas after resection: a retrospective review. Ann Surg 2014;259:360-368.
20.
Zhang T, Du X, Zhao Y: Laparoscopic surgery for pancreatic lesions: current status and future. Front Med 2011;5:277-282.
21.
Glanemann M, Shi B, Liang F, et al: Surgical strategies for treatment of malignant pancreatic tumors: extended, standard or local surgery? World J Surg Oncol 2008;6:123.
22.
Marescaux J, Clément JM, Tassetti V, et al: Virtual reality applied to hepatic surgery simulation: the next revolution. Ann Surg 1998;228:627-634.
23.
Lamadé W, Glombitza G, Fischer L, et al: The impact of 3-dimensional reconstructions on operation planning in liver surgery. Arch Surg 2000;135:1256-1261.
24.
Saito S, Yamanaka J, Miura K, et al: A novel 3D hepatectomy simulation based on liver circulation: application to liver resection and transplantation. Hepatology 2005;41:1297-1304.
25.
Lang H, Radtke A, Hindennach M, et al: Impact of virtual tumor resection and computer-assisted risk analysis on operation planning and intraoperative strategy in major hepatic resection. Arch Surg 2005;140:629-638; discussion 638.
26.
Herline AJ, Stefansic JD, Debelak JP, et al: Image-guided surgery: preliminary feasibility studies of frameless stereotactic liver surgery. Arch Surg 1999;134:644-649; discussion 649-650.
27.
Beller S, Eulenstein S, Lange T, et al: Upgrade of an optical navigation system with a permanent electromagnetic position control: a first step towards ‘navigated control' for liver surgery. J Hepatobiliary Pancreat Surg 2009;16:165-170.
28.
Cash DM, Miga MI, Sinha TK, et al: Compensating for intraoperative soft-tissue deformations using incomplete surface data and finite elements. IEEE Trans Med Imaging 2005;24:1479-1491.
29.
Cash DM, Miga MI, Glasgow SC, et al: Concepts and preliminary data toward the realization of image-guided liver surgery. J Gastrointest Surg 2007;11:844-859.
30.
Hansen C, Wieferich J, Ritter F, et al: Illustrative visualization of 3D planning models for augmented reality in liver surgery. Int J Comput Assist Radiol Surg 2010;5:133-141.
31.
Peterhans M, vom Berg A, Dagon B, et al: A navigation system for open liver surgery: design, workflow and first clinical applications. Int J Med Robot 2011;7:7-16.
32.
Stefansic JD, Herline AJ, Shyr Y, et al: Registration of physical space to laparoscopic image space for use in minimally invasive hepatic surgery. IEEE Trans Med Imaging 2000;19:1012-1023.
33.
Rauth TP, Bao PQ, Galloway RL, et al: Laparoscopic surface scanning and subsurface targeting: implications for image-guided laparoscopic liver surgery. Surgery 2007;142:207-214.
34.
Hostettler A, Nicolau SA, Rémond Y, et al: A real-time predictive simulation of abdominal viscera positions during quiet free breathing. Prog Biophys Mol Biol 2010;103:169-184.
35.
Marzano E, Piardi T, Soler L, et al: Augmented reality-guided artery-first pancreatico-duodenectomy. J Gastrointest Surg 2013;17:1980-1983.
36.
Marescaux J, Rubino F, Arenas M, et al: Augmented-reality-assisted laparoscopic adrenalectomy. JAMA 2004;292:2214-2215.
37.
Konishi K, Hashizume M, Nakamoto M, et al: Augmented reality navigation system for endoscopic surgery based on three-dimensional ultrasound and computed tomography: application to 20 clinical cases. Int Congr Ser 2005;1281:537-542.
38.
Teber D, Guven S, Simpfendörfer T, et al: Augmented reality: a new tool to improve surgical accuracy during laparoscopic partial nephrectomy? Preliminary in vitro and in vivo results. Eur Urol 2009;56:332-338.
39.
Ukimura O, Magi-Galluzzi C, Gill IS: Real-time transrectal ultrasound guidance during laparoscopic radical prostatectomy: impact on surgical margins. J Urol 2006;175:1304-1310.
40.
Simpfendörfer T, Baumhauer M, Müller M, et al: Augmented reality visualization during laparoscopic radical prostatectomy. J Endourol 2011;25:1841-1845.
41.
Ukimura O, Gill IS: Image-fusion, augmented reality, and predictive surgical navigation. Urol Clin North Am 2009;36:115-123, vii.
42.
Shekhar R, Dandekar O, Bhat V, et al: Live augmented reality: a new visualization method for laparoscopic surgery using continuous volumetric computed tomography. Surg Endosc 2010;24:1976-1985.
43.
Ieiri S, Uemura M, Konishi K, et al: Augmented reality navigation system for laparoscopic splenectomy in children based on preoperative CT image using optical tracking device. Pediatr Surg Int 2012;28:341-346.
44.
Mårvik R, Langø T, Tangen GA, Andersen JO, Kaspersen JH, Ystgaard B, et al: Laparoscopic navigation pointer for three-dimensional image-guided surgery. Surg Endosc 2004;18:1242-1248.
45.
Baumhauer M, Feuerstein M, Meinzer HP, et al: Navigation in endoscopic soft tissue surgery: perspectives and limitations. J Endourol 2008;22:751-766.
46.
Gavaghan KA, Peterhans M, Oliveira-Santos T, et al: A portable image overlay projection device for computer-aided open liver surgery. IEEE Trans Biomed Eng 2011;58:1855-1864.
47.
Gavaghan K, Oliveira-Santos T, Peterhans M, et al: Evaluation of a portable image overlay projector for the visualisation of surgical navigation data: phantom studies. Int J Comput Assist Radiol Surg 2012;7:547-556.
© 2015 S. Karger AG, Basel
2015
Copyright / Drug Dosage / Disclaimer
Copyright: All rights reserved. No part of this publication may be translated into other languages, reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying, recording, microcopying, or by any information storage and retrieval system, without permission in writing from the publisher.
Drug Dosage: The authors and the publisher have exerted every effort to ensure that drug selection and dosage set forth in this text are in accord with current recommendations and practice at the time of publication. However, in view of ongoing research, changes in government regulations, and the constant flow of information relating to drug therapy and drug reactions, the reader is urged to check the package insert for each drug for any changes in indications and dosage and for added warnings and precautions. This is particularly important when the recommended agent is a new and/or infrequently employed drug.
Disclaimer: The statements, opinions and data contained in this publication are solely those of the individual authors and contributors and not of the publishers and the editor(s). The appearance of advertisements or/and product references in the publication is not a warranty, endorsement, or approval of the products or services advertised or of their effectiveness, quality or safety. The publisher and the editor(s) disclaim responsibility for any injury to persons or property resulting from any ideas, methods, instructions or products referred to in the content or advertisements.
You do not currently have access to this content.