Augmented Reality for Liver Surgery

Project Info

Funding Inria and ALTRAN

Objective Visualization of internal structures of organs during surgical operations

Date 01.2012 — now





People Involved

Project Description

Despite the improvements of surgical techniques and tools, some surgical interventions, such as Augmented Reality for Liver Surgery, remain very challenging for surgeons. Especially for abdominal minimally invasive surgery where haptic and visual feedback are limited. Indeed, during such surgeries only a partial view of the organ’s surface is seen through an endoscopic camera and organ manipulations are performed via endoscopic tools. Moreover, due to the pneumoperitoneum the abdominal organs are strongly deformed. Still, the surgeons need to know where the internal structures such as tumors or vessels are located. Therefore, they have to mentally register the preoperative images of the organs onto the endoscopic view to locate these structures.

Our contribution is to provide surgeons with an enhanced visualization of organ’s internal structures during the surgery.


Using Contours as Boundary Conditions for Elastic Registration during Minimally Invasive Hepatic SurgeryNazim Haouchine, Frederick Roy, Lionel Untereiner, Stéphane Cotin International Conference on Intelligent Robots and Systems, Oct 2016, Daejeon, South Korea.

Simultaneous Pose Estimation and Augmentation of Elastic Surfaces from a Moving Monocular CameraNazim Haouchine, Marie-Odile Berger, Stephane Cotin International Symposium on Mixed and Augmented Reality, Sep 2016, Merida, Mexico.

Patient-specific Biomechanical Modeling for Guidance during Minimally-invasive Hepatic SurgeryRosalie Plantefève, Igor Peterlik, Nazim Haouchine, Stéphane Cotin Annals of Biomedical Engineering, Springer Verlag, 2015.

Monocular 3D Reconstruction and Augmentation of Elastic Surfaces with Self-occlusion Handling.  Nazim Haouchine, Jeremie Dequidt, Marie-Odile Berger, Stephane Cotin IEEE Transactions on Visualization and Computer Graphics, Institute of Electrical and Electronics Engineers, 2015.

Impact of Soft Tissue Heterogeneity on Augmented Reality for Liver Surgery.  Nazim Haouchine, Stephane Cotin, Igor Peterlik, Jeremie Dequidt, Mario Sanz-Lopez, Erwan Kerrien, Marie-Odile Berger IEEE Transactions on Visualization and Computer Graphics, Institute of Electrical and Electronics Engineers, 2015, 21 (5), pp.584 – 597.

Augmented Reality during Cutting and Tearing of Deformable Objects. Christoph Paulus, Nazim Haouchine, David Cazier, Stephane Cotin IEEE International Symposium on Mixed and Augmented Reality, Sep 2015, Fukuoka, Japan.

Surgical Augmented Reality with Topological Changes. Christoph Paulus, Nazim Haouchine, David Cazier, Stephane Cotin Medical Image Computing and Computer Assisted Interventions, Oct 2015, München, Germany

Handling Topological Changes during Elastic Registration: Application to Augmented Reality in Laparoscopic Surgery
Christoph Joachim Paulus, Nazim Haouchine, Seong-Ho Kong, Renato Vianna Soares, David Cazier, Stéphane Cotin International Journal of Computer Assisted Radiology and Surgery, Springer Verlag, 2016

Project Gallery

Project Videos