Augmented fluoroscopy



Enhancing Fluoroscopy-Guided Interventions: a Neural Network to Predict Vessel Deformation without Contrast Agents.


We propose a deep learning approach for the visualization of vessels during image-guided procedures without the need for contrast agents or pre-operative 4D CTs.


Problem: X-Ray images are routinely acquired during image-guided surgical interventions, but the vessels are not visible in these images. Injection of contrast agents is traditionally used to visualize the vessels, but only a limited dose may be injected before it is toxic to the patient. Another solution is to project the vessels segmented from the pre-operative CT-Scan. However, the anatomy of the patient during the intervention is different from the anatomy in the pre-operative CT Scan.


Our solution: Using a neural network, we can predict the deformation of the anatomy in the X-Ray image to superpose the vessels on the image at the right place and in the right shape. The video illustrates our method. The hepatic veins position in red is not corrected to follow breathing motion, and it is far from the true position. The hepatic veins in green are deformed using our neural network prediction and follow the breathing motion visible in the image.

Image Gallery