Fusion of fundus images and MRI data of the human eye

De Zanet, Sandro; Ciller, Carlos; Kowal, Horst Jens (5 May 2014). Fusion of fundus images and MRI data of the human eye (Unpublished). In: ARVO Annual Meeting. Orlando, Florida. 04.-08.05.2014.


Ophthalmologists are confronted with a set of different image modalities to diagnose eye tumors e.g., fundus photography, CT and MRI. However, these images are often complementary and represent pathologies differently. Some aspects of tumors can only be seen in a particular modality. A fusion of modalities would improve the contextual information for diagnosis. The presented work attempts to register color fundus photography with MRI volumes. This would complement the low resolution 3D information in the MRI with high resolution 2D fundus images.


MRI volumes were acquired from 12 infants under the age of 5 with unilateral retinoblastoma. The contrast-enhanced T1-FLAIR sequence was performed with an isotropic resolution of less than 0.5mm. Fundus images were acquired with a RetCam camera. For healthy eyes, two landmarks were used: the optic disk and the fovea. The eyes were detected and extracted from the MRI volume using a 3D adaption of the Fast Radial Symmetry Transform (FRST). The cropped volume was automatically segmented using the Split Bregman algorithm. The optic nerve was enhanced by a Frangi vessel filter. By intersection the nerve with the retina the optic disk was found. The fovea position was estimated by constraining the position with the angle between the optic and the visual axis as well as the distance from the optic disk. The optical axis was detected automatically by fitting a parable on to the lens surface. On the fundus, the optic disk and the fovea were detected by using the method of Budai et al. Finally, the image was projected on to the segmented surface using the lens position as the camera center.
In tumor affected eyes, the manually segmented tumors were used instead of the optic disk and macula for the registration.


In all of the 12 MRI volumes that were tested the 24 eyes were found correctly, including healthy and pathological cases. In healthy eyes the optic nerve head was found in all of the tested eyes with an error of 1.08 +/- 0.37mm. A successful registration can be seen in figure 1.


The presented method is a step toward automatic fusion of modalities in ophthalmology. The combination enhances the MRI volume with higher resolution from the color fundus on the retina. Tumor treatment planning is improved by avoiding critical structures and disease progression monitoring is made easier.

Item Type:

Conference or Workshop Item (Poster)


10 Strategic Research Centers > ARTORG Center for Biomedical Engineering Research > ARTORG Center - AI in Medical Imaging Laboratory
04 Faculty of Medicine > Department of Head Organs and Neurology (DKNS) > Clinic of Ophthalmology

UniBE Contributor:

De Zanet, Sandro, Ciller, Carlos, Kowal, Horst Jens


600 Technology > 610 Medicine & health




Sandro De Zanet

Date Deposited:

12 May 2015 10:23

Last Modified:

05 Dec 2022 14:46



Actions (login required)

Edit item Edit item
Provide Feedback