Friedrich-Alexander-Universität Erlangen
Lehrstuhl für Mustererkennung
Martensstraße 3
91058 Erlangen

Image Fusion

In close collaboration with leading clinical and industrial partners, the Image Fusion (IMF) Group develops novel methods for rigid and non-rigid data registration, as well as innovative applications and efficient clinical workflows. Current foci of interest include multi-modal image fusion, image-guided therapy, 2-D/3-D registration and image overlay. The interdisciplinary research provides the basis to develop applications close to medical practice. 

Colloquium Time Table (Friday, 14:00-15:30, room change: 02.134-113)

DateResponsible PersonTitle
30.08.2019Ute Spiske (Siming Bayer)BT Intro: Interpolation of deformation field for brain-shift using Gaussian Process
06.09.2019--
13.09.2019Markus Weiß (Roman Schaffert)MT Final: Learning-based Correspondence Estimation for 2-D/3-D Image Registration
20.09.2019--
27.09.2019--


Opens internal link in current windowPrior Sessions

Mailing list subscription management page for Opens external link in new windowstudents and Opens external link in new windowguests.

Running Projects

Rigid Medical Image Registration

In rigid registration, only rotations and translations are applied for the spatial transform.

Non-Rigid Medical Image Registration

Non-rigid image registration is a natural extension to rigid registration, allowing also deformations.

2D-3D Medical Image Registration

Fusion of pre-operative 3-D volumetric data with intra-operative 2-D images.

Image-Guided Radiation Therapy

Multi-modal respiratory motion modeling and tracking.
Automatic patient setup using 3-D range imaging.

Self-Adapting Image Guidance for Endovascular Aneurysm Repair

Fusion of preoperative images with intraoperative fluoroscopy for endovascular repair of aortic aneurysms.

Finished Projects

Surface Registration

Rigid, non-rigid and multi-modal 3-D surface registration.

Time-of-Flight 3-D Endoscopy

Extending conventional 2-D endoscopic data with additional 3-D surface information.

The tracking and compensation of patient motion during a magnetic resonance imaging (MRI) acqusition is an unsolved problem. For brain MRI, a promising approach recently suggested is to track the patient using an in-bore camera (see Figure 1). Features for the tracking were obtained from a checkerboard marker attached to the patient's forehead. However, the possible tracking range of the head pose is limited by the locally attached marker. For pose estimation, the detection algorithm requires the checkerboard marker entirely visible inside the camera’s field of view (FOV). Due to the limited space inside the scanner bore, camera-marker distances from 5-7cm restrict the FOV significantly, which directly affects the possible tracking range. 

To overcome this shortcoming, we developed a novel self-encoded marker (Figure 1c) where each feature on the pattern is augmented with a 2-D barcode. Hence, the marker can be tracked even if it is not completely visible in the camera image. Compared to the detection of the checkerboard marker, the detection algorithm of the self-encoded marker was extended by a feature identification and verification step as shown in Figure 2. Given the known pattern including the embedded codes of the self-encoded marker, a mesh of all neighboring quads on the pattern was loaded in a look-up table at the start of the software. Thus, this information can be exploited to verify the detected codes. Instead of verifying each code independently, we used the recognized codes of neighboring quads for verification. Thus, the self-encoded marker offers considerable advantages over the checkerboard marker in terms of processing speed, since it makes the correspondence search of feature points and marker-model coordinates, which are required for the pose estimation, redundant.

For evaluation, experiments with computer controlled motion outside the scanner were performed. Phantom studies inside the scanner and first in-vivo experiments showed promising results. Even in the presence of strong continuous motion, the scanner geometry was sufficiently updated using pose estimates of the self-encoded marker. In this way, the structure of the brain was recovered as shown in Figure 3.

In this study, we presented a novel marker design, which overcomes the limiting tracking range of existing optical prospective in-bore motion correction systems.

<b>Figure 1:</b> Setup of the optical motion correction system: the MR compatible camera (a) was mounted on the 8 channel head coil (b). Reliable features for optical tracking of the patient were provided by the self-encoded marker (c).
<b>Figure 2:</b> Workflow diagram of the detection algorithm for the self-encoded marker. This algorithm can be divided into quad detection, feature identification, verification, and pose estimation.
<b>Figure 3:</b> Images of the scan simulating an uncooperative patient: (a) Reference Scan; Scan with random motion and (b) no correction and (c) prospective mo- tion correction using the self-encoded marker; (d-f) Magnification of window in (a-c); Detected translation (g-i) and rotation (j-l).
Articles in Conference Proceedings
Hutter, Jana; Grimm, Robert; Forman, Christoph; Hornegger, Joachim; Schmitt, Peter
Inverse root sampling pattern for iterative reconstruction in non-CE MR angiography
Magnetic Resonance Materials in Physics, Biology and Medicine (ESMRMB 2011), Leipzig, 06.10.-08.10.2011, vol. 24, pp. 92-93, 2011