Non-rigid Registration of a 3D Ultrasound and a MR Image Data Set of the Female Pelvic Floor

Background
The visual combination of different modalities is essential for many medical imaging applications in the field of Computer-Assisted medical Diagnosis (CAD) to enhance the clinical information content. Clinically, incontinence is a diagnosis with high clinical prevalence and morbidity rate. The search for a method to identify risk patients and to control the success of operations is still a challenging task. The conjunction of magnetic resonance (MR) and 3D ultrasound (US) image data sets could lead to a new clinical visual representation of the morphology as we show with corresponding data sets of the female anal canal with this paper.

Methods
We present a feasibility study for a non-rigid registration technique based on a biomechanical model for MR and US image data sets of the female anal canal as a base for a new innovative clinical visual representation.

Results
It is shown in this case study that the internal and external sphincter region could be registered elastically and the registration partially corrects the compression induced by the ultrasound transducer, so the MR data set showing the native anatomy is used as a frame for the US data set showing the same region with higher resolution but distorted by the transducer

Conclusion
The morphology is of special interest in the assessment of anal incontinence and the non-rigid registration of normal clinical MR and US image data sets is a new field of the adaptation of this method incorporating the advantages of both technologies.

Background 
In a recent study the advances of 3D sonographical imaging techniques to allow a sophisticated study of anal sphincter and levator ani muscle anatomy were described [1]. Today's common US examination techniques using a 7.5 MHz transducer allow a spatial resolution of up to 0.3 mm in each direction [2,3], whereas it is hard to obtain good quality MR images better than 1 mm in a single direction, when imaging the pelvis. Nevertheless, MR is a well established 3D data acquisition technique, which is used as gold standard to describe human anatomy in vivo.

It is a clinical necessity to enhance the information contained in imaging for diagnostic and also therapeutic purposes. In the past this led to new imaging techniques (visual representations) which use the information of at least two modalities in order to maximize the benefit for the clinician in diagnosis and treatment [4]. The registration of MR and US is of special interest because sonography is a diagnostic technique which is easy to handle, widely available, and furthermore economic [5]. To combine the best of the two worlds we will show that it is possible to match 3D MR and US for the assessment of female pelvic floor morphology.

Both introitus sonography and endoanal sonography focus on rectum and anal sphincter muscle morphology [6,7]. A recent publication by Williams et al. [8] shows a good correlation of endosonographic anatomy with endocoil MR. In contrast to this paper, our case shows the anatomy in a native physiologic state without stretching the tissue with a transrectal probe. No results have been published so far about the combination of introitus sonography and MRI using a standard bodyflex coil used for clinical purposes showing the anatomy in native status.

Because the organs in pelvic floor area are movable in position and size, consequently, new imaging techniques in this region should be based on non-rigid registration techniques (techniques considering tissue deformations) rather than on rigid registration techniques [9-11] in order to find the relationship of corresponding data set points. Actually, few cases of non-rigid MR and US image registration in the pelvic floor area are reported (e.g. for the treatment of prostate cancer by Mizowaki et al. [12]).

Non-rigid registration has become a fundamental method for medical image analysis during the past years [5,13-15,35] and is tested and approved with data from different anatomical regions [15-18]. An important issue in the registration process is the generation of deformation fields that reflect the transformation of an image in a realistic way with respect to the given anatomy [19,20]. Various physically based elastic models and algorithms have been recently described [21-24]. The aim of this paper is to apply an advanced algorithm previously approved for computer-assisted neurosurgery [25] and tested in corresponding head-neck data sets [26] now for registration purposes in the pelvic floor area, especially of the anal canal region to create a new visual representation.

Information derived from this type of image registration could lead towards new diagnostic (or even therapeutic) methods in the treatment of female pelvic floor dysfunctions using the MR data as a frame for high-resolution US data.

Methods & Materials
For our case report two corresponding 3D data sets (MR and US) of a women attending the outpatient clinics for diagnosis and treatment of urinary incontinence were taken with no specific clinical preference out of an ongoing study.

The 3D volume data set was acquired using Voluson 530 D, Kretztechnik, Zipf, Austria as it has been previously described [1]. The volume data set of the undistended anal sphincter and levator ani muscle was taken with a 7.5 MHz transvaginal probe (opening angle of 105° in tranversal and of 100° in longitudinal direction, isotropic resolution of 0.3 mm in each spatial direction) was placed at the posterior frenulum of labia minora.

The MR examination was carried out in sitting position with an 0.5T open configuration MR system, Signa SP GEMS, using a bodyflex surface coil for data acquisition. After a locator sequence, axial and sagittal T2-weighted fast-spin-echo sequences (TR 4000, TE 100, Matrix 256 × 256, slice thickness 7.2 mm, intersection gap 1.2 mm) were acquired and stored in DICOM format. The resolution in the matrix is 1.09 mm, whereby the MR data sets result to be non-isotropic in the three directions in space in contrast to the sonographical data sets having isotropic voxel size.

As a base system for both alignment and visualization we used the 3D-Slicer 2 software available free for non-profit organizations on both standard MS Windows platforms and Sun Solaris 5.8 Workstations [27-29]. The 3D Slicer software is designed for both diagnostical visualization and surgical planning, and it integrates several facets of image-guided medicine into a single environment: It provides capabilities for (I) automatic registration (aligning data sets), (II) semi-automatic segmentation, (III) generation of 3D surface models (for viewing the segmented structures), (IV) 3D visualization, and (V) quantitative analysis (measuring distances, angles, surface areas, and volumes) of various medical scans.

The processing followed the strategy as described in Fig. 1. After carrying out an edge enhancement in the 3D US data set using adaptive filter techniques [30,31] both datasets were initially aligned using the standard 3D-Slicer's fiducial alignment method by placing three landmarks as fiducials in two different axial slices of both axial MR and US data set. We chose the mucosa and points in the internal or the external sphincter muscle as anatomical landmarks for the rigid overlay assuming the MR images to be the gold standard for the muscle components [8]. As a result an affine transformation matrix was determinded for the overlay. Both data sets were cropped to the region of interest (Fig. 3) to minimize the calculation time. After resampling using a standard linear interpolation method both data sets have an isotropic resolution of 0.6 mm in each spatial direction. The worst registration errors of the correlation ratio are due to the MR resolution [32,33]. We carried out a visual assessment of the accuracy of the registration and assumed the error for each modality to be of the order of half a voxel size in our case [34]. The entire processing time for the process shown in Fig. 1 for this feasibility study was one hour not considering the data acquisition times for MR and US.

In this work we present the application of an algorithm for non-rigid registration described previously by two of the authors [19,20]. This algorithm was originally developed for MR techniques and we applied it for new anatomical region assuming that the edge enhancement algorithms are valid for US data sets, too. In order to obtain realistic deformations, we propose a physics-based elastic model. The method does not require segmentation and does not have the drawback that initial estimates of the deformation are only generated for the boundary of a considered structure. Instead, these estimates are calculated based on a template matching approach with a local similarity measure. Furthermore, we incorporated different models for elasticities into our algorithm. The discretization of the underlying equation is done by a finite element technique, which has become a popular method for medical imaging applications [24,25].

The registration process can be described as an optimization problem. Target of the optimization is the minimization of the deformation energy between two data sets, reference and template. The displacement field which describes the correlation of corresponding anatomical structures in both image data sets can be described using the theorema of minimal potential enegy E. With this in a volume Ω a deformation u needs to be determined which minimizes the following equation.

F means the external force causing the deformation u. σ is the stress which causes the (local) distortion ε. The relationship between σ and ε can be described using elastomechanical equation σ = Dε with D being an elasticity tensor. Due to the fact that in the dedicated anatomical region mostly muscle tissue is found, the tissue parameter in D used in the biomechanical model is assumed to be homogeneous (according to [20,22]and[25]). The minimization of the potential energy E then is the registration process devided in two basic steps. The method is described in detail in [20].

F means the external force causing the deformation u. σ is the stress which causes the (local) distortion ε. The relationship between σ and ε can be described using elastomechanical equation σ = Dε with D being an elasticity tensor. Due to the fact that in the dedicated anatomical region mostly muscle tissue is found, the tissue parameter in D used in the biomechanical model is assumed to be homogeneous (according to [20,22]and[25]). The minimization of the potential energy E then is the registration process devided in two basic steps. The method is described in detail in [20].

Results
Leading structures in both of our data sets are the rectum and the anal canal with the mucosa, the circular as well as the conjoined longitudinal muscle layer of the anorectal junction and the levator ani muscle, especially the puborectalis muscle. These morphological structures can be identified clearly in US as well as in MR images – in the latter case with much less contrast than in the US data sets. In addition to this MR shows up the pelvic bones and skin surface facilitates spatial orientation.

The application of adaptive filtering on US data set increased the signal to noise ratio significantly. As a consequence edges appear enhanced in the filtered images showing therefore the anatomical details much clearer. This is shown in Fig. 2. Both external and internal anal sphincter muscle as well as the anal mucosa can be identified in filtered images. Especially, the internal anal sphincter muscle appears clearly as a hypoechogenic region. The levator ani muscle has a V-form surrounding the external anal sphincter muscle best visible in the axial plane. It can be easily distinguished from the hyperechogenic tissue of the external anal sphincter.

Fig. 3 (left side) shows the MR data set analog to the US images in Fig. 2 in its different planes. In the right side of Fig. 3 the position and the size of the overlayed US data set and the spatial orientation in the MR data set is shown. Due to the higher resolution of the US data set about three times more data points are visible in the overlay region in comparision to the MR image significantly magnifying the overlay region. Fig. 3b shows the sagittal plane of the MR data set. Few structures are distinguishable clearly in the vaginal and anal region due to the poor resolution and contrast. Even filter techniques could not significantly increase the contrast in this region in sagittal scan and are not shown therefore.

In Fig. 4 the registration is explicitly shown for one axial plane. The top of each image indicates the anterior direction. MR is used as the template and US as the reference image. As a result the US data set is displayed in the coordinates of the MR due to the application of the deformation field (Fig. 4c). At the position of the transducer – best visible in the top of Fig. 4a – the displacement field shows major differences. The compression induced with the transducer head is partially corrected in the registered image Fig. 4c. The displacement field in z-direction perpendicular to the axial slice is omitted due to the poor resolution of the MR data set in this direction and due to the fact that in sagittal planes too few anatomical landmarks could be identified clearly.

The non-rigid registration qualifies the visual assessment in axial plane very well. An estimation of accuracy in both sagittal and coronal plane could be quantified not better than half a voxel size. In Fig. 5 the segmentation of the internal anal sphincter muscle is explicitly shown in one axial plane. Analogous to Fig. 4 the top of each image indicates the anterior direction. It is shown for the MR (Fig. 5a), the US (Fig. 5b) and the registered image (Fig. 5c) respectively. The deformation induced by the ultrasound probe placed in anterior position is corrected (Fig. 5d).

Discussion 
MR leads to rigid non-deformed data sets in contrast to most sonographical data acquisition techniques. The better structural contrast of the MR data sets allows a better spacial orientation but the quality and resolution especially for soft tissue is higher with 3D US techniques.

Due to several factors such as the lack of image structure, the poor signal to noise ratio of the MR data set, the intensity artifacts, the computational complexity and the restricted time frame it is not feasible to quantify the deformation occurring between each voxel of the corresponding data sets directly. Consequently, we chose a physics-based non-rigid registration algorithm to estimate a deformation field only at sparse locations which have to be interpolated throughout the image. Models of this type have become popular for non-rigid registration because they are fast and have the potential to constrain the underlying deformation in a plausible manner.

Included in our method is an edge enhancement for the US data set using adaptive filtering. Our sophisticated 3D filter technique requires an isotropic or at least a nearly isotropic resolution of the volume image data sets which is the case for our US data set. Furthermore, most registration methods require to have similar resolution of both images, similar regions with the same image size and only local deformations on a short range scale. Therefore, nevertheless, preprocessing steps were needed. Corresponding clinical data sets of two different modalities usually fail fulfilling those preconditions completely – so do ours.

For initial alignment purposes it helps to localize the anatomy. This is demonstrated in Fig. 2. The difference of resolution in MR's axial direction in comparison to the resolution of ultrasound is huge. Due to this, a misplacement of ultrasound's axial slices in relationship with MR axial slices was of no initial relevance and our error in misalignment assumed to be in the region of half a voxel size in each spatial direction.

Fig. 3 shows the poor resolution and contrast in the vaginal and anal region of the MR data sets. Few structures are distinguishable clearly in this region. Even filter techniques could not significantly increase the contrast in this region in sagittal scan and are not shown therefore. This leads to the wish to enhance the clinical information in this region using registration techniques as presented with this paper.

MR and US show minor contour differences for all the anatomical structures. The reason for this misplacement is based on the two completely different data acquisition techniques. Even if they were very carefully carried out the prevention of any distortion is impossible and leads to the following effects: 1. The coupling of the transducer to the tissue induces a tissue deformation in any case. 2. The position of the patient varies without placing any external markers if the data acquisition takes place at different places and different times. 3. Different acquisition times induce e.g. different filling levels of the organs with different contours as a result.

The registration results shown in Fig. 4 and Fig. 5 demonstrate clearly the feasibility of the non-rigid registration method for the correspondent 3D data sets of the anal canal. The native MR data set is used as a frame for the US data set – which shows the sphincter structures more clearly than the MR.

The levator ani muscle cannot be registered with accuracy because the identification in the US data set due to the poor contrast needs an experienced clinician and results impossible for an automated algorithm. The visual representation is limited to slightly distorted tissue structures as proved with this data and shown before in previous attempts in corresponding head-neck data sets. But regions with high contrast and slight deformations can be registered using our method. For further studies MR data sets with higher resolution MR and isotropic voxel size would be desirable.

Conclusions
The present case report shows the feasibility of the visual representation presented for normal clinical data of the anal canal. The registration partially corrects the compression induced by the transducer, so the MR data set showing the native anatomy is used as a frame for the US data set showing the same region with higher resolution but distorted by the transducer. As a consequence the clinical information for diagnostic purposes is enhanced for resolution (Fig. 3) and for position (Fig. 5).

Obviously, these findings need to be validated with more cases in a future prospective study. As previously emphasized the MR images were assumed to be the gold standard for the contours. Using the non-rigid registration technique described in this paper and developing a more sophisticated data acquisition and registering technique this might be changed in the future and the application of 3D ultrasound (US) has a high potential in the innovative development of future low-cost applications.

Authors Contributions 
JFV developed the registration strategy and did the technical part implementing the visual representation method described here. JW did the data acquisition and the medical part. SKW and JR developed the used linear elastic model and helped to modify and adapt it to the present data. RK provided the computing infrastructure and consulted the development process of the method. All authors read and approved the final manuscript.

Acknowledgments 
This work was supported by the Deutsche Forschungsgemeinschaft (DFG = German Research Foundation), grant VE 239/3-1, and of the NIH, grants P4 RR13218 and P01 CA67165.

Special thanks go to Prof. R. Kubik-Huch, MD, Department of Radiology, Kantonsspital Baden, Switzerland, for providing the MR data set.

BioMedical Engineering OnLine 2005 published by BioMed Central

An Open Access Research article

References:

References

1. Wisser J, Schaer GN, Kurmanavicius J, Huch R, Huch A: Use of 3D ultrasound as a new approach to assess obstetrical trauma to the pelvic floor.Ultraschall Med 1999, 20(1):15-18. [PubMed Abstract] [Publisher Full Text]

2. Gladisch R: Praxis der abdominellen Ultraschalldiagnostik.2., überarb. und erg. Aufl edition. Schattauer – Stuttgart, New York; 1992.

3. Trautwein A, Kreibig U, Oberhausen E, Hüttermann J: Physik für Mediziner, Biologen, Pharmazeuten.5th edition. Edited by: de Gruyter. Berlin-New York; 1999.

4. Jolesz FA, Nabavi A, Kikinis R: Integration of interventional MRI with computer-assisted surgery.J Magn Reson Imaging 2001, 13(1):69-77. [PubMed Abstract] [Publisher Full Text]

5. Bucholz RD, Smith KR, Laycock KA, McDurmont LL: Three-dimensional localization: from image-guided surgery to information-guided therapy.Methods 2001, 25(2):186-200. [PubMed Abstract] [Publisher Full Text]

6. Peschers UM, DeLancey JO, Schaer GN, Schuessler B: Exoanal ultrasound of the anal sphincter: normal anatomy and sphincter defects.Br J Obstet Gynaecol 1997, 104(9):999-1003. [PubMed Abstract]

7. Nielsen MB, Pedersen JF, Hauge C, Rasmussen OO, Christiansen J: Endosonography of the anal sphincter: findings in healthy volunteers.AJR Am J Roentgenol 1991, 157(6):1199-1202. [PubMed Abstract]

8. Williams AB, Bartram CI, Halligan S, Marshall MM, Nicholls RJ, Kmiot WA: Endosonographic anatomy of the normal anal canal compared with endocoil magnetic resonance imaging.Dis Colon Rectum 2002, 45(2):176-183. [PubMed Abstract] [Publisher Full Text]

9. Roche A, Pennec X, Malandain G, Ayache N: Rigid registration of 3-D ultrasound with MR images: a new approach combining intensity and gradient information.IEEE Trans Med Imaging 2001, 20(10):1038-1049. [PubMed Abstract] [Publisher Full Text]

10. de Bruin PW, Vos FM, Post FH, Vossepoel AM, de Blok SB: Interactive matching of ultrasound and MRI for visualization during resection of myomata.SPIE Int Soc Opt Eng Proceedings of Spie the International Society for Optical Engineering 2002, 4681:77-84.

11. Pagoulatos N, Haynor DR, Kim Y: Image-based registration of ultrasound and magnetic resonance images: a preliminary study.SPIE Int Soc Opt Eng Proceedings of Spie the International Society for Optical Engineering 2000, 3976:156-164.

12. Mizowaki T, Cohen GN, Fung AYC, Zaider M: Towards integrating functional imaging in the treatment of prostate cancer with radiation: The registration of the MR spectroscopy imaging to ultrasound/CT images and its implementation in treatment planning.Int J Radiat Oncol Biol Phys 2002, 54(5):1558-1564. [PubMed Abstract] [Publisher Full Text]

13. Pennec X, Ayache N, Roche A, Cachier P: Non-rigid MR/US registration for tracking brain deformations.Proceedings International Workshop on Medical Imaging and Augmented Reality IEEE Computer Soc 2001.

14. Roche A: Interventional radiology in oncology.Bull Acad Natl Med 1991, 175(7):1121-1127. [PubMed Abstract]

15. Warfield SK, Nabavi A, Butz T, Tuncali K, Silverman SG, Black PM, Jolesz FA, Kikinis R: Intraoperative segmentation and nonrigid registration for image guided therapy.Medical Image Computing and Computer Assisted Intervention MICCAI 2000, 1935:176-185.

16. Ruiz-Alzola J, Westin CF, Warfield SK, Alberola C, Maier S, Kikinis R: Nonrigid registration of 3D tensor medical data.Med Image Anal 2002, 6(2):143-161. [PubMed Abstract] [Publisher Full Text]

17. Bharatha A, Hirose M, Hata N, Warfield SK, Ferrant M, Zou KH, Suarez-Santana E, Ruiz-Alzola J, D'Amico A, Cormack RA, et al.: Evaluation of three-dimensional finite element-based deformable registration of pre- and intraoperative prostate imaging.Med Phys 2001, 28(12):2551-2560. [PubMed Abstract] [Publisher Full Text]

18. Butz T, Warfield SK, Tuncali K, Silverman SG, van Sonnenberg E, Jolesz FA, R K: Pre- and intra-operative planning and simulation of percutaneous tumor ablation.Medical Image Computing and Computer Assisted Intervention MICCAI 2000, 1935:317-326.

19. Warfield SK, Talos F, Tei A, Bharatha A, Nabavi A, Ferrant M, Black PM, Jolesz FA, Kikinis R: Real-time registration of volumetric brain MRI by biomechanical simulation of deformation during image guided neurosurgery.Computing & Visualization in Science 2002, 5(1):3-11. [Publisher Full Text]

20. Rexilius J, Warfield SK, Guttmann CRG., Wei X, Benson R, Wolfson L, Shenton M, Handels H: A Novel Nonrigid Registration Algorithm and Applications.Medical Image Computing and Computer Assisted Intervention MICCAI 2001, 1936:923-931.

21. Davatzikos C: Spatial transformation and registration of brain images using elastically deformable models.Computer Vision & Image Understanding 1997, 66(2):207-222. [Publisher Full Text]

22. Ferrant M, Nabavi A, Macq B, Jolesz FA, Kikinis R, Warfield SK: Registration of 3-D intraoperative MR images of the brain using a finite-element biomechanical model.IEEE Trans Med Imaging 2001, 20(12):1384-1397. [PubMed Abstract] [Publisher Full Text]

23. Collins DL, Peters TM, Dai W, Evans AC: Model based segmentation of individual brain structures from MRI data.SPIE Visualization in Biomedical Computing 1992, 1808:10-23.

24. Bro-Nielsen M: Finite element modeling in surgery simulation.Proceedings of the IEEE 1998, 86(3):490-503. [Publisher Full Text]

25. Ferrant M, Nabavi A, Macq B, Black PM, Jolesz FA, Kikinis R, Warfield SK: Serial registration of intraoperative MR images of the brain.Med Image Anal 2002, 6(4):337-359. [PubMed Abstract] [Publisher Full Text]

26. Verhey JF, Ludwig A, Rexilius J, Warfield SK, Mamisch C, Kikinis R, Westin CF, Seibel R, Rienhoff O: Mulitmodale nicht-rigide Registrierung von Ultraschall und MR Bilddaten unter Verwendung eines biomechanischen Modells.In Bildverarbeitung für die Medizin 2002 – Algorithmen Systeme Anwendungen. Edited by: Meiler M, Saupe D, Kruggel F, Handels H, Lehmann T. Heidelberg: Springer; 2002:310-313.

27. Gering D: A System for Surgical Planning and Guidance using Image Fusion and Interventional MR.In Master's Thesis. Cambridge: Massassuchets Institute of Technology; 1999.

28. Gering D, Nabavi A, Kikinis R, Grimson WEL, Hata N, Everett P, Jolesz F, Wells W: An Integrated Visualization System for Surgical Planning and Guidance using Image Fusion and Interventional Imaging.Proceeding of Medical Image Computing and Computer-Assisted Intervention (MICCAI), Cambridge England, Sept 1999: 1999; Cambridge 1999, 809-819.

29. 3D Slicer Software http://splweb.bwh.harvard.edu:8000 or http://www.slicer.org

30. Westin CF, Richolt J, Moharir V, Kikinis R: Affine adaptive filtering of CT data.Med Image Anal 2000, 4(2):161-177. [PubMed Abstract] [Publisher Full Text]

31. Westin CF, Wigstrom L, Loock T, Sjoqvist L, Kikinis R, Knutsson H: Three-dimensional adaptive filtering in magnetic resonance angiography.J Magn Reson Imaging 2001, 14(1):63-71. [PubMed Abstract] [Publisher Full Text]

32. Roche A, Pennec X, Rudolph M, Auer DP, Malandain G, Ourselin S, Auer LM, Ayache N: Generalized correlation ratio for rigid registration of 3D ultrasound with MR images.Medical Image Computing and Computer Assisted Intervention MICCAI 2000, 1935:567-577.

33. Pennec X, Thirion JP: A Framework For Uncertainty and Validation of 3-D Registration Methods Based On Points and Frames.International Journal of Computer Vision 1997, 25(3):203-229. [Publisher Full Text]

34. Hill DLG, Batchelor PG, Holden M, Hawkes DJ: Medical image registration.Phys Med Biol 2001, 46:R1-R45. [PubMed Abstract] [Publisher Full Text]

35. Gee JC: On matching brain volumes.Pattern Recognition 1999, 32:99-111. [Publisher Full Text]

36. Bajka M, Berclaz G, Schär G: Empfehlungen zur Gynäkologischen Sonographie.SGUMGG – Schweizerische Gesellschaft für Ultraschall in der Medizin 1998.

37. Schär GN: Ultrasonography of the lower urinary tract.Curr Opin Obstet Gynecol 1997, 9(5):313-316. [PubMed Abstract]

The electronic version of this article is the complete one and can be found online at: http://www.biomedical-engineering-online.com/content/4/1/19

© 2005 Verhey et al; licensee BioMed Central Ltd.

This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.