Citation: Wenyang Liu, Dan Ruan. Segmentation of Left Ventricle with a Coupled Length Regularization and Sparse Composite Shape Prior: a Variational Approach[J]. AIMS Medical Science, 2015, 2(4): 295-302. doi: 10.3934/medsci.2015.4.295
[1] | Asha Usha Vijayakumar, Manju Sudhakaran, Leelabhai Janaki Yovel . Human basilar artery: morphology & variations. AIMS Medical Science, 2020, 7(4): 278-292. doi: 10.3934/medsci.2020017 |
[2] | Ilige Hage, Ramsey Hamade . Automatic Detection of Cortical Bones Haversian Osteonal Boundaries. AIMS Medical Science, 2015, 2(4): 328-346. doi: 10.3934/medsci.2015.4.328 |
[3] | Antonin Prochazka, Jan Zeman . Thyroid nodule segmentation in ultrasound images using U-Net with ResNet encoder: achieving state-of-the-art performance on all public datasets. AIMS Medical Science, 2025, 12(2): 124-144. doi: 10.3934/medsci.2025009 |
[4] | Ehab I. El-Amin, Gamal Y. Ahmed, Waled Amen Mohammed Ahmed, Khalid E. Khalid, Ashraf M. E. A. Sakran . Lengths and Positions of the Vermiform Appendix among Sudanese Cadavers. AIMS Medical Science, 2015, 2(3): 222-227. doi: 10.3934/medsci.2015.3.222 |
[5] | Marco Ferrone, Anna Franzone, Bruno Trimarco, Giovanni Esposito, Plinio Cirillo . Percutaneous Coronary Intervention in a Patient with Acute Thrombosis of Saphenous Vein Graft and Patent Native Coronary Artery: Which is the Vessel to Approach?. AIMS Medical Science, 2015, 2(4): 310-315. doi: 10.3934/medsci.2015.4.310 |
[6] | Paul J Ross, Krishnie Srikandarajah, Julien de Naurois . Right versus left-sided colon cancer: Is it time to consider these as different diseases?. AIMS Medical Science, 2018, 5(3): 303-315. doi: 10.3934/medsci.2018.3.303 |
[7] | Ragini C Bhake, Stafford L Lightman . A Simple Complex Case: Restoration of Circadian Cortisol Activity. AIMS Medical Science, 2015, 2(3): 182-185. doi: 10.3934/medsci.2015.3.182 |
[8] | Prarthana Shrestha, Rik Kneepkens, Gijs van Elswijk, Jeroen Vrijnsen, Roxana Ion, Dirk Verhagen, Esther Abels, Dirk Vossen, and Bas Hulsken . Objective and Subjective Assessment of Digital Pathology Image Quality. AIMS Medical Science, 2015, 2(1): 65-78. doi: 10.3934/medsci.2015.1.65 |
[9] | Muaz O. Fagere . Diagnostic Utility of Pleural Effusion and Serum Cholesterol, Lactic Dehydrogenase and Protein Ratios in the Differentiation between Transudates and Exudates. AIMS Medical Science, 2016, 3(1): 32-40. doi: 10.3934/medsci.2016.1.32 |
[10] | Luceta McRoy, George Rust, Junjun Xu . Factors Associated with Asthma ED Visit Rates among Medicaid-enrolled Children: A Structural Equation Modeling Approach. AIMS Medical Science, 2017, 4(1): 71-82. doi: 10.3934/medsci.2017.1.71 |
Cine MRI is a suitable modality in analyzing cardiac functions by segmenting the endo- and epicardial contours of the left ventricle (LV) [1]. Given the unclear boundaries between these structures and against the background, prior geometric knowledge needs to be incorporated. A typical idea is to maintain a close-to-constant distance between the endo- and epicardial contours (a “ring” structure) with either hard values [2] or by a soft constraint [3]. However, such static/pre-defined distance may fail to capture large LV shape variations across slices and phases among different subjects. More recently, it has been proposed to use a two-level contours of a single level set function to represent the endo- and epicardium [4], with their enclosing relations maintained by a smoothly varying distance. A local intensity model has been utilized to handle the overlapped distributions. However, representing the endo- and epicardium with a single level set function may hinder flexible incorporation of shape prior specific to individual structures [5,6,7]. The local intensity model could also be overly sensitive to contour initializations and kernel parameter settings [8].
In this study, we propose to represent the endo- and epicardium with two separate level set functions, but introduce a novel coupling setup embedded in the length regularization, with a symmetric “dilation/erosion” morphological relation imposed, to achieve a smoothly varying distance between the endo- and epicardial contours. The coupled level set representations further allows us to incorporate a sparse composite shape descriptor to boost the performance. Gaussian mixture models are utilized to represent overlapped intensity distributions in each subregion. Compared to local intensity models, it is more robust to contour initializations, noise, and selection of setup parameters.
Figure 1 illustrates the proposed cardiac region separation scheme. Specifically, given an image I:Ω→R and two dependent level set functions ϕ1,ϕ2:Ω→R, we partition Ω into three subdomains: Ω1Δ={X|ϕ1(X)≤0}, Ω1Δ={X|ϕ1(X)≤0}, Ω3Δ={X|ϕ2(X)>0}, representing the left ventricular cavity, myocardium and background, respectively. A typical variational segmentation formulation consists of two components: E(Φ) = Efidelity + Ereg, a data fidelity and a regularization, which we will elaborate bellow.
We choose to model intensity distributions with Gaussian mixtures for each Ωi [9]:
P(I(X)|Ωi,θi)=ni∑j=1wj,i√2πσ2j,iexp(−(I(X)−μj,i)22σ2j,i), |
(1) |
Efidelity(Φ,Θ)=−∫Ω(1−H(ϕ1))log(c1P(I(x)|θ1))dx−∫ΩH(ϕ1)(1−H(ϕ2))log(c2P(I(x)|θ2))dx−∫ΩH(ϕ2)log(c3P(I(x)|θ3))dx, |
(2) |
Our design of regularization consists of two components: Elength and Eshape.
Elength: For a smoothly varying distance between the endo- and epicardial contours at each location,
we introduce a novel coupling in the length regularization with
Elength=∫Ωg1δ(ϕ1)|∇ϕ1|dx+∫Ωg2δ(ϕ2)|∇ϕ2|dx+β2∫Ω|∇d|2dx, |
(3) |
Eshape: Inspired by a recently developed shape regularization [7], we construct two shape library Dendo=[ψendo1,ψendo2,⋯ψendom] and Depi=[ψepi1,ψepi2,⋯ψepim], representing the training shapes. The shape regularization is designed as:
Eshape=∫Ω{(ϕ1−Dendow)2+(ϕ2−Depiw)2}dx+γ‖w‖1, |
(4) |
With the introduced Elength and Eshape, our Ereg is designed as the following:
Ereg(Φ,d,w)=λ12∫Ω(ϕ2+d)2δ(ϕ1)|∇ϕ1|dx+λ22∫Ω(ϕ1−d)2δ(ϕ2)|∇ϕ2|dx+β2∫Ω|∇d|2dx+α2∫Ω{(ϕ1−Dendow)2+(ϕ2−Depiw)2}dx+γ‖w‖1+μ22∑i=1∫Ω(∇ϕi−1)2dx, |
(5) |
ALGORITHM 1 Minimization scheme | |
1: | while |Ek - Ek-1| < tol do |
2: | minimization w.r.t. θ1, θ2, θ3 with Expectation-Maximization (EM) algorithm [12]: θk+11,θk+12,θk+13←EM(ϕk1,ϕk2,I,wk,dk) |
3: | minimization w.r.t. w with alternating direction method of multipliers (ADMM) [13]: wk+1←ADMM(α2(‖ϕk1−Dendow‖22+‖ϕk2−Depiw‖22)+γ‖w‖1) |
4: | gradient descending w.r.t. d dk+11←dkiter_num while m < iter num do dk+1m+1=dk+1m+Δt{−λ1(ϕk2+dk+1m)δ(ϕk1)|∇ϕk1|−λ2(ϕk1−dk+1m)δ(ϕk2)|∇ϕk2|+βΔdk+1m} end while |
5: | gradient descending w.r.t. ϕ1, ϕ2 ϕk+11,1←ϕk1,iter_num,ϕk+12,1←ϕk2,iter_num while i < iter_num do ϕk+11,i+1=ϕk+11,i+Δt{−δ(ϕk+11,i)log(c1P(I(x)|θk+11))+δ(ϕk+11,i)(1−H(ϕk+12,i))log(c2P(I(x)|θk+12))+λ12δ(ϕk+11,i)∇⋅((ϕk+12,i+dk+1m+1)2∇ϕk+11,i|∇ϕk+11,i|)−λ2(ϕk+11,i−dk+1m+1)δ(ϕk+12,1)|∇ϕk+12,1|−α(ϕk+11,1−Dendowk+1)+μ(ϕk+11,1−∇⋅(∇ϕk+11,i|∇ϕk+11,i|))} ϕk+12,i+1=ϕk+12,i+Δt{−δ(ϕk+12,i)H(ϕk+11,i+1)log(c2P(I(x)|θk+12))+δ(ϕk+12,i)log(c3P(I(x)|θk+13))−λ1(ϕk+12,i+dk+1m+1)δ(ϕk+11,i+1)|∇ϕk+11,i|+λ22δ(ϕk+12,i)∇⋅((ϕk+11,i+1−dk+1m+1)2∇ϕk+12,i|∇ϕk+12,i|)−α(ϕk+12,1−Depiwk+1)+μ(ϕk+12,1−∇⋅(∇ϕk+12,i|∇ϕk+12,i|))} end while |
6: | end while |
For all experiments in this study, we manually chose and fixed the parameters as: c1 = c2 = 1, c3 = 0.1, λ1 = λ2 = 2, β = 2, α = γ = 0.02, μ = 1 and time step Δt = 0.1. We set the Gaussian component number to be n1 = n2 = 1 for the cavity and myocardium, and n3 = 2 for the background. Our algorithm was implemented with matlab 2012b. It took about one minute to segment one image volume on a macbook pro laptop with quad-core i7 2.3GHz and 8GB RAM. No specific code optimization and/or paralellization schemes were used.
We evaluated the proposed method on datasets from MICCAI LV segmentation challenge (http://smial.sri.utoronto.ca/LV_Challenge/Home.html), which consists of 15 training datasets and 15 validation datasets from patients of different pathologies. The Cine steady state free precession MR short axis images were obtained with a 1.5T GE Signa MRI, with FOV = 320 × 320 mm2, image size = 256 × 256 and slice-thickness = 8 mm. The manual segmented endo- and epicardial contours were provided in all slices at end-diastolic (ED) and end-systolic (ES) phases. Our training endo- and epicardium libraries were built upon 15 training datasets, and the evaluation was performed on the 15 validation datasets.
The segmentation accuracy was evaluated based on both Dice similarity coefficient (DSC) metric and average perpendicular distance (APD). DSC is defined as DSCΔ=2|Cseg∩Ctruth||Cseg|+|Ctruth|, where Cseg and Ctruth are the segmented foreground from the obtained and manual segmentation respectively. APD measures the perpendicular distance from the segmented contour to the corresponding manually contour, averaged over all contour points.
Figure 2 compares segmented contours from our method with manual segmented contours on one typical LV example. Figure 3 demonstrates the flexibility and robustness of the proposed method on segmenting one LV example with various thickness of its myocardium within and across different slices. Table 1 reports and compares the DSC and APD statistics of the proposed method with results from other state-of-the-art methods. The proposed method had slightly lower APD compared to [4]. It achieved competitive/better DSC and APD accuracy compared to the other state-of-the-art methods.
Our proposed coupled length/distance regularization dynamically updates and encourages a smoothly varying distance between the endo- and epicardium through the optimization process. It is more flexible and accurate to capture the large endocardium-epicardium variations across different slices and among different patients, as compared to conventional approaches where such distance is usually static and pre-determined by heuristics [2,3,16].
The proposed method is similar to the dual-layer single level set approach [4] in regularizing a smoothly varying distance between the endo- and epicardium, but with added flexibility of incorporating individual priors for each structure separately [5,6,7], such as via coupled or decoupled sparse composite shape models depends on the training source. In this study, we utilize a single weight w to ensure the coupling of epi- and endocardium selections, since those shapes come from a single patient in each shape library. However, under situations that training shapes do not pair up, our formulation would be flexible enough to provide an asymmetric and decoupled regularization. For example, when endo- and epicardial training shapes come from different groups of patients, our model is capable of providing an asymmetric regularization by enforcing different weights (wendo and wepi) from such different training sources to leverage all training instances. Such flexibility also permits further extension of the current model to a joint left and right ventricle (RV) segmentation framework, where training LV and RV shapes often come from heterogeneous sources. In the specific context where differentiating intensity gradient is often absent at the structure interface, the more global Gaussian mixture model we use has the advantage of being more stable, more robust to contour initialization and noise, and does not require the tuning of (heterogeneous) local kernel parameters.
In summary, we have proposed a novel variational segmentation method by introducing geometrical coupling into the length regularization and a flexible coupled/decoupled sparse composite shape prior. Our method has been evaluated on the validation datasets from MICCAI challenge and achieved comparable/better DSC and APD accuracy compared to other state-of-the-art methods. A joint left and right ventricle segmentation method is under development.
All authors declare no conflicts of interest in this paper.
[1] | Lelieveldt B, Geest R, Lamb H, et al. (2001) Automated observer-independent acquisition of cardiac short-axis MR images: A pilot study 1. Radiology 221: 537–542. |
[2] | Lynch M, Ghita O, Whelan PF (2006) Left-ventricle myocardium segmentation using a coupled level-set with a priori knowledge. Comput Mem Imag Grap 30: 255–262. |
[3] | Kohlberger T, Funka-Lea G, Desh V (2007) Soft level set coupling for LV segmentation in gated perfusion SPECT. In Medical Image Computing and Computer-Assisted Intervention (MICCAI) 4791: 327–334. |
[4] | Feng C, Li C, Zhao D, et al. (2013) Segmentation of the left ventricle using distance regularized two-layer level set approach. In Medical Image Computing and Computer-Assisted Intervention (MICCAI) 8149: 477–484. |
[5] | Tsai A, Yezzi A, Wells W, et al. (2003) A shape-based approach to the segmentation of medical imagery using level sets. IEEE Trans Med Imaging 22: 137–154. |
[6] |
Cremer D, Osher S, Soatto S (2006) Kernel density estimation and intrinsic alignment for shape priors in level set segmentation. Int J Comput Vision 69: 335–351. doi: 10.1007/s11263-006-7533-5
![]() |
[7] | Liu W, Ruan D (2014) Segmentation with a shape dictionary. In Biomedical Imaging (ISBI), IEEE International Symposium on: 357–360. |
[8] | Wang L, Li C, Sun Q, et al. (2008) Brain MR image segmentation using local and global intensity fitting active contours/surfaces. In Medical Image Computing and Computer-Assisted Intervention (MICCAI) 5241: 384–392. |
[9] | Verma N, Muralidhar GS, Bovik AC, et al. (2011) Model-driven, probabilistic level set based segmentation of magnetic resonance images of the brain. In Engineering in Medicine and Biology Society (EMBC), IEEE Annual International Conference on: 2821–2824. |
[10] | Li C, Xu C, Gui C, et al. (2005) Level set evolution without re-initialization: a new variational formulation. In Computer Vision and Pattern Recognition (CVPR), IEEE Computer Society Conference on 1: 430–436. |
[11] | Osher S, Fedkiw R (2003) Level set methods and dynamic implicit surfaces. Springer. |
[12] | Dempster AP, Laird NM, Rubin DB (1977) Maximum likelihood from incomplete data via the EM algorithm. J R Stat Soc Series B (Methodological) 39: 1–38. |
[13] | Boyd S, Parikh N, Chu E, et al. (2011) Distributed optimization and statistical learning via the alternating direction method of multipliers. Foundations and Trends in Machine Learning 3: 1– 122. |
[14] | Jolly MP, Xue H, Grady L, et al. (2009) Combining registration and minimum surfaces for the segmentation of the left ventricle in cardiac Cine MR images. In Medical Image Computing and Computer-Assisted Intervention (MICCAI) 5762: 910–918. |
[15] | Constantinides C, Chenoune Y, Kachenoura N, et al. (2009) Semi-automated cardiac segmentation on Cine magnetic resonance images using GVF-snake deformable models. The MIDAS Journal-Cardiac MR Left Ventricle Segmentation Challenge. |
[16] |
Folkesson J, Samset E, Kwong R, et al. (2008) Unifying statistical classification and geodesic active regions for segmentation of cardiac MRI. IEEE Trans Inf Technol Biomed 12: 328–334. doi: 10.1109/TITB.2007.912179
![]() |
1. | Wenyang Liu, Yam Cheung, Amit Sawant, Dan Ruan, A robust real-time surface reconstruction method on point clouds captured from a 3D surface photogrammetry system, 2016, 43, 00942405, 2353, 10.1118/1.4945695 | |
2. | Mehreen Irshad, Muhammad Sharif, Mussarat Yasmin, Amjad Rehman, Muhammad Attique Khan, Discrete light sheet microscopic segmentation of left ventricle using morphological tuning and active contours, 2022, 85, 1059-910X, 308, 10.1002/jemt.23906 |