|
1.IntroductionImage segmentation refers to the technique of dividing an image into nonoverlapping homogeneous regions and extracting the objects of interest. It is the basis of image analysis and computer vision.1 Recently, considerable research on image segmentation has been conducted, and various segmentation algorithms have been proposed. In general, these algorithms can be divided into: edge detection segmentation algorithms,2 region segmentation algorithms,3 threshold segmentation algorithms,4 and fuzzy segmentation algorithms.5 Among them, threshold segmentation algorithms have been widely studied and applied owing to their simplicity and effectiveness. The purpose of threshold segmentation is to separate the object from the background as much as possible and retain maximum image information entropy. Therefore, the essence of an entropy-based threshold segmentation algorithm is to use different entropy functions to establish the objective function, with the segmentation threshold as the independent variable, and then to determine the threshold where the objective function takes the extreme value according to a certain criterion. The traditional one-dimensional (1-D) maximum entropy method only considers the gray-scale information of pixels and neglects their spatial correlation. Although the processing speed is high, the noise immunity is poor. In this regard, by using the information contained in the two-dimensional (2-D) histogram of the gray-scale distribution of image pixels and the average gray-scale distribution of their neighborhood, Abutaleb6 proposed a 2-D maximum entropy method that takes into account the neighborhood mean value information. Although the 2-D maximum entropy method enhances the algorithm’s ability to suppress noise and improves segmentation accuracy, the introduction of neighborhood gray scale mean value information increases running time and resource consumption.7 To improve efficiency, Zhang et al. proposed a 2-D maximum entropy threshold segmentation algorithm by combining the artificial fish swarm optimization algorithm with Abutaleb entropy, which has satisfactory noise immunity and convergence performance.8 To obtain a better threshold, a combination of optimization algorithms is usually employed, such as the particle swarm optimization algorithm,9 the artificial swarm optimization algorithm,10 and the artificial fish swarm optimization algorithm.7 To further improve the performance of the algorithm, Lei et al. introduced the neighborhood gray-scale median based on the 2-D histogram; moreover, they proposed a three-dimensional (3-D) cross-entropy method as well as a fast recursive method to improve efficiency. It achieved a better segmentation effect.11 Compared with the 2-D maximum entropy method, the 3-D maximum entropy method has better segmentation quality; however, algorithm complexity greatly increases. To some extent, the efficiency of the algorithm has been improved by the aforementioned recurrence method and an intelligent optimization algorithm, but the entropy calculation still involves a logarithmic operation. Thus, the algorithm efficiency should be improved. Accordingly, in this study, an equivalent 3-D entropy method is proposed by establishing an equivalent objective function. The method can effectively simplify the calculation and improve efficiency. In view of the searching performance of the artificial fish swarm optimization algorithm, a new threshold calculation method is developed based on the proposed objective function so as to further enhance the timeliness of the algorithm. The experimental result shows that this method not only yields segmentation results that are equivalent to those obtained by the logarithmic method but also improves the efficiency of the algorithm. 2.Three-Dimensional Maximum Entropy MethodLet be an image of size , and let , , be the gray-scale value of the pixel . The neighborhood gray-scale mean value and gray-scale median of a neighborhood of the pixel can be defined as follows: , , and can define a triple . For example, if represents the frequency at which the pixel with gray-scale value , neighborhood gray-scale mean value , and neighborhood gray value appears in the image , then its frequency is12Based on the definition of Shannon entropy, the 3-D discrete entropy can be defined as Based on the 3-D histogram shown in Fig. 1, the 3-D maximum entropy method divides the image into the objective area 0 and the background area 1 by using the threshold . Areas 2 to 7 are the edges and noise regions. Clearly, it can be seen that the 3-D maximum entropy method uses the maximum amount of object and background information in the image, thus preserving details as much as possible. According to the definition of entropy, the total entropy of the image is where is gray levels, is gray value of image pixels, is neighborhood mean, is neighborhood median, , .According to the principle of maximum entropy, the optimal threshold value is 3.Equivalent Three-Dimensional Entropy3.1.Equivalent Three-dimensional Entropy Method and Equivalence ProofAccording to Eq. (5), there are a large number of logarithmic operations in the process of calculating the 3-D entropy. However, the logarithmic operation efficiency is low, which seriously restricts the application of the algorithm. Maximum entropy means the kind of situation in which the probability distribution is the most uniform. And in the ideal situation, is infinitely close to , and close to . In view of this, a new 3-D maximum entropy method is proposed in this study. Its efficiency is improved by replacing the logarithmic operations with more efficient subtraction operations. The equivalence between this algorithm and the traditional 3-D maximum entropy method is now proved theoretically. By Eq. (6), the optimal threshold value is Theorem 1.The optimal threshold value calculated by Eq. (6) is equal to that calculated by Eq. (8). Namely, the proposed 3-D entropy method is equivalent to the traditional 3-D entropy method. According to Lagrange Multiplier Method,13 constants are introduced, then it can be obtained from Eq. (5): Take the partial derivatives of and , respectively, and let the derivatives be 0, which can get Solve the equation set shown in the Eq. (11), which can get It can be obtained from Eqs. (9) and (12) Therefore, It is known from the above solving process, is the maximum value of Eq. (5). And it is also the maximum point of , is known from Eq. (7). Therefore, the optimal threshold value calculated according to Eq. (6) is equal to that calculated according to Eq. (8). Namely, the equivalent 3-D entropy method is equivalent to the traditional 3-D entropy method. 3.2.Artificial Fish-Swarm AlgorithmAccording to Eq. (7), for any threshold vector , the entropy is calculated through summations. The complexity of this calculation is . In addition, . Hence, for any image, the complexity of the calculation is .14 It can be seen that if the optimal threshold of Eq. (7) is obtained by the exhaustive search method, the algorithm is relatively inefficient. Intelligent optimization algorithms can effectively avoid exhaustive calculation and improve efficiency. They are widely used to solve complex problems.15–17 In view of this, Dai et al.17 put forward an optimization strategy from bottom to top, which is called artificial fish swarm optimization algorithm (AFSA), by analyzing the behavioral characteristics of shoals and adopting the model of autonomous animation. AFSA exhibits high convergence rate, high robustness, and strong global searching ability.17 In view of the high convergence rate and strong global searching capability of AFSA, in this study, AFSA is used to determine the optimal threshold value in Eq. (7). In the 3-D gray-scale space , an artificial fish individual model for threshold value calculation is constructed. Each artificial fish represents a potential threshold solution . The behavior types of artificial fish are also defined, namely, foraging behavior, swarm behavior, following behavior, and random behavior.17,18
3.3.Threshold Optimization Based on AFSATo avoid exhaustive search and improve the efficiency of the equivalent 3-D entropy method, AFSA is used to determine the optimal threshold value shown in Eq. (8) and thus achieve image segmentation. If the food concentration in the current position of artificial fish is calculated by the entropy objective function, then the distance between two artificial fish and is defined as The specific steps to obtain the optimal threshold value by using AFSA are summarized as follows:
The more the population size is, the richer the information representing the original image will be, the more accurate the segmentation threshold will get, the higher the optimization accuracy of the algorithm will become. But the increase of population will increase the complexity of the algorithm if other conditions remain unchanged. Reference 19 shows that the efficiency and accuracy will reach the peak value at the same time and the image segmentation effect will be the best when the population size is between 15 and 35. The maximum number of iterations is one of the conditions for the end of the optimization algorithm. It is set so that the algorithm can find the optimal solution under the prescribed conditions. With a large number of experiments, it can be proved that the algorithm can find the optimal solution when the maximum number of iterations is 30. In this study, the population size is 20, and the maximum number of iterations is 30, the step length is 10, and the crowd factor is 0.8. Thus, the total number of summation operations is , and the complexity of the algorithm is , whereas the complexity of the exhaustion method is . Thus, the computation time of this method is significantly reduced, which improves the efficiency of the algorithm. 4.Experimental AnalysisTo test the segmentation performance of the proposed method, the following two sets of experiments were conducted using the four images shown in Fig. 2: (i) Quantitative analysis experiments regarding quantitative indicators of the segmentation effect. Two indicators, namely, threshold value and running time, were selected. A quantitative comparison was made among the traditional 3-D maximum entropy method, the equivalent 3-D maximum entropy method, and the AFSA-based equivalent 3-D maximum entropy method to analyze the effectiveness of the proposed method in improving efficiency. (ii) Qualitative analysis experiments regarding visual effects. The segmentation results of the traditional 1-D, 2-D, and 3-D maximum entropy methods were compared, and the effectiveness of the proposed method was qualitatively analyzed from a visual perspective. The experimental platform was a PC with 2-GB RAM and a Q8300 CPU, which was programmed using Matlab2010. 4.1.Effectiveness Validation of Improvement MeasuresTo verify the equivalence of the proposed 3-D maximum entropy and the rationality of using AFSA to determine the optimal threshold value, the equivalent 3-D maximum entropy method based on AFSA was compared with the traditional 3-D maximum entropy method and the equivalent 3-D maximum entropy method. As the purpose of the experiment is to verify the equivalence between the solution by the improved method and the solution by the traditional 3-D maximum entropy method, it is necessary to compare the threshold values calculated by each method. To test the efficiency of the improved method, the running time of the algorithms should be compared. From the comparison results in Table 1, it can be seen that the threshold value obtained by the equivalent 3-D maximum entropy method is consistent with that obtained by the traditional 3-D maximum entropy method, which experimentally verifies Theorem 1. As the equivalent 3-D maximum entropy method can avoid the time-consuming logarithmic operation, the efficiency of the algorithm is greatly improved. As AFSA is used to determine the optimal threshold value in the AFSA-based equivalent 3-D maximum entropy method, which avoids exhaustive search, the efficiency of the algorithm is further improved. It can be seen that the equivalent 3-D maximum entropy method based on AFSA can give better consideration to the time factor and achieves the same segmentation effect. Table 1Comparison of the results of 3-D maximum entropy method.
4.2.Comparison of Segmentation EffectTo test the segmentation performance of the proposed method and verify its advantages, comparisons with the 1-D maximum entropy method, the 2-D maximum entropy method, and the 3-D maximum entropy were conducted. As shown in Figs. 3–6, the 1-D maximum entropy method only considers the pixel gray-scale information and fails to consider the spatial correlation of pixels, which leads to poor noise immunity. By introducing the neighborhood mean value information, the 2-D maximum entropy method improves the noise immunity of the algorithm. However, as the probability of the main diagonal region is assumed to be during the threshold calculation process,18 the image information is lost, which leads to inaccurate image details. The traditional 3-D maximum entropy method considers median information and more neighborhood information on the basis of 2-D maximum entropy method, and the details of the image are relatively richer. In the proposed method, the optimal threshold is determined based on the 3-D histogram. The noise immunity of the algorithm is relatively strong. As there is no approximate calculation, the same segmentation effect as the maximum entropy method is achieved. The comparison results show that the proposed method exhibits strong antinoise performance and is able to better retain image details. Thereby, the advantages of the method are verified from the visual perspective. 5.ConclusionsIn view of the low efficiency of the traditional 3-D maximum entropy method, an image segmentation method based on the equivalent 3-D entropy and AFSA was proposed. In this method, the optimal threshold is determined by the equivalent 3-D entropy equation shown in Eq. (8), which avoids the time-consuming logarithmic operation. The optimal threshold is calculated by AFSA, which avoids exhaustive search. The results of the quantitative comparison with the traditional 3-D maximum entropy method showed that the segmentation effect of the proposed method is the same as that of the traditional 3-D maximum entropy method, but the efficiency of the algorithm is greatly improved. The qualitative analysis of the 1-D maximum entropy method and the 2-D maximum entropy method showed that the method has strong antinoise performance and better retains image details. The qualitative and quantitative comparison and analysis demonstrated that the proposed method has high accuracy, strong noise immunity, and high speed and may be successfully applied in the segmentation of SAR and noisy images. AcknowledgmentsThis work was supported by the National Natural Science Foundation of China, Grant No. 51677063. The authors have no relevant financial interests in the manuscript and no other potential conflicts of interest to disclose. ReferencesL. M. Tang et al.,
“Image fuzzy clustering segmentation based on variational level set,”
J. Softw., 25
(7), 1570
–1582
(2014). Google Scholar
K. B. Krishnan, S. R. Ranga and N. Guptha,
“A survey on different edge detection techniques for image segmentation,”
Ind. J. Sci. Technol., 10
(4), 1
–8
(2017). https://doi.org/10.17485/ijst/2017/v10i4/108963 Google Scholar
A. Baâzaoui et al.,
“Semi-automated segmentation of single and multiple tumors in liver CT images using entropy-based fuzzy region growing,”
Innov. Res. Biomed. Eng., 38
(2), 98
–108
(2018). https://doi.org/10.1016/j.irbm.2017.02.003 Google Scholar
X. She, X. Liu and H. Chen,
“Fast computation of threshold based on multi-threshold Otsu criterion,”
J. Electron. Inform. Technol., 39
(1), 144
–149
(2017). Google Scholar
X. Lei and H. Ouyang,
“Image segmentation algorithm based on improved fuzzy clustering,”
Cluster Comput., 62
(1), 1
–11
(2018). Google Scholar
M. Dhieb et al.,
“2-D entropy image segmentation on thresholding based on particle swarm optimization (PSO),”
in Int. Conf. on Advanced Technologies for Signal and Image Processing,
143
–147
(2014). https://doi.org/10.1109/ATSIP.2014.6834594 Google Scholar
H. Zhang et al.,
“Processing method for underwater degenerative image,”
J. Tianjin Univ., 43
(9), 827
–833
(2010). Google Scholar
X. Lei and A. Fu,
“Two-dimensional maximum entropy image segmentation method based on quantum-behaved particle swarm optimization algorithm,”
in Int. Conf. on Natural Computation,
692
–696
(2016). https://doi.org/10.1109/ICNC.2008.822 Google Scholar
B. Lei and J. Fan,
“Three dimensional extension of cross-entropy thresholding algorithm for gray-level images,”
Control Decis., 231
(4), 740
–744
(2016). Google Scholar
D. Karaboga, An Idea Based on Honey Bee Swarm for Numerical Optimization, Ereiyes University, Kayseri, Turkiye
(2005). Google Scholar
J. Liu, Z. Yu and W. Jin,
“Three dimensional minimum error threshold algorithm and its fast recursive method,”
J. Electron. Inform. Technol., 35
(9), 2073
–2080
(2013). https://doi.org/10.3724/SP.J.1146.2013.00041 Google Scholar
J. Wangc et al.,
“Distributed real-time demand response based on Lagrangian multiplier optimal selection approach,”
Appl. Energ., 190 949
–959
(2017). https://doi.org/10.1016/j.apenergy.2016.12.147 Google Scholar
J. Fan, F. Zhao and X. Zhang,
“Recursive algorithm for three-dimensional otsu’s thresholding segmentation method,”
Acta Electron. Sin., 35
(7), 1398
–1402
(2007). Google Scholar
V. Kumar and D. Kumar,
“An astrophysics-inspired Grey wolf algorithm for numerical optimization and its application to engineering design problems,”
Adv. Eng. Softw., 112 231
–254
(2017). https://doi.org/10.1016/j.advengsoft.2017.05.008 AESODT 0965-9978 Google Scholar
Q. Y. Jiang et al.,
“An efficient multi-objective artificial raindrop algorithm and its application to dynamic optimization problems in chemical processes,”
Appl. Soft Comput., 58 354
–377
(2017). https://doi.org/10.1016/j.asoc.2017.05.003 Google Scholar
X. Li, Z. Shao and J. Qian,
“An optimizing method based on autonomous animals: fish-swarm algorithm,”
Syst. Eng., 11 32
–38
(2002). Google Scholar
Y. Dai, L. Yao and Y. Wang,
“Elite learning-based multi-dimensional dynamic adaptive artificial fish swarm algorithm,”
J. Chin. Comput. Syst., 12
(12), 2668
–2672
(2017). Google Scholar
X. Zhang, Y. Sun and Y. Zhen,
“Precise two-dimensional otsu’s image segmentation and its fast recursive realization,”
Acta Electron. Sin., 39
(8), 1778
–1784
(2011). TTHPAGTTHPAG 0372-2112 Google Scholar
L. Cui, X. Sun and H. Li,
“Multilevel thresholding image segmentation based on improved artificial fish swarm algorithm,”
Comput. Sci., 41
(8), 306
–310
(2014). Google Scholar
BiographyXiangxiao Lei, EngD, is an associate professor at Changsha Social Work College. He graduated from Central South University; now he is studying at Hunan University. His research interests include intelligent control and digital image processing. |