Loading [Contrib]/a11y/accessibility-menu.js
Research article Special Issues

Evolutionary optimization framework to train multilayer perceptrons for engineering applications


  • Training neural networks by using conventional supervised backpropagation algorithms is a challenging task. This is due to significant limitations, such as the risk for local minimum stagnation in the loss landscape of neural networks. That may prevent the network from finding the global minimum of its loss function and therefore slow its convergence speed. Another challenge is the vanishing and exploding gradients that may happen when the gradients of the loss function of the model become either infinitesimally small or unmanageably large during the training. That also hinders the convergence of the neural models. On the other hand, the traditional gradient-based algorithms necessitate the pre-selection of learning parameters such as the learning rates, activation function, batch size, stopping criteria, and others. Recent research has shown the potential of evolutionary optimization algorithms to address most of those challenges in optimizing the overall performance of neural networks. In this research, we introduce and validate an evolutionary optimization framework to train multilayer perceptrons, which are simple feedforward neural networks. The suggested framework uses the recently proposed evolutionary cooperative optimization algorithm, namely, the dynamic group-based cooperative optimizer. The ability of this optimizer to solve a wide range of real optimization problems motivated our research group to benchmark its performance in training multilayer perceptron models. We validated the proposed optimization framework on a set of five datasets for engineering applications, and we compared its performance against the conventional backpropagation algorithm and other commonly used evolutionary optimization algorithms. The simulations showed the competitive performance of the proposed framework for most examined datasets in terms of overall performance and convergence. For three benchmarking datasets, the proposed framework provided increases of 2.7%, 4.83%, and 5.13% over the performance of the second best-performing optimizers, respectively.

    Citation: Rami AL-HAJJ, Mohamad M. Fouad, Mustafa Zeki. Evolutionary optimization framework to train multilayer perceptrons for engineering applications[J]. Mathematical Biosciences and Engineering, 2024, 21(2): 2970-2990. doi: 10.3934/mbe.2024132

    Related Papers:

    [1] Z. Aboub, B. Daoudi, A. Boukraa . Theoretical study of Ni doping SrTiO3 using a density functional theory. AIMS Materials Science, 2020, 7(6): 902-910. doi: 10.3934/matersci.2020.6.902
    [2] Lu Wang, Chris M. Marin, Wai-Ning Mei, Chin Li Cheung . Electronic structures of lanthanum, samarium, and gadolinium sulfides. AIMS Materials Science, 2015, 2(2): 97-105. doi: 10.3934/matersci.2015.2.97
    [3] Kulpash Iskakova, Rif Akhmaltdinov, Temirgali Kuketaev . Formation of (Cu)n & (Cu2O)n nanostructures with the stability of their clusters. AIMS Materials Science, 2018, 5(3): 543-550. doi: 10.3934/matersci.2018.3.543
    [4] Radi A. Jishi . Modified Becke-Johnson exchange potential: improved modeling of lead halides for solar cell applications. AIMS Materials Science, 2016, 3(1): 149-159. doi: 10.3934/matersci.2016.1.149
    [5] Iñaki López, Teresa Cebriano, Pedro Hidalgo, Emilio Nogales, Javier Piqueras, Bianchi Méndez . The role of impurities in the shape, structure and physical properties of semiconducting oxide nanostructures grown by thermal evaporation. AIMS Materials Science, 2016, 3(2): 425-433. doi: 10.3934/matersci.2016.2.425
    [6] Xuan Luc Le, Nguyen Dang Phu, Nguyen Xuan Duong . Enhancement of ferroelectricity in perovskite BaTiO3 epitaxial thin films by sulfurization. AIMS Materials Science, 2024, 11(4): 802-814. doi: 10.3934/matersci.2024039
    [7] Larysa Khomenkova, Mykola Baran, Jedrzej Jedrzejewski, Caroline Bonafos, Vincent Paillard, Yevgen Venger, Isaac Balberg, Nadiia Korsunska . Silicon nanocrystals embedded in oxide films grown by magnetron sputtering. AIMS Materials Science, 2016, 3(2): 538-561. doi: 10.3934/matersci.2016.2.538
    [8] Alberto Debernardi . Ab initio calculation of band alignment of epitaxial La2O3 on Si(111) substrate. AIMS Materials Science, 2015, 2(3): 279-293. doi: 10.3934/matersci.2015.3.279
    [9] Lucangelo Dimesso, Michael Wussler, Thomas Mayer, Eric Mankel, Wolfram Jaegermann . Inorganic alkali lead iodide semiconducting APbI3 (A = Li, Na, K, Cs) and NH4PbI3 films prepared from solution: Structure, morphology, and electronic structure. AIMS Materials Science, 2016, 3(3): 737-755. doi: 10.3934/matersci.2016.3.737
    [10] Mohammad Na'aim Abd Rahim, Mohd Shukor Salleh, Saifudin Hafiz Yahaya, Sivarao Subramonian, Azrin Hani Abdul Rashid, Syarifah Nur Aqida Syed Ahmad, Salah Salman Al-Zubaidi . Microstructural investigation and mechanical properties of Al2O3-MWCNTs reinforced aluminium composite. AIMS Materials Science, 2025, 12(2): 318-335. doi: 10.3934/matersci.2025017
  • Training neural networks by using conventional supervised backpropagation algorithms is a challenging task. This is due to significant limitations, such as the risk for local minimum stagnation in the loss landscape of neural networks. That may prevent the network from finding the global minimum of its loss function and therefore slow its convergence speed. Another challenge is the vanishing and exploding gradients that may happen when the gradients of the loss function of the model become either infinitesimally small or unmanageably large during the training. That also hinders the convergence of the neural models. On the other hand, the traditional gradient-based algorithms necessitate the pre-selection of learning parameters such as the learning rates, activation function, batch size, stopping criteria, and others. Recent research has shown the potential of evolutionary optimization algorithms to address most of those challenges in optimizing the overall performance of neural networks. In this research, we introduce and validate an evolutionary optimization framework to train multilayer perceptrons, which are simple feedforward neural networks. The suggested framework uses the recently proposed evolutionary cooperative optimization algorithm, namely, the dynamic group-based cooperative optimizer. The ability of this optimizer to solve a wide range of real optimization problems motivated our research group to benchmark its performance in training multilayer perceptron models. We validated the proposed optimization framework on a set of five datasets for engineering applications, and we compared its performance against the conventional backpropagation algorithm and other commonly used evolutionary optimization algorithms. The simulations showed the competitive performance of the proposed framework for most examined datasets in terms of overall performance and convergence. For three benchmarking datasets, the proposed framework provided increases of 2.7%, 4.83%, and 5.13% over the performance of the second best-performing optimizers, respectively.



    According to Braun D et al. [1,2], the discovery of "macromolecules" by Hermann Staudinger in the early nineteens, pave way for the development of synthetic polymeric materials. Due to their high molecular weight, polymeric materials are known to possess some quality attributes such as mechanical and technical properties [3,4] which are not observed in other substances like metal and iron. For instance, against the shortcoming of iron and metal, the chemical nature of polymer has made it resistible to water and micro-organisms attack [5,6], which has enhanced the durability of polymeric materials. However, these distinct polymer properties have been inimical to the bio-degradation of polymer waste leading to the accumulation of polymer waste in the environment [6,7]. The accumulation of this polymer waste is considered a huge threat to healthy living and environment [8].

    Polyethylene bags (known as Nylon bags in Nigeria) among other polymeric compounds were developed in the 1970s [9,10], and since then, it has gained wide acceptance among the buyers and sellers. Special features such as its versatility, affordability, availability, and minimal cost to produce among other factors are reasons for its wide usage, as Spokas KA [11] reported that around 500 billion plastic bags are used every year worldwide. The case is not far from Nigeria, Anichebe E [12] revealed that Nigeria generates more than 32 million metric tonnes of waste annually, which plastic waste is amount to 2.5 million tons [13]. Nigeria is rated as the ninth in the world for plastic pollution especially in marine pollution, and mismanagement of plastic waste [7].

    Due to its availability and affordability, people discard polyethylene bags at a slight opportunity, neglecting the other option of reuse. One of the reasons for this act is that they know, they can easily acquire one when next they visit any supermart, or simply walk up to any vendor, which their request will be gladly granted as a means of winning their patronage. Though recycling is much emphasised, recycling Low-Density Polyethylene (LDPE) and Linear-Low Density Polyethylene (LLDPE) bags are considered not cost-effective, as it is cheap, and the feasibility of leaching toxic chemicals at the point of recycling is also major hindrance [12]. This is why Polyethylene bags are much saturated in Nigeria's environment.

    Odior et al. [14] revealed that, Nigeria is Africa's largest importer of plastics in primary forms, as production of Linear-Low Density Polyethylene bag happened to be a major source of income for small-medium business opportunities. This may be difficult for government to completely do away with polyethylene bags, as it is a means of livelihood to some. However, the health and the environmental impacts of Polyethylene bags outweigh all the benefits [11,15]. Polyethylene bags, especially, Linear-Low Density Polyethylene bag is generously utilised in Nigeria without a second thought of what will be the response of environment to this overloading of Polyethylene waste.

    Therefore, this paper seeks to discourse the imminent danger of generous uses of Polyethylene bags in Nigeria, and its environmental implications.

    Figure 1.  Dumping site besides the main road at Mppape, Abuja revealing Nylon bags waste [16].
    Figure 2.  Dumping site filled with Nylon bags waste along Mubi roundabout in Yola, Adamawa state.
    Figure 3.  Polyethylene bags (Known also as Nylon bag in Nigeria).

    According to Dumbili E et al. [7], the use of plastic bags with other single-use plastic products such as takeaway food packs, spoons, cups and straws is a daily adventure in Nigeria.

    Polyethylene bags (Nylon bags) are generously used for many purposes in Nigeria, such as packaging nylon (LDPE bag) for books; small electronics appliances (both LDPE and LLDPE), food items (majorly LLDPE bag), commodity etcetera. It is used as waste collection nylon (LDPE bags) in many local hospitals, organisations and homes. While low-income earners children and rural dwellers used it as school bags, many households and food vendors use Linear-Low Density Polyethylene bag as a wrapper for solid meal, complimentary gifts in some supermarts and boutiques. Some customers even request extra nylon (LDPE and LLDPE bags), which are generously granted without a thought of the impact of that single nylon on the environment.

    Apart from the prevalent uses of polyethylene bags (known as Nylon bags) in various supermart and shop outlets, one of the most predominant usages is in domestic affairs, especially, kitchen apartments. Nigeria being blessed with many tribes [17], has many local dishes, which cut across different regions. Most of these local delicacies are majorly in form of solid, as our forefathers, whose major occupations such as farming, blacksmith, fishing etc., required energy. They believed that solid meals could supply the energy needed to carry out their day-to-day activities, so most local meals are solid. Some of these local dishes were formerly prepared in specialised leaves before cooking (such as Moinmoin, Okpa), or wrapped with leaves when is done (such as Eba, Apu, Tuwo, pounded yam, Amala, Kukure etc.).

    With the advent of technology and the discovery of Polyethylene bags, these special leaves previously used for cooking and wrapping of solid meals, have been substituted with polyethylene bags [18]. Even, the likes of modern vitamins-fortified solid meals such as Semolina, Wheat are now usually wrapped with polyethylene bags after cooking, even when the meal is still hot. This is a common practice at major homes, food vendors and cafeterias. Although, research is ongoing to determine the health negative impact of Polyethylene bags, but the discovery of plastic bisphenol-A (BPA) residue in human urine [19], has attested to the fact that same can occur with polyethylene bags. alami T and Ogbe A [16,20] buttressed this fact by predicting high tendency of chemical leaching of Polyethylene bags (or Polyethylene additives) into the food as a result of heat application in the process of wrapping hot solid meal (such as Semo, Amala, Apu and Tuwo Shinkafa), and cooking of Moinmoin, Okpa (a solid meal derived from beans pudding) with polyethylene bags. This has a grave consequence as terminal diseases such as cancer and renal failure have been traced to ingestion of this harmful chemical via food [19]. Unfortunately, most people that patronised these nylon-wrapped foods are those that cannot adequately take care of the health consequence of consuming nylon-wrapped food due to financial constraints.

    Also, in most local canteen, low-class families, and rural areas, firewood is often a major source of cooking. Waste Polyethylene bags are commonly used to ignite the fire to the firewood, in some cases, waste polyethylene bags are burnt concurrently with firewood, in order to speed up the rate of combustion. In the process of cooking, some may inhale smoke containing polyethylene chemicals, while some smoke may be dissolved into the meal that is on fire. On long exposure, this may have negative effect on the eyes, as well as on the environment [21].

    The chemical composition of polymer distinguishes it from other materials as polymer contains a repeated unit of monomers or copolymers [1,3]. According to Ewelele RO ([22], the properties of polymer is not independent of their molecular weight. Since same polymer under different degree of polymerisation exhibit different properties, it will be wise to examine different molecular weight of polyethylene to predict their polymeric behaviours.

    The need to improve more on HDPE properties such as flexibility gave birth to LLDPE. Linear Low-Density Polyethylene (LLDPE) is produced by copolymerization of ethylene with relatively small amounts of 1-alkene at low temperature and pressure [23]. According to Wikipedia [24], the actual polymerization process can be done either in solution phase or in gas phase reactors. Usually, octene is the comonomer in solution phase while butene and hexene are copolymerized with ethylene in a gas phase reactor. The result of copolymerization process generates short branches along the linear polyethylene chain.

    According to Okamura T et al. [23,25,26], Polyethylene (•CH2―CH2―) x was first synthesized on an industrial scale in 1939. This was done under high pressure of about 1,000–3,000 atm and at temperatures ranging from 80℃ to 300℃. A free radical polymerisation mechanism was employed in the presence of benzoyl peroxide as initiator. The final product resulted in Low-Density Polyethylene (LDPE).

    The limited application of Low-Density polyethylene due to the high number of branches formed, as a result of intermolecular and intramolecular chain transfer during polymerization, pave way for the introduction of High-density polyethylene [27]. High-density polyethylene (HDPE) is usually prepared at low pressure at about 70℃ in the presence of a special catalyst (Ziegler-Natta catalyst) [28].

    Due to the high crystallinity, Polyethylene bags made from HDPE are durable, and not easily torn. Therefore, it can be re-used many times before finally disposed. Waste from HDPE bag is not so rampant, as it can outlast so many bags produced from LLDPE and LDPE. Recycling of HDPE bag is also feasible. A polyethylene bag made from LLDPE is usually referred to as a single used Polyethylene bag. Because of their flexibility, and availability, it is usually used once, it is affordable, easy to produce, and very cheap. Most waste Polyethylene bag in Nigeria is made from LLDPE, therefore, it constitutes the most misused of all Polyethylene bags.

    Table 1.  Comparison properties of LLDPE, LDPE, and HDPE.
    Types of Polyethylene Properties References
    LLDPE ⅰ. The densities of LLDPE vary from 0.926gcm−3 to 0.94gcm−3
    ⅱ. the crystallinity is 50–70 %
    ⅲ. Higher tensile strength
    ⅳ. Higher impact resistance than LDPE.
    ⅴ. It is very flexible and elongates under stress
    ⅵ. It has good resistance to chemicals.
    ⅶ. It has good electrical properties
    [23,24,29]
    LDPE ⅰ. A high degree of short and long-chain branching.
    ⅱ. Density - 0.910–0.940 g/cm3
    ⅲ.the crystallinity (below about 50 %)
    ⅳ. highly malleable
    ⅴ. Low tensile strength
    ⅵ. Poor durability.
    [1,23,26]
    HDPE ⅰ. The density is approximately 0.95 g/mL
    ⅱ. The crystallinity is about 70–90 %
    ⅲ.High melting point
    ⅳ. High tensile strength.
    ⅴ. Rigid, robust, and durable.
    [1,23,30]

     | Show Table
    DownLoad: CSV
    Figure 4.  Schematic molecular structure of (a) LDPE, (b) LLDPE, and (c) HDPE [23].

    Improper disposal is one of the major environmental challenges of polyethylene bags in Nigeria [7]. It upsets the delicate balance of sanitation, majorly in the sub and urban area because of their high patronage to products that comes with Polyethylene bags. Several reports [6,7,31] revealed heaps of waste Polyethylene bags (Nylon bags) scattering throughout the major cities of Nigeria. For instance, Anunonwu CO [32] reported a heap of waste nylon bags in Owerri, the capital city of Imo State. The same trend was also noticed in Benin city, where improper disposal of waste in Nylon bag was prevalent on the major streets [33].

    The Federal Capital Territory is not exonerated from this, as many dump areas are plagued with waste nylon bags flying all around, especially in a slum area surrounding the Federal Capital. This improper disposal may be seen as one of the contributing factors to flooding, as [34] revealed that the accumulation of polyethylene bags can block the drainage system, thereby causing water to go in wrong direction. Dumbili E et al. [7,35] further revealed that household sewerage system can be jeopardised as a result of throwing away wastewater with waste polyethylene bags used for wrapping solid meals, a practice which is prevalent among middle and low-class families.

    Blocked drainage causes stagnant water, which provides site for mosquito breeding, as the survey [36] revealed that malaria remains the foremost public health problem among pregnant women and infants under five (5) years in Nigeria. WHO [37] further approximately estimated that 57 million cases of malaria are reported, and nearly 100,000 malaria-related deaths occur each year. This cost the Federal government 40% of total GDP in prevention, treatment and cost of labours [15,36].

    The presence of LDPE in soil was recently reported to show the most negative effect among other plastic types reducing the growth and quantitative phytochemicals in plants [40,41].

    Recently, the community solid waste, which includes waste polyethylene bags has been utilised in landfilling. All polymers including polyethylene bags decompose very slowly, due to limited availability of oxygen and humidity [8,21].. The product yielded CH4 (methane), H2O and CO2 (carbon dioxide) with biomass. Methane is one of the gasses that cause Greenhouse effect (depletion of ozone layer, thereby allowing the penetration of direct sunlight). Skin cancer and skin diseases are the direct consequence of greenhouse effect. Also, [9] revealed that domestic animals fed on plants from this contaminated soil risk being choked or death.

    Incineration of household solid waste is a common practice in Nigeria, especially, in towns and semi-urban areas where a waste collection system is not functioning or under-functioning

    However, North EJ [21] revealed that incineration of polymeric materials such as polyethylene bags could be harmful to the health and environment, as its residue may consist of chemicals, Volatile Organic Compound (VOCs). These can trigger greenhouse effect, asthma in asthmatic patients, and upset the delicate balance of nervous system.

    Marine pollution is also a major recipient of land plastic bags pollution. Studies had revealed the tendency of waste plastic bags migrating to the sea [7,12]. This has grave consequences on aquatic habitat, also on the consumers of such sea animals. Nigeria is considered the ninth nation with largest plastic waste pollution of marine [7]. Marine waste plastic pollution has been considered as the source of microplastic in rainwater.

    Though, the advent of Polyethylene bags brought about convenience and affordability, however, the health and the environmental impacts of Polyethylene bags outweigh all the benefits [11,15]. While the use of Polyethylene bags cannot be suddenly abhorred, however, there is an urgent need for adequate measures to address the imminent environmental consequence of Polyethylene bags. This measure should be focus on promoting the idea of reducing; reuse and recycling Polyethylene bags. The government at different strata should champion the course of promoting awareness of the implications of Polyethylene bags to the environment.

    Research focussing on the copolymerisation of the natural product with a polymer to make polymer biodegradable should be encouraged through all the institutions and research institutes.

    Also, the Federal Government through the designated policymakers should legislate and regulate the amount of Polyethylene bags produced in the country, this will encourage the habit of 'reduce and reuse' Polyethylene bags in the country. Nigeria government can emulate various measure taking by neighbouring countries (such as Rwanda and Kenya) to eliminate the use of Polyethylene bags and replace with biodegradable ones (such as paper bag).

    The authors unanimously declare that this paper is free from any conflict of interest.



    [1] S. Haykin, Neural Networks and Learning Machines, Prentice Hall, 2011.
    [2] O. I. Abiodun, A. Jantan, A. E. Omolara, K. V. Dada, N. A. Mohamed, H. Arshad, State-of-the-art in artificial neural network applications: A survey, Heliyon, 4 (2018). https://doi.org/10.1016/j.heliyon.2018.e00938
    [3] F. Li, M. Sun, EMLP: Short-term gas load forecasting based on ensemble multilayer perceptron with adaptive weight correction, Math. Biosci. Eng., 18 (2021), 1590–1608. https://doi.org/10.3934/mbe.2021082 doi: 10.3934/mbe.2021082
    [4] A. Rana, A. S. Rawat, A. Bijalwan, H. Bahuguna, Application of multi layer (perceptron) artificial neural network in the diagnosis system: a systematic review, in 2018 International Conference on Research in Intelligent and Computing in Engineering (RICE), (2018), 1–6. https://doi.org/10.1109/RICE.2018.8509069
    [5] L. C. Velasco, J. F. Bongat, C. Castillon, J. Laurente, E. Tabanao, Days-ahead water level forecasting using artificial neural networks for watersheds, Math. Biosci. Eng., 20 (2023), 758–774. https://doi.org/10.3934/mbe.2023035 doi: 10.3934/mbe.2023035
    [6] S. Hochreiter, A. S. Younger, P. R. Conwell, Learning to learn using gradient descent, in Artificial Neural Networks—ICANN 2001: International Conference Vienna, (2001), 87–94. https://doi.org/10.1007/3-540-44668-0_13
    [7] L. M. Saini, M. K. Soni, Artificial neural network-based peak load forecasting using conjugate gradient methods, IEEE Trans. Power Syst., 17 (2002), 907–912. https://doi.org/10.1109/TPWRS.2002.800992 doi: 10.1109/TPWRS.2002.800992
    [8] H. Adeli, A. Samant, An adaptive conjugate gradient neural network-wavelet model for traffic incident detection, Comput. Aided Civil Infrast. Eng., 15 (2000), 251–260. https://doi.org/10.1111/0885-9507.00189 doi: 10.1111/0885-9507.00189
    [9] J. Bilski, B. Kowalczyk, A. Marchlewska, J. M. Zurada, Local Levenberg-Marquardt algorithm for learning feedforwad neural networks, J. Artif. Intell. Soft Comput. Res., 10 (2020), 299–316. https://doi.org/10.2478/jaiscr-2020-0020 doi: 10.2478/jaiscr-2020-0020
    [10] R. Pascanu, T. Mikolov, T. Y. Bengio, On the difficulty of training recurrent neural networks, in International Conference on Machine Learning, (2013), 1310–1318.
    [11] H. Faris, I. Aljarah, S. Mirjalili, Training feedforward neural networks using multi-verse optimizer for binary classification problems, Appl. Intell., 45 (2016), 322–332. https://doi.org/10.1007/s10489-016-0767-1 doi: 10.1007/s10489-016-0767-1
    [12] M. Črepinšek, S. H. Liu, M. Mernik, Exploration and exploitation in evolutionary algorithms: A survey, ACM Comput. Surv., 45 (2013), 1–33. https://doi.org/10.1145/2480741.2480752 doi: 10.1145/2480741.2480752
    [13] G. Xu, An adaptive parameter tuning of particle swarm optimization algorithm, Appl. Math. Comput., 219 (2013), 4560–4569. https://doi.org/10.1016/j.amc.2012.10.067 doi: 10.1016/j.amc.2012.10.067
    [14] S. Mirjalili, S. Z. M. Hashim, H. M. Sardroudi, Training feedforward neural networks using hybrid particle swarm optimization and gravitational search algorithm, Appl. Math. Comput., 218 (2012), 11125–11137. https://doi.org/10.1016/j.amc.2012.04.069 doi: 10.1016/j.amc.2012.04.069
    [15] X. S. Yang, Random walks and optimization, in Nature Inspired Optimization Algorithms, Elsevier, (2014), 45–65. https://doi.org/10.1016/B978-0-12-416743-8.00003-8
    [16] M. Ghasemi, S. Ghavidel, S. Rahmani, A. Roosta, H. Falah, A novel hybrid algorithm of imperialist competitive algorithm and teaching learning algorithm for optimal power flow problem with non-smooth cost functions, Eng. Appl. Artif. Intell., 29 (2014), 54–69. https://doi.org/10.1016/j.engappai.2013.11.003 doi: 10.1016/j.engappai.2013.11.003
    [17] S. Pothiya, I. Ngamroo, W. Kongprawechnon, Ant colony optimisation for economic dispatch problem with non-smooth cost functions, Int. J. Electr. Power Energy Syst., 32 (2010), 478–487. https://doi.org/10.1016/j.ijepes.2009.09.016 doi: 10.1016/j.ijepes.2009.09.016
    [18] M. M. Fouad, A. I. El-Desouky, R. Al-Hajj, E. S. M. El-Kenawy, Dynamic group-based cooperative optimization algorithm, IEEE Access, 8 (2020), 148378–148403. https://doi.org/10.1109/ACCESS.2020.3015892 doi: 10.1109/ACCESS.2020.3015892
    [19] S. Mirjalili, S. M. Mirjalili, A. Lewis, Grey wolf optimizer, Adv. Eng. Software, 69 (2014), 46–61. https://doi.org/10.1016/j.advengsoft.2013.12.007 doi: 10.1016/j.advengsoft.2013.12.007
    [20] F. Van den Bergh, A. P. Engelbrecht, A cooperative approach to particle swarm optimization, IEEE Trans. Evol. Comput., 8 (2004), 225–239. https://doi.org/10.1109/TEVC.2004.826069 doi: 10.1109/TEVC.2004.826069
    [21] C. K. Goh, K. C. Tan, A competitive-cooperative co-evolutionary paradigm for dynamic multi-objective optimization, IEEE Trans. Evol. Comput., 13 (2008), 103–127. https://doi.org/10.1109/TEVC.2008.920671 doi: 10.1109/TEVC.2008.920671
    [22] J. H. Holland, Adaptation in Natural and Artificial Systems, MIT Press, Cambridge, 1992. https://doi.org/10.7551/mitpress/1090.001.0001
    [23] D. E. Goldberg, Genetic Algorithms in Search Optimization and Machine Learning, Addison-Wesley, 1989.
    [24] EK Burke, EK Burke, G Kendall, G Kendall, Search Methodologies: Introductory Tutorials in Optimization and Decision Support Techniques, Springer, 2014. https://doi.org/10.1007/978-1-4614-6940-7
    [25] U. Seiffert, Multiple layer perceptron training using genetic algorithms, in Proceedings of the European Symposium on Artificial Neural Networks, (2001), 159–164.
    [26] F. Ecer, S. Ardabili, S. S. Band, A. Mosavi, Training multilayer perceptron with genetic algorithms and particle swarm optimization for modeling stock price index prediction, 22 (2020), Entropy, 1239. https://doi.org/10.3390/e22111239
    [27] C. Zanchettin, T. B. Ludermir, L. M. Almeida, Hybrid training method for MLP: Optimization of architecture and training, IEEE Trans. Syst. Man Cyber. Part B, 41 (2011), 1097–1109. https://doi.org/10.1109/TSMCB.2011.2107035 doi: 10.1109/TSMCB.2011.2107035
    [28] H. Wang, H. Moayedi, L. Kok Foong, Genetic algorithm hybridized with multilayer perceptron to have an economical slope stability design, Eng. Comput., 37 (2021), 3067–3078. https://doi.org/10.1007/s00366-020-00957-5 doi: 10.1007/s00366-020-00957-5
    [29] C. C. Ribeiro, P. Hansen, V. Maniezzo, A. Carbonaro, Ant colony optimization: An overview, Essay Sur. Metaheuristics, 2002 (2002), 469–492. https://doi.org/10.1007/978-1-4615-1507-4_21 doi: 10.1007/978-1-4615-1507-4_21
    [30] M. Dorigo, T. Stützle, Ant Colony Optimization: Overview and Recent Advances, Springer International Publishing, (2019), 311–351. https://doi.org/10.1007/978-3-319-91086-4_10
    [31] D. Karaboga, B. Gorkemli, C. Ozturk, N. Karaboga, A comprehensive survey: Artificial bee colony (ABC) algorithm and applications, Artif. Intell. Revi., 42 (2014), 21–57. https://doi.org/10.1007/s10462-012-9328-0 doi: 10.1007/s10462-012-9328-0
    [32] B. A. Garro, R. A. Vázquez, Designing artificial neural networks using particle swarm optimization algorithms, Comput. Intell. Neurosci., 2015 (2015), 61. https://doi.org/10.1155/2015/369298 doi: 10.1155/2015/369298
    [33] I. Vilovic, N. Burum, Z. Sipus, Ant colony approach in optimization of base station position, in 2009 3rd European Conference on Antennas and Propagation, (2009), 2882–2886.
    [34] K. Socha, C. Blum, An ant colony optimization algorithm for continuous optimization: Application to feed-forward neural network training, Neural Comput. Appl., 16 (2007), 235–247. https://doi.org/10.1007/s00521-007-0084-z doi: 10.1007/s00521-007-0084-z
    [35] M. Mavrovouniotis, S. Yang, Training neural networks with ant colony optimization algorithms for pattern classification, Soft Comput., 19 (2015), 1511–1522. https://doi.org/10.1007/s00500-014-1334-5 doi: 10.1007/s00500-014-1334-5
    [36] C. Ozturk, D. Karaboga, Hybrid artificial bee colony algorithm for neural network training, in 2011 IEEE Congress of Evolutionary Computation (CEC), (2011), 84–88. https://doi.org/10.1109/CEC.2011.5949602
    [37] R. Storn, K. Price, Differential evolution–a simple and efficient heuristic for global optimization over continuous spaces, J. Global Optimization, 11 (1997), 341–359. https://doi.org/10.1023/A:1008202821328 doi: 10.1023/A:1008202821328
    [38] N. Bacanin, K. Alhazmi, M. Zivkovic, K. Venkatachalam, T. Bezdan, J. Nebhen, Training multi-layer perceptron with enhanced brain storm optimization metaheuristics, Comput. Mater. Contin, 70 (2022), 4199–4215. https://doi.org/10.32604/cmc.2022.020449 doi: 10.32604/cmc.2022.020449
    [39] J. Ilonen, J. K. Kamarainen, J. Lampinen, Differential evolution training algorithm for feed-forward neural networks, Neural Process. Lett., 17 (2003), 93–105. https://doi.org/10.1023/A:1022995128597 doi: 10.1023/A:1022995128597
    [40] A. Slowik, M. Bialko, Training of artificial neural networks using differential evolution algorithm, in 2008 Conference on Human System Interactions, (2008), 60–65. https://doi.org/10.1109/HSI.2008.4581409
    [41] A. A. Bataineh, D. Kaur, S. M. J. Jalali, Multi-layer perceptron training optimization using nature inspired computing, IEEE Access, 10 (2022), 36963–36977. https://doi.org/10.1109/ACCESS.2022.3164669 doi: 10.1109/ACCESS.2022.3164669
    [42] K. N. Dehghan, S. R. Mohammadpour, S. H. A. Rahamti, US natural gas consumption analysis via a smart time series approach based on multilayer perceptron ANN tuned by metaheuristic algorithms, in Handbook of Smart Energy Systems, Springer International Publishing, (2023), 1–13. https://doi.org/10.1007/978-3-030-72322-4_137-1
    [43] A. Alimoradi, H. Hajkarimian, H. H. Ahooi, M. Salsabili, Comparison between the performance of four metaheuristic algorithms in training a multilayer perceptron machine for gold grade estimation, Int. J. Min. Geo-Eng., 56 (2022), 97–105. https://doi.org/10.22059/ijmge.2021.314154.594880 doi: 10.22059/ijmge.2021.314154.594880
    [44] K. Bandurski, W. Kwedlo, A Lamarckian hybrid of differential evolution and conjugate gradients for neural network training, Neural Process. Lett., 32 (2010), 31–44. https://doi.org/10.1007/s11063-010-9141-1 doi: 10.1007/s11063-010-9141-1
    [45] B. Warsito, A. Prahutama, H. Yasin, S. Sumiyati, Hybrid particle swarm and conjugate gradient optimization in neural network for prediction of suspended particulate matter, in E3S Web of Conferences, (2019), 25007. https://doi.org/10.1051/e3sconf/201912525007
    [46] A. Cuk, T. Bezdan, N. Bacanin, M. Zivkovic, K. Venkatachalam, T. A. Rashid, et al., Feedforward multi-layer perceptron training by hybridized method between genetic algorithm and artificial bee colony, Data Sci. Data Anal. Oppor. Challenges, 2021 (2021), 279. https://doi.org/10.1201/9781003111290-17-21 doi: 10.1201/9781003111290-17-21
    [47] UC Irvine Machine Learning Repository. Available form: http://archive.ics.uci.edu/ml/
    [48] Kaggel Database. Available form: https://www.kaggle.com/datasets/
    [49] F. Pedregosa, G. Varoquaux, A. Gramfort, V. Michel, B. Thirion, O. Grisel, et al., Scikit-learn: Machine learning in Python, J. Mach. Learn. Res., 12 (2011), 2825–2830.
    [50] F. Dick, H. Tevaearai, Significance and limitations of the p value, Eur. J. Vasc. Endovascular Surg., 50 (2015), 815. https://doi.org/10.1016/j.ejvs.2015.07.026 doi: 10.1016/j.ejvs.2015.07.026
  • This article has been cited by:

    1. M. Baira, A. Bekhti Siad, S. Messekine, Electronic, optical and transport properties of perovskite compounds ARhO3 (A = Bi, Lu): A first principle investigations, 2021, 603, 09214526, 412588, 10.1016/j.physb.2020.412588
    2. D S Jayalakshmi, T Hrisheekesan, G Akshaya, D Hemanand, W T Chembian, P Arun Prakash, Computational Investigation of Optical, Thermal and Thermoelectric Properties of Cs3P compound, 2021, 1979, 1742-6588, 012055, 10.1088/1742-6596/1979/1/012055
    3. Zakaryaa Zarhri, Andres Dominguez Cano, Outmane Oubram, Younes Ziat, Ali Bassam, Optical measurements and Burstein Moss effect in optical properties of Nb-doped BaSnO3 perovskite, 2022, 166, 27730123, 207223, 10.1016/j.micrna.2022.207223
  • Reader Comments
  • © 2024 the Author(s), licensee AIMS Press. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0)
通讯作者: 陈斌, bchen63@163.com
  • 1. 

    沈阳化工大学材料科学与工程学院 沈阳 110142

  1. 本站搜索
  2. 百度学术搜索
  3. 万方数据库搜索
  4. CNKI搜索

Metrics

Article views(1614) PDF downloads(44) Cited by(1)

Figures and Tables

Figures(6)  /  Tables(6)

Other Articles By Authors

/

DownLoad:  Full-Size Img  PowerPoint
Return
Return

Catalog