Cognitive green computing (CGC) dedicates to study the designing, manufacturing, using and disposing of computers, servers and associated subsystems with minimal environmental damage. These solutions should provide efficient mechanisms for maximizing the efficiency of use of computing resources. Evolutionary algorithm (EA) is a well-known global search algorithm, which has been successfully used to solve various complex optimization problems. However, a run of population-based EA often requires huge memory consumption, which limited their applications in the memory-limited hardware. To overcome this drawback, in this work, we propose a compact EA (CEA) for the sake of CGC, whose compact encoding and evolving mechanism is able to significantly reduce the memory consumption. After that, we use it to address the ternary compound ontology matching problem. Six testing cases that consist of nine ontologies are used to test CEA's performance, and the experimental results show its effectiveness.
Jian Zhang, Yan Zhang, Cong Wang, Huilong Yu, Cui Qin .
Binocular stereo matching algorithm based on MST cost aggregation. Mathematical Biosciences and Engineering, 2021, 18(4): 3215-3226.
doi: 10.3934/mbe.2021160
[4]
Yanmei Jiang, Mingsheng Liu, Jianhua Li, Jingyi Zhang .
Reinforced MCTS for non-intrusive online load identification based on cognitive green computing in smart grid. Mathematical Biosciences and Engineering, 2022, 19(11): 11595-11627.
doi: 10.3934/mbe.2022540
[5]
Guohui Zhang, Gulbahar Tohti, Ping Chen, Mamtimin Geni, Yixuan Fan .
SFEMM: A cotton binocular matching method based on YOLOv7x. Mathematical Biosciences and Engineering, 2024, 21(3): 3618-3630.
doi: 10.3934/mbe.2024159
[6]
Yanpei Liu, Yunjing Zhu, Yanru Bin, Ningning Chen .
Resources allocation optimization algorithm based on the comprehensive utility in edge computing applications. Mathematical Biosciences and Engineering, 2022, 19(9): 9147-9167.
doi: 10.3934/mbe.2022425
[7]
Andrea Guazzini, Enrico Imbimbo, Federica Stefanelli, Franco Bagnoli, Ezio Venturino .
Quantifying fairness to overcome selfishness: A behavioural model to describe the evolution and stabilization of inter-group bias using the Ultimatum Game. Mathematical Biosciences and Engineering, 2019, 16(5): 3718-3733.
doi: 10.3934/mbe.2019184
[8]
Ning He, Hongmei Jin, Hong'an Li, Zhanli Li .
A global optimization generation method of stitching dental panorama with anti-perspective transformation. Mathematical Biosciences and Engineering, 2023, 20(9): 17356-17383.
doi: 10.3934/mbe.2023772
[9]
Yan Liu, Bingxue Lv, Yuheng Wang, Wei Huang .
An end-to-end stereo matching algorithm based on improved convolutional neural network. Mathematical Biosciences and Engineering, 2020, 17(6): 7787-7803.
doi: 10.3934/mbe.2020396
[10]
Tinghuai Ma, Lei Guo, Xin Wang, Yurong Qian, Yuan Tian, Najla Al-Nabhan .
Friend closeness based user matching cross social networks. Mathematical Biosciences and Engineering, 2021, 18(4): 4264-4292.
doi: 10.3934/mbe.2021214
Abstract
Cognitive green computing (CGC) dedicates to study the designing, manufacturing, using and disposing of computers, servers and associated subsystems with minimal environmental damage. These solutions should provide efficient mechanisms for maximizing the efficiency of use of computing resources. Evolutionary algorithm (EA) is a well-known global search algorithm, which has been successfully used to solve various complex optimization problems. However, a run of population-based EA often requires huge memory consumption, which limited their applications in the memory-limited hardware. To overcome this drawback, in this work, we propose a compact EA (CEA) for the sake of CGC, whose compact encoding and evolving mechanism is able to significantly reduce the memory consumption. After that, we use it to address the ternary compound ontology matching problem. Six testing cases that consist of nine ontologies are used to test CEA's performance, and the experimental results show its effectiveness.
1.
Introduction
Cognitive green computing (CGC) amalgams the properties of cognitive computing [1] and green computing [2] to deal with such challenging issues like, energy optimization, carbon emission, resource utilization intelligently. In particular, CGC aims at providing efficient mechanisms for the tasks such as maximizing the efficiency of use of computing resources [3]. Evolutionary algorithm (EA) [4] is a well-known global search algorithm, which has been successfully used to solve various complex optimization problems. EA heuristically explores the decision space by maintaining a population which might contain hundreds of chromosomes. Thus, a run of population-based EA often requires huge memory consumption, which limited their applications in the memory-limited hardware, e.g., mobile systems, industrial robots, etc. To overcome this drawback, in this work, we propose a Compact EA (CEA) [5] for the sake of CGC, and use it to address the ternary compound ontology matching problem. CEA uses a Probability Array (PA) to represent a population and execute the evolutionary operations, which is able to reduce the algorithm's memory consumption and searching performance.
Ontology is a cutting-edge knowledge modeling technique, which has been widely used to model various domain knowledge. It is impractical to develop and maintain a top-level ontology that is able to meet all the requirements of different applications, and thus, various domain ontologies are developed independently for different purposes [6]. Although they own significant overlapped information, a concept could be described with different granularity, yielding the ontology heterogeneity problem. For instance, describing a patient's record may include using SNOMED-CT for clinical methods employed, LOINC for laboratory analyses and results, ICD-10 for diagnoses and ATC for coding any prescribed antibiotics. Matching ontologies is able to determine semantically identical concepts among heterogenous ontologies, which is a feasible approach to integrate the knowledge in different ontologies. Traditionally, matching ontologies is the procedure that takes input two ontologies, and returns the concept mappings between two ontologies. However, if multiple ontologies are necessary to accurately describe the information and knowledge, to allow their communications, there is a need to establish links among multiple ontologies. This need motivates a new type of complex ontology matching, i.e., compound ontology matching [7], which involves more than two ontologies. A common case of the compound matching is the ternary compound matching, where two concepts from two distinct ontologies are mapped with a concept from the third ontology. For instance, the concept "broad forehead" in the human phenotype ontology (HP) is equivalent to the union of the concept "increased width" in phenotypic quality ontology (PATO) and the concept "forehead" in the foundation model of anatomy (FMA) ontology, i.e., "broad forehead" "increased width" "forehead".
Since 2018, ontology alignment evaluation initiative (OAEI)* has presented the complex track that evaluates the matching techniques which generate complex correspondences. But there is still no testing case on the compound ontology matching problem, and currently, there are only two compound ontology matching techniques that are proposed by Pesquita and Oliveira [7,8]. The former first determines the anchors, i.e., highly similar concept pairs, in two ontologies, and then match them to the third ontology. On the basis of the first work, Oliveira et al. further makes use of agreement maker light (AML) to built for the word matcher, and a weighted Jaccard index to aggregate the similarity values, whose computational complexity is large. Moreover, the completeness and accuracy of the determined compound ontology alignments are not high. Being inspired by the success of EA in the ontology matching domain [9,10,11,12,13], this work proposes to make use of EA to address the ternary compound ontology matching problem. However, population-based EA suffers from significant computational complexity, which hampers their application in the real matching tasks. To maximize the utilization of computer hardware and improve the algorithm's efficiency, this work first construct an optimal model for the ternary compound ontology matching problem, and then presents a concept similarity measure to calculate the confidence of a ternary compound correspondence, finally, a CEA with compact encoding and evolving mechanism is proposed to efficiently address this problem.
The rest of the paper is organized as follows: section 2 defines the ternary compound ontology matching problem and the concept similarity measure; section 4 describes the problem-specific CEA in details; section 5 shows the experimental results; and finally, section 6 draws the conclusion.
2.
Ternary compound ontology matching problem
There are many definitions on the Ontology, and in this work, for the convenience, an ontology is defined as a 5-tuple , where is the concept set, and are respectively the sets of inner property and outer property, is the set of instance, and is the set of axiom [14,15]. In particular, an inner property (or datatype property) describes a concept's individual feature, while an outer property (or object property) describes its relationships with other concepts. A ternary correspondence is also a 3-tuple , where , and are respectively the concepts of the first, second and third ontologies, is the relationship of equivalence, i.e., , and is the confidence or similarity value of this correspondence. The ternary compound matching process takes as input three ontologies and an external background knowledge base (e.g., unified medical language system (UMLS) [16]), and outputs a set of ternary compound correspondences, i.e., the ternary compound ontology alignment.
The traditional evaluation metrics work on the basis of the reference alignment provided by the expert. However, the reference alignment is not always available especially when the entity scale is huge. To overcome this drawback, we propose an approximate metric, which is based on the observation that the more ternary compound alignment correspondences found, the higher probability that it contains more correct correspondences, i.e., the alignment's completeness would be higher; and similarly, the higher mean similarity value of all the correspondences in an alignment, the higher probability that it contains less incorrect correspondences, i.e., the alignment's accuracy would be higher [17]. In particular, the approximate metric for evaluating a ternary compound ontology alignment's quality is defined as follows:
(2.1)
where , are respectively the cardinalities of the alignment and the th ontology's concept set, is the confidence value of the th correspondence. Here, measures how many ternary compound alignment correspondences are found, calculates the average similarity measure, and function takes both of them into consideration.
On this basis, the mathematical model of ternary compound ontology matching problem can be defined as follows:
(2.2)
where is the cardinality of the th ontology's concept set, and represents the th correspondence. In particular, (or ) means the th concept in the first ontology is mapped to none in the second (or third) ontology.
3.
Concept similarity measure
Concept similarity measure (CSM) is a function measuring to what extent the concepts in a correspondence are similar, and its effectiveness directly affects the alignment's quality [18]. Essentially, CSM used in this work borrows the idea from Oliveira et al. [7], but we more focus on the concept's lexical and linguistic features, which are the most commonly used information in the ontology matching domain [19]. Given three concepts , and , and their labels as , and , we first pre-process these labels by: (1) remove their numbers, punctuations and stop-words; (2) split the labels into words and convert them into lower-case; (3) lemmatizing and stemming the English words. Then, we get the corresponding word set , and , which are used to calculate , and 's similarity value in two sequential steps. First, we calculate the similarity of , as follows:
(3.1)
where . Here, for each word in , say , we find its most similar word in , say , and calculate their similarity value . After that, we sum all the similarity values with respect to the words in , and divide it by the cardinality of to obtain two concepts' similarity value. In particular, is defined as follows:
(3.2)
where UMLS is first used to determine whether two words and are synonymous terms, and if not, will be used to calculate the lexical similarity with N-gram distance [20]. If , similarity value among , and is set as 0; otherwise, we reduce by removing all the words that have already been matched with to get . After that, , and 's similarity value is determined by the . In particular, the threshold for is set as 0.8, which is referred to the configurations in Oliveira et al. [7].
4.
Compact evolutionary algorithm
This work presents a problem-specific CEA, and use it to solve the ternary compound ontology matching problem. CEA uses the binary encoding mechanism, i.e., Gray code, to encode the ternary compound correspondences in a solution. Supposing , and are respectively the number of concepts in three ontologies, the length of a chromosome is . The -th gene bit consists of two parts of information, one for the index of the first target concept and the other for the second. When decoding, the -th source concept is mapped with these two target concepts.
A PA is used to represent a population and execute the evolving process. In particular, the length of a PA is equal to that of a chromosome, where each element inside is the probability of being one with respect to the corresponding gene bit. Here is an example of generating a new solution through PA . First, generate four random numbers, such as 0.4, 0.5, 0.8 and 0.1. Then compare the numbers with the elements in PA accordingly to determine the new generated individual's gene values, e.g., since , the first gene bit's value of the new solution is 0, and similarly, the remaining gene bits' values are 1, 0 and 1, respectively. In this way, the new solution we obtain is 0101. By repeating this procedure, we can obtain various individuals. In each generation, PA is updated to move towards the best solution found so far, which is implemented by increasing the elements' values in PA when the best solution's corresponding element's value is 1, and decreasing the values when 0. Given the , if the gene value of the elite is 1 (or 0), the corresponding element of PA will increase (or decrease) by , and the updated PA is . When PA's elements are all approach 1 or 0, CEA converges, and thus, the step length affects the algorithm's searching performance. When the step length is large, the algorithm will converge quicker but tends to get stuck in the local optima; and when it is too small, the algorithm's learning ability is lower, which makes it converges slower. This work set the step length is by referring to Sudholt et al. [21]. Given the length of a chromosome (or PA) , the step length for updating PA and the maximum generation for CEA , the pseudo-code of CEA is shown in Algorithm 1.
Algorithm 1 Compact evolutionary algorithm
*******Initialization********** fordo ;
end for generate a solution through PA and set it as ;
;
*******Evolving Process ********** whiledo generate a solution through PA;
[, ]=; ifthen ; end if *******Update PA ******* fordo ifthen ; else ; end if end for fordo ifthen ;
end if ifthen ; end if end for ; end while
5.
Experiment
5.1. Experimental configuration
To test the performance of CEA, we use six testing cases that consists of nine ontologies, which are suggested by Oliveira et al. [7]. Table 1 shows a brief descriptions on these ontologies. We denote a testing case with the pattern "source ontology-the first target ontology-the second target ontology", e.g., "MP-CL-PATO".
Table 1.
Description on nine biomedical ontologies.
The alignment's quality are evaluated with the traditional recall, precision and f-measure [31], which are defined as follows:
(5.1)
(5.2)
(5.3)
where and are respectively the cardinalities of the alignment and reference alignment . In particular, recall and precision respectively measure the coverage of correct correspondences by referring to and , and f-measure is their harmonic mean value. The experiment is carried out with an Intel Core i9-8950HK CPU @ 2.90GHz x 12 and 25GB allocated RAM.
5.2. Comparison on alignment's quality and matching efficiency
First, we compare CEA with EA based matching technique [32], Memetic algorithm (MA) based matching technique [33], Differential Evolution Algorithm (DE) based matching technique [34], whose configurations are referred to their literatures. Table 2 shows their mean f-measure and standard deviation of the alignments obtained by EA based matching techniques, and Table 3 presents the T-Test statistical analysis [35] of the values in Table 2. The results of all the meta-heuristics based matching techniques are the mean value of 30 independent runs.
Table 2.
Comparison with meta-heuristics based matching techniques in terms of alignment's quality. and stand for f-measure and standard deviation, respectively.
In our experiment, a level of significance is chosen. Data analysis of Tables 2 and 3 depicts that CEA statistically outperforms other meta-heuristics based matching techniques on f-measure at 5% significance level. In addition, CEA does not need to tune any parameters except for the maximum generation 3000, which makes it more stable than other meta-heuristics based matching techniques.
Tables 4 compares CEA with two state-of-the-art ternary compound ontology matching techniques, i.e., AML based matching techniques with top-one ranked selector and top-two ranked selector [7], in terms of recall, precision and f-measure. As shown in Table 4, CEA's recall outperforms the other two competitors in all testing cases, which show that the compact evolving mechanism is able to effectively search in large searching space. Next, CEA's precision values also rank the first in all matching tasks, which show the proposed similarity measure's effectiveness. Finally, the f-measure of CEA based matching technique show that it is able to effectively optimize the alignment's quality.
Table 4.
Comparison with state-of-the-art ternary compound ontology matching techniques.
From Table 5, we can see that, in all testing cases, CEA dramatically improves EA's memory consumption and runtime per generation. Specifically, the highest improvement degree is on average by 82.95% and 80.93%, respectively. These gains are due to that CEA introduces the compact encoding mechanism, which is able to significantly save the memory consumption, and the simplified evolving mechanism, which is able to improve the algorithm's runtime per generation. To conclude, CEA is able to improve the quality of ternary compound ontology alignment, and significantly reduce the memory consumption and runtime per generation.
Table 5.
Comparison of the memory (MegaByte) consumed per generation.
Testing Case
EA
MA
DE
CEA
Comparison of the memory (MegaByte) consumed per generation
MP-CL-PATO
524.30
1,027.72
490.26
115.21
MP-GO-PATO
547.75
1,109.44
583.90
145.32
MP-NBO-PATO
384.20
710.32
272.46
94.41
MP-UBERON-PATO
924.32
1,420.97
918.16
382.54
WBP-GO-PATO
640.22
1,302.61
712.32
217.25
HP-FMA-PATO
1,350.21
2,558.98
1,254.13
433.57
Average
728.50
1,355.01
705.20
231.38
Comparison on the runtime (second) taken per generation
For the sake of the cognitive green computing, this work proposes a CEA to efficiently address the ternary compound ontology matching problem, which is able to bridge the sematic gap among three heterogeneous ontologies. In particular, we use the compact encoding and evolving mechanisms to reduce the algorithm's memory consumption and runtime when searching for the global optima. We construct an optimal model for the problem, and present a concept similarity measure to calculate a ternary compound correspondence's similarity value. The experimental results show that CEA-based matching technique is able to efficiently determine ternary compound ontology alignments.
When facing a very large-scale matching task, e.g., an ontology owns tens of thousands of concepts, a pre-screening method should be introduced. In the future, we will be interested in partitioning the ontologies into several semantic segments, which is of help to reduce the search space of CEA. In addition, a parallel matching mechanism would be of help to further improve the matching efficiency.
Acknowledgments
This work is supported by the National Key Research and Development Program of China (No. 11974373) and Natural Science Foundation of Fujian Province (No. 2020J01875).
Conflict of interest
All authors declare no conflicts of interest in this paper.
References
[1]
D. S. Modha, R. Ananthanarayanan, S. K. Esser, A. Ndirango, A. J. Sherbondy, R. Singh, Cognitive computing, Commun. ACM, 54 (2011), 62–71.
[2]
P. Kurp, Green computing, Commun. ACM, 51 (2008), 11–13.
[3]
M. Chen, F. Herrera, K. Hwang, Cognitive computing: architecture, technologies and intelligent applications, IEEE Access, 6 (2018), 19774–19783. doi: 10.1109/ACCESS.2018.2791469
[4]
S. Mirjalili, Genetic algorithm, in Evolutionary Algorithms and Neural Networks, Springer, 2019.
[5]
G. R. Harik, F. G. Lobo, D. E. Goldberg, The compact genetic algorithm, IEEE Trans. Evol. Comput., 3 (1999), 287–297. doi: 10.1109/4235.797971
[6]
N. Pour, A. Algergawy, R. Amini, D. Faria, I. Fundulaki, I. Harrow, et al., Results of the ontology alignment evaluation initiative 2020, Proceedings of the 15th International Workshop on Ontology Matching (OM 2020), 2020.
[7]
D. Oliveira, C. Pesquita, Improving the interoperability of biomedical ontologies with compound alignments, J. Biomed. Semantics, 9 (2018), 1–13. doi: 10.1186/s13326-017-0171-8
[8]
C. Pesquita, M. Cheatham, D. Faria, J. Barros, E. Santos, F. M. Couto, Building reference alignments for compound matching of multiple ontologies using obo cross-products, in OM, (2014), 172–173.
[9]
G. Acampora, U. Kaymak, V. Loia, A. Vitiello, Applying nsga-ii for solving the ontology alignment problem, in 2013 IEEE International Conference on Systems, Man, and Cybernetics, IEEE, (2013), 1098–1103.
[10]
X. Xue, Y. Wang, Optimizing ontology alignments through a memetic algorithm using both matchfmeasure and unanimous improvement ratio, Artif. Intell., 223 (2015), 65–81. doi: 10.1016/j.artint.2015.03.001
[11]
M. Shamsfard, B. Helli, S. Babalou, Omega: Ontology matching enhanced by genetic algorithm. in 2016 Second International Conference on Web Research (ICWR), IEEE, (2016), 170–176.
[12]
Q. Lv, C. Jiang, H. Li, Solving ontology meta-matching problem through an evolutionary algorithm with approximate evaluation indicators and adaptive selection pressure, IEEE Access, 2020 (2020), 3046–3064.
[13]
N. Ferranti, S. S. R. F. Soares, J. F. de Souza, Metaheuristics-based ontology meta-matching approaches, Expert Syst. Appl., 173 (2021), 114578. doi: 10.1016/j.eswa.2021.114578
[14]
G. Acampora, V. Loia, A. Vitiello, Enhancing ontology alignment through a memetic aggregation of similarity measures, Inf. Sci., 250 (2013), 1–20. doi: 10.1016/j.ins.2013.06.052
[15]
X. Xue, Y. Wang, Using memetic algorithm for instance coreference resolution, IEEE Trans. Knowl. Data Eng., 28 (2015), 580–591.
[16]
O. Bodenreider, The unified medical language system (umls): integrating biomedical terminology, Nucleic Acids Res., 32 (2004), D267–D270. doi: 10.1093/nar/gkh061
[17]
X. Xue, J. S. Pan, An overview on evolutionary algorithm based ontology matching, J. Inf. Hiding Multimed. Signal Proc., 9 (2018), 75–88.
[18]
X. Xue, J. Zhang, Matching large-scale biomedical ontologies with central concept based partitioning algorithm and adaptive compact evolutionary algorithm, Appl. Soft Comput., 106 (2021), 107343. doi: 10.1016/j.asoc.2021.107343
[19]
I. Mott, Investigating semantic similarity for biomedical ontology alignment. Ph.D thesis, Universida De DeLisboa, 2017.
[20]
G. Kondrak, N-gram similarity and distance, in International symposium on string processing and information retrieval, Springer, 2005,115–126.
[21]
D. Sudholt, C. Witt, Update strength in edas and aco: How to avoid genetic drift, in Proceedings of the Genetic and Evolutionary Computation Conference 2016, 2016.
[22]
P. N. Robinson, S. Köhler, S. Bauer, D. Seelow, D. Horn, S. Mundlos, The human phenotype ontology: a tool for annotating and analyzing human hereditary disease, Am. J. Hum. Genet., 83 (2008), 610–615. doi: 10.1016/j.ajhg.2008.09.017
[23]
C. L. Smith, C. A. W. Goldsmith, J. T. Eppig, The mammalian phenotype ontology as a tool for annotating, analyzing and comparing phenotypic information, Genome Biol., 6 (2005), R7. doi: 10.1186/gb-2005-6-5-p7
[24]
G. V. Gkoutos, P. N. Schofield, R. Hoehndorf, The neurobehavior ontology: an ontology for annotation and integration of behavior and behavioral phenotypes, in Int. Rev. Neurobiol., 103 (2012), 69–87.
[25]
G. Schindelman, J. S. Fernandes, C. A. Bastiani, K. Yook, P. W Sternberg, Worm phenotype ontology: integrating phenotype data within and beyond the c. elegans community, BMC Bioinformatics, 12 (2011), 32. doi: 10.1186/1471-2105-12-32
[26]
G. V. Gkoutos, E. C. J. Green, A. M. Mallon, J. M. Hancock, D. Davidson, Using ontologies to describe mouse phenotypes, Genome Biol., 6 (2005), R8. doi: 10.1186/gb-2005-6-5-p8
[27]
J. Bard, S. Y. Rhee, M. Ashburner, An ontology for cell types, Genome Biol., 6 (2005), R21. doi: 10.1186/gb-2005-6-2-r21
[28]
C. Rosse, J. L. V. Mejino Jr, A reference ontology for biomedical informatics: the foundational model of anatomy, J. Biomed. Inf., 6 (2003), 478–500.
[29]
Gene Ontology Consortium, The gene ontology (go) database and informatics resource, Nucleic Acids Res., 32 (2004), D258–D261. doi: 10.1093/nar/gkh036
[30]
C. J. Mungall, C. Torniai, G. V. Gkoutos, S. E. Lewis, M. A. Haendel, Uberon, an integrative multi-species anatomy ontology, Genome Biol., 13 (2012), R5. doi: 10.1186/gb-2012-13-1-r5
[31]
C. J. Van Rijsbergen, Foundation of evaluation, J. Doc., 30 (1974), 365–373. doi: 10.1108/eb026584
[32]
J. M. V. Naya, M. M. Romero, J. P. Loureiro, C. R. Munteanu, A. P. Sierra, Improving ontology alignment through genetic algorithms, in Soft computing methods for practical environment solutions: Techniques and studies, (2010), 240–259.
[33]
G. Acampora, P. Avella, V. Loia, S. Salerno, A. Vitiello, Improving ontology alignment through memetic algorithms, in 2011 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE 2011), IEEE, (2011), 1783–1790.
[34]
X. Xue, J. Chen, Matching biomedical ontologies through compact differential evolution algorithm with compact adaption schemes on control parameters, Neurocomputing, 2020 (2020), 1–9.
[35]
L. Schmetterer, E. L. Lehmann, Testing statistical hypotheses, Econometrica, 30 (1962), 462–465.
This article has been cited by:
1.
Yanmei Jiang, Mingsheng Liu, Jianhua Li, Jingyi Zhang,
Reinforced MCTS for non-intrusive online load identification based on cognitive green computing in smart grid,
2022,
19,
1551-0018,
11595,
10.3934/mbe.2022540
Table 2.
Comparison with meta-heuristics based matching techniques in terms of alignment's quality. and stand for f-measure and standard deviation, respectively.