To assure operational safety in the airport apron area and track the process of ground service, it is necessary to analyze key targets and their activities in the airport apron surveillance videos. This research shows an activity identification algorithm for ground service objects in an airport apron area and proposes an improved YOLOv5 algorithm to increase the precision of small object detection by introducing an SPD-Conv (spath-to-depth-Conv) block in YOLOv5's backbone layer. The improved algorithm can efficiently extract the information features of small-sized objects, medium-sized objects, and moving objects in large scenes, and it achieves effective detection of activities of ground service in the apron area. The experimental results show that the detection average precision of all objects is more than 90%, and the whole class mean average precision (mAP) is 98.7%. At the same time, the original model was converted to TensorRT and OpenVINO format models, which increased the inference efficiency of the GPU and CPU by 55.3 and 137.1%, respectively.
Citation: Yaxi Xu, Yi Liu, Ke Shi, Xin Wang, Yi Li, Jizong Chen. An airport apron ground service surveillance algorithm based on improved YOLO network[J]. Electronic Research Archive, 2024, 32(5): 3569-3587. doi: 10.3934/era.2024164
Related Papers:
[1]
Jun Gao, Qian Jiang, Bo Zhou, Daozheng Chen .
Convolutional neural networks for computer-aided detection or diagnosis in medical image analysis: An overview. Mathematical Biosciences and Engineering, 2019, 16(6): 6536-6561.
doi: 10.3934/mbe.2019326
[2]
Haiyan Song, Cuihong Liu, Shengnan Li, Peixiao Zhang .
TS-GCN: A novel tumor segmentation method integrating transformer and GCN. Mathematical Biosciences and Engineering, 2023, 20(10): 18173-18190.
doi: 10.3934/mbe.2023807
[3]
Tongping Shen, Fangliang Huang, Xusong Zhang .
CT medical image segmentation algorithm based on deep learning technology. Mathematical Biosciences and Engineering, 2023, 20(6): 10954-10976.
doi: 10.3934/mbe.2023485
[4]
Jinyun Jiang, Jianchen Cai, Qile Zhang, Kun Lan, Xiaoliang Jiang, Jun Wu .
Group theoretic particle swarm optimization for gray-level medical image enhancement. Mathematical Biosciences and Engineering, 2023, 20(6): 10479-10494.
doi: 10.3934/mbe.2023462
[5]
Tong Shan, Jiayong Yan, Xiaoyao Cui, Lijian Xie .
DSCA-Net: A depthwise separable convolutional neural network with attention mechanism for medical image segmentation. Mathematical Biosciences and Engineering, 2023, 20(1): 365-382.
doi: 10.3934/mbe.2023017
[6]
Mei-Ling Huang, Zong-Bin Huang .
An ensemble-acute lymphoblastic leukemia model for acute lymphoblastic leukemia image classification. Mathematical Biosciences and Engineering, 2024, 21(2): 1959-1978.
doi: 10.3934/mbe.2024087
Tingxi Wen, Hanxiao Wu, Yu Du, Chuanbo Huang .
Faster R-CNN with improved anchor box for cell recognition. Mathematical Biosciences and Engineering, 2020, 17(6): 7772-7786.
doi: 10.3934/mbe.2020395
[9]
Vasileios E. Papageorgiou, Georgios Petmezas, Pantelis Dogoulis, Maxime Cordy, Nicos Maglaveras .
Uncertainty CNNs: A path to enhanced medical image classification performance. Mathematical Biosciences and Engineering, 2025, 22(3): 528-553.
doi: 10.3934/mbe.2025020
[10]
Shen Jiang, Jinjiang Li, Zhen Hua .
Transformer with progressive sampling for medical cellular image segmentation. Mathematical Biosciences and Engineering, 2022, 19(12): 12104-12126.
doi: 10.3934/mbe.2022563
Abstract
To assure operational safety in the airport apron area and track the process of ground service, it is necessary to analyze key targets and their activities in the airport apron surveillance videos. This research shows an activity identification algorithm for ground service objects in an airport apron area and proposes an improved YOLOv5 algorithm to increase the precision of small object detection by introducing an SPD-Conv (spath-to-depth-Conv) block in YOLOv5's backbone layer. The improved algorithm can efficiently extract the information features of small-sized objects, medium-sized objects, and moving objects in large scenes, and it achieves effective detection of activities of ground service in the apron area. The experimental results show that the detection average precision of all objects is more than 90%, and the whole class mean average precision (mAP) is 98.7%. At the same time, the original model was converted to TensorRT and OpenVINO format models, which increased the inference efficiency of the GPU and CPU by 55.3 and 137.1%, respectively.
1.
Introduction
Breast cancer is one of the most common malignant tumors in women. In 2013, there were about 180 million new cases of female breast cancer in the world [1,2]. In China, the incidence rate of breast cancer in 2013 was 42.02/10 million, ranking the first place in the incidence of cancer in women, and the mortality rate was 9.74/10 million, ranking fifth in the female cancer death cause [3,4,5]. Breast cancer seriously endangers women's life and health, and brings huge economic burden to the family and society [6].
At present, the traditional statistical methods to analyze the medical expenses and influencing factors of breast cancer include multiple linear regression, logistic regression analysis and so on [7,8,9,10]. Back propagation (BP) neural network is an artificial neural network model based on error back propagation [11]. Compared with traditional statistical methods, it has no special requirements for the type and distribution of data, and has some fault tolerance, so it has more advantages [12,13,14,15]. In recent years, BP neural network model and other data mining methods have also been applied to analyze the medical expenses of cancer patients such as gastric cancer, lung cancer, liver cancer, gynecological cancer and so on [16,17,18].
In this study, the medical expenses of female breast cancer patients in rural areas of Anhui Province were selected as the research object. After the BP neural network model was constructed, the results were compared with the multiple linear model. The aim was to verify the effectiveness and predictive power of the two models for the influencing factors of medical expenses of breast cancer patients, so as to provide scientific theoretical basis for reasonable control of medical expenses of breast cancer.
2.
Materials and methods
2.1. General data
According to the data of cancer registration report in Anhui Province, the medical records of all female breast cancer patients diagnosed from 2017 to 2019 and coded as C50 according to ICD-10 disease code were collected from four county people's hospitals (Feidong, Feixi, Changfeng, and Lujiang) in Anhui Province, including hospitalization number, medical insurance number, medical payment method, operation, chemotherapy and radiotherapy; Medical insurance number, name, date of birth, disease diagnosis, total cost of hospitalization, hospital and other information were collected from social security department. A total of 846 samples were collected. All research variables were assigned values (Table 1). After the samples with missing values and illogicality were excluded, 795 cases were included in the study, and the effective rate was 93.97%.
BP neural network is the abbreviation of error back propagation neural network. It is a multilayer feedforward network trained by error back propagation algorithm. It is one of the most widely used neural network models at present. It is composed of an input layer, one or more hidden layers and an output layer. Each layer is composed of a certain number of neurons. Its structure is shown in Figure 1. First, the number of neurons in each layer is determined. The number of neurons in the input layer and the output layer is determined by the independent and dependent variables of the actual research. There is no unified calculation method for the number of neurons in the hidden layer. In this study, the formula (M represents the number of neurons in the hidden layer, n represents the number of neurons in the input layer, m represents the number of neurons in the output layer, and represents any value from 1 to 10) is used to calculate the number of neurons in the hidden layer. Secondly, network training. Through SSPS Clementine 12.0 software to simulate the training set, different BP neural network models are obtained. Finally, the network test is carried out. The test set is substituted into each model, and the model with the highest accuracy is the optimal model.
Figure 1.
Structure of back propagation neural network model.
Multiple linear regression is a regression analysis based on the given values of multiple explanatory variables. It is a method to study the linear relationship between a dependent variable and multiple independent variables [19]. The general form of multiple linear regression model is:
Y=β0+β1x1+β2x2+β3x3+I+βixi+e
(1)
Where β0 is a constant term, I is the number of independent variables, βi (i = 1, 2… i) is partial regression coefficient, e is random error. The meaning of partial regression coefficient is the average change of dependent variable Y when the independent variable changes one unit while other independent variables remain unchanged. After the multiple linear regression parameters are obtained, it is necessary to carry out statistical tests to determine the reliability of the model performance, including the fitting test (coefficient of determination), the significance test of the overall linear equation (F test), the significance test of variables (t test), etc. [20].
2.4. Model evaluation method
The performance of the two models is evaluated by the following indicators, where R2 is the coefficient of determination, which can explain the percentage of the independent variable explaining the change of the dependent variable. The value range is between 0 and 1. The closer the value is to 1, the better the fitting degree of the model to the sample is [21]. The absolute mean error (MAE) reflects the actual error of the model, and the root mean square error (RMSE) is the arithmetic square root of the mean square error (MSE). The calculation formula of each index is as follows.
R2=1−∑ni=1(yi−^yl)2∑ni=1(yi−¯yl)2
(2)
MAE=1n∑ni=1|∧yl−yi|
(3)
MSE=1n∑ni=1wi(yi−∧yi)2
(4)
RMSE=√1n∑ni=1wi(yi−∧yi)2
(5)
The predicted data of all patients were test by the normality test. The data both in back propagation neural network model and multiple linear regression model were consistent with normal distribution. After passing the homogeneity test, the difference between the two models were compared by t test.
3.
Result
3.1. Basic information of patients
The median medical expenses of breast cancer patients were (24576 ± 4792) RMB, and the hospitalization days was (31.4 ± 6.7) d. The composition ratio of other variables is shown in Table 2.
Table 2.
Basic information of hospitalized patients with breast cancer.
The SPSS Clementine 12.0 data mining platform was used to construct BP neural network model and multiple linear regression model for medical expenses of female breast cancer patients. BP neural network model takes nine indicators such as region, year of diagnosis and medical payment mode as input and logarithm of medical expenses as output. It adopts random sampling method and takes 70% samples as training set and 30% samples as test set. After repeated verification, a three-layer BP neural network model is finally constructed, with 9 neurons in the input layer, 10 neurons in the hidden layer and 1 neuron in the output layer, and the accuracy is 95.97%. The model results are shown in Table 3.
Table 3.
Summary of Back propagation neural network model results.
In the multiple linear regression model, 9 indicators such as region, year of diagnosis and medical payment mode were taken as independent variables, and the logarithm of medical expenses was taken as dependent variable. The multiple correlation coefficient was 0.841, which indicated that the model fitted well. The probability of F statistic of the model population linear test (P < 0.001) indicates that there is a significant linear relationship between independent variables and dependent variables. The model results are shown in Table 4.
Table 4.
Summary of multiple linear regression models.
3.3. Comparative analysis of influencing factors of medical expenses of breast cancer patients
BP neural network model gives the sensitivity of each variable, that is, the influence of each variable change on medical expenses. The analysis and comparison results of the two models are shown in Table 5. It can be seen that the top two influencing factors for medical expenses of breast cancer patients are length of stay and region; whether radiotherapy, surgery, age and chemotherapy also have a greater impact on medical expenses; medical payment method, diagnosis year and clinical stage have a smaller impact on medical expenses.
Table 5.
Comparative analysis of influencing factors of medical expenses in patients with breast cancer.
3.4. Comparison between back propagation neural network model and multiple linear regression model
All samples were substituted into the established BP neural network model and multiple linear regression model to evaluate the performance of the two models. The results are shown in Table 6. The coefficient of determination (R2) of BP neural network model was larger than that of multiple linear regression model, so the fitting degree of BP neural network model was better than that of multiple linear regression model. The MAE, MSE and RMSE values of BP neural network model were less than those of multiple linear regression model, so the prediction ability of BP neural network model was better than that of multiple linear regression model.
Table 6.
Comparison between back propagation neural network model and multiple linear regression model.
In this study, the median medical expenses and length of stay of breast cancer patients were (24576 ± 4792) RBM and (31.4 ± 6.7) d. The high cost of hospitalization not only affects the delay of treatment, but also hinders the choice of treatment [22,23]. At the same time, breast cancer brings huge disease burden to patients. Therefore, it is suggested to strengthen cancer screening for women, so as to achieve early detection, early diagnosis and early treatment, so as to reduce the economic burden and disease burden for individuals, families and society.
The results show that BP neural network model and multiple linear regression model can fit the data well. Through the comparative analysis of the influencing factors of medical expenses of breast cancer patients, it can be seen that the hospitalization days and regions are consistent in the two models, whether surgery, age of diagnosis, chemotherapy, medical payment method, year of diagnosis and clinical stage are basically consistent in the two models, but whether radiotherapy is inconsistent in the two models. The length of stay has the greatest impact on the cost of hospitalization, which is consistent with the existing research. Therefore, on the premise of ensuring the level of medical services, shortening the length of stay is an effective measure to reduce the medical expenses of breast cancer patients. There are also great differences in the medical expenses of breast cancer among regions, mainly due to the different economic development and medical technology levels. It is suggested that medical service providers can standardize the clinical pathway and provide efficient and affordable treatment for patients. Medical insurance is the main means to reduce the economic burden of rural patients. In this study, it has little impact on medical expenses. It is suggested that medical insurance policy makers should strengthen the compensation for rural cancer patients and reduce their economic risks.
In recent years, BP neural network model has been widely used in the field of medicine, and achieved good results [24,25]. Although BP neural network model has some disadvantages, such as over training, slow convergence speed, easy to fall into local optimum, it has no requirements for data type and distribution, has certain fault tolerance, and can correct errors repeatedly in the process of self-learning [26,27]. These advantages have great advantages in dealing with medical data with the characteristics of complexity and diversity. The results show that the determination coefficient of BP neural network model is greater than that of multiple linear regression model, and the values of MAE, RMSE and MSE are less than the corresponding values of multiple linear regression model, so its prediction ability is higher than that of multiple linear regression model.
5.
Conclusions
Compared with multiple linear regression model, BP neural network model is more suitable for the analysis of medical expenses in patients with breast cancer. However, the model itself has no advantages or disadvantages, only the applicable conditions of each model are different.
Acknowledgements
The authors would like to acknowledge the all the breast cancer patients for their participation and support.
Conflict of interest
The authors declared that there was no conflict of interests.
J. Redmon, S. Divvala, R. Girshick, A. Farhadi, You only look once: Unified, real-time object detection, in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), (2016), 779–788. https://doi.org/10.1109/CVPR.2016.91
[3]
H. Law, J. Deng, Cornernet: Detecting objects as paired keypoints, in Proceedings of the European Conference on Computer Vision (ECCV), (2018), 734–750. https://doi.org/10.1007/s11263-019-01204-1
[4]
Z. Tian, C. Shen, H. Chen, T. He, Fcos: Fully convolutional one-stage object detection, in 2019 IEEE/CVF International Conference on Computer Vision (ICCV), (2019), 9626–9636. https://doi.org/10.1109/ICCV.2019.00972
[5]
J. Liu, M. Wang, X. Xie, Y. Song, L. Xu, Leather defect detection algorithm based on improved YOLOv5, Comput. Eng., 49 (2023), 240–249. https://doi.org/10.19678/j.issn.1000-3428.0064587 doi: 10.19678/j.issn.1000-3428.0064587
[6]
J. Choi, D. Chun, H. Kim, H. J. Lee, Gaussian yolov3: An accurate and fast object detector using localization uncertainty for autonomous driving, in Proceedings of the IEEE/CVF International Conference on Computer Vision, (2019), 502–511. https://doi.org/10.1109/ICCV.2019.00059
[7]
P. Li, H. Li, Research on fod detection for airport runway based on yolov3, in 2020 39th Chinese Control Conference (CCC), IEEE, (2020), 7096–7099. https://doi.org/10.23919/CCC50068.2020.9188724
[8]
X. Shi, J. Hu, X. Lei, S. Xu, Detection of flying birds in airport monitoring based on improved YOLOv5, in 2021 6th International Conference on Intelligent Computing and Signal Processing (ICSP), IEEE, (2021), 1446–1451. https://doi.org/10.1109/ICSP51882.2021.9408797
[9]
F. H. Cai, Y. X. Zhang, J. Huang, A bridge surface crack detection algorithm based on YOLOv3 and attention mechanism, Pattern Recognit. Artif. Intell., 33 (2020), 926–933. https://doi.org/10.16451/j.cnki.issn1003-6059.202010007 doi: 10.16451/j.cnki.issn1003-6059.202010007
[10]
Y. M. Shi, K. B. Jia, The Research and implementation of moving object detecting and tracking in intelligence video monitor system, in 2011 International Conference on Multimedia and Signal Processing, IEEE, 2 (2011), 105–108. https://doi.org/10.1109/CMSP.2011.111
[11]
J. Ferryman, M. Borg, D. Thirde, F. Fusier, V. Valentin, F. Brémond, et al., Automated scene understanding for airport aprons, in AI 2005: Advances in Artificial Intelligence. AI 2005. Lecture Notes in Computer Science, Springer, Berlin, 3809 (2005), 593–603. https://doi.org/10.1007/11589990_62
[12]
N. Cai, G. He, Multi-cloud resource scheduling intelligent system with endogenous security, Electron. Res. Arch., 32 (2024), 1380–1405. https://doi/10.3934/era.2024064 doi: 10.3934/era.2024064
[13]
M. Kumar, S. Ray, D. K. Yadav, Moving human detection and tracking from thermal video through intelligent surveillance system for smart applications, Multimedia Tools Appl., 82 (2023), 39551–39570. https://doi.org/10.1007/s11042-022-13515-6 doi: 10.1007/s11042-022-13515-6
[14]
A. Raza, S. A. Chelloug, M. H. Alatiyyah, A. Jalal, J. Park, Multiple pedestrian detection and tracking in night vision surveillance systems, CMC-Comput. Mater. Continua, 75 (2023), 3275–3289. http://doi.org/10.32604/cmc.2023.029719 doi: 10.32604/cmc.2023.029719
[15]
S. Wilke, A. Majumdar, W. Y. Ochieng, Airport surface operations: A holistic framework for operations modeling and risk management, Saf. Sci., 63 (2014), 18–33. https://doi.org/10.1016/j.ssci.2013.10.015 doi: 10.1016/j.ssci.2013.10.015
[16]
H. L. Lu, S. Vaddi, V. Cheng, J. Tsai, Airport gate operation monitoring using computer vision techniques, in 16th AIAA Aviation Technology, Integration, and Operations Conference, (2016), 3912. https://doi.org/10.2514/6.2016-3912
[17]
Y. Zou, Q. Ying, R. Liu, M. Rong, Research on evaluation method for operation support capability of airport apron, in 2020 IEEE 2nd International Conference on Civil Aviation Safety and Information Technology (ICCASIT, IEEE, (2020), 1043–1047. https://doi.org/10.1109/ICCASIT50869.2020.9368541
[18]
T. V. Phat, S. Alam, N. Lilith, P. N. Tran, B. T. Nguyen, Aircraft push-back prediction and turnaround monitoring by vision-based object detection and activity identification, in Proc. 10th SESAR Innov. Days., 2020.
S. Wang, Y. Che, H. Zhao, A. Lim, Accurate tracking, collision detection, and optimal scheduling of airport ground support equipment, IEEE Internet Things J., 8 (2020), 572–584. https://doi.org/10.1109/JIOT.2020.3004874 doi: 10.1109/JIOT.2020.3004874
[21]
S. Wang, C. Li, A. Lim, ROPHS: Determine real-time status of a multi-carriage logistics train at airport, IEEE Trans. Intell. Transp. Syst., 23 (2021), 6347–6356. https://doi.org/10.1109/TITS.2021.3055838 doi: 10.1109/TITS.2021.3055838
[22]
S. Yıldız, O. Aydemir, A. Memiş, S. Varlı, A turnaround control system to automatically detect and monitor the time stamps of ground service actions in airports: a deep learning and computer vision based approach, Eng. Appl. Artif. Intell., 114 (2022), 105032. https://doi.org/10.1016/j.engappai.2022.105032 doi: 10.1016/j.engappai.2022.105032
[23]
P. Thai, S. Alam, N. Lilith, B. T. Nguyen, A computer vision framework using Convolutional Neural Networks for airport-airside surveillance, Transp. Res. Part C Emerging Technol., 137 (2022), 103590. https://doi.org/10.1016/j.trc.2022.103590 doi: 10.1016/j.trc.2022.103590
[24]
S. Liu, R. Wu, J. Qu, Y. Li, HDA-Net: hybrid convolutional neural networks for small objects recognization at airports, IEEE Trans. Instrum. Meas., 71 (2022), 1–14. https://ieeexplore.ieee.org/abstract/document/9939036
R. Sunkara, T. Luo, No more strided convolutions or pooling: A new CNN building block for low-resolution images and small objects, in Joint European Conference on Machine Learning and Knowledge Discovery in Databases, Cham, Springer Nature Switzerland, (2022), 443–459. https://doi.org/10.1007/978-3-031-26409-2_27
[27]
S. Ren, K. He, R. Girshick, J. Sun, Faster r-cnn: Towards real-time object detection with region proposal networks, Adv. Neural Inf. Process. Syst., (2015), 28.
[28]
W. Liu, D. Anguelov, D. Erhan, C. Szegedy, S. Reed, C. Fu, et al., Ssd: Single shot multibox detector, in Computer Vision–ECCV 2016. ECCV 2016. Lecture Notes in Computer Science(), Springer, Cham, 9905 (2016), 21–37 https://doi.org/10.1007/978-3-319-46448-0_2
[29]
M. Tan, R. Pang, Q. V. Le, Efficientdet: Scalable and efficient object detection, in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), (2020), 10781–10790.
[30]
K. Chen, J. Wang, J. Pang, Y. Cao, Y. Xiong, X. Li, et al., MMDetection: Open mmlab detection toolbox and benchmark, preprint, arXiv: 1906.07155. https://doi.org/10.48550/arXiv.1906.07155
This article has been cited by:
1.
Li Wu, Zhijie Lv, Linjing Lai, Penglei Zhou,
Assessment of influencing factors of hospitalization expenses for Crohn's disease patients: Based on LASSO and linear mixed model,
2022,
10,
2296-2565,
10.3389/fpubh.2022.925616
Wei Guo, Guoyun Gao, Jun Dai, Qiming Sun, Kelvin Wong,
Prediction of Lung Infection during Palliative Chemotherapy of Lung Cancer Based on Artificial Neural Network,
2022,
2022,
1748-6718,
1,
10.1155/2022/4312117
4.
Yihao Zhu, Xiaojing Yang, Yao Zu,
Integrated analysis of WGCNA and machine learning identified diagnostic biomarkers in dilated cardiomyopathy with heart failure,
2022,
10,
2296-634X,
10.3389/fcell.2022.1089915
5.
Yuanhong Che, Zhangdong Wei, Jing Wen, Hangjun Che,
Construction of Surface Water Pollution Prediction Model Based on Machine Learning,
2022,
2022,
1875-919X,
1,
10.1155/2022/7211094
6.
Hong Jiang, Sinuo Ren, Shengbo Zhang, Xudan Luo, Rui He, ShuaiFei Wang, JianDong Yan, Shan Zhou, Chengliang Yin, Ying Xiao, Zhihuan Li,
Analyzing factors influencing hospitalization costs for five common cancers in China using neural network models,
2025,
1369-6998,
1,
10.1080/13696998.2025.2494459
Yaxi Xu, Yi Liu, Ke Shi, Xin Wang, Yi Li, Jizong Chen. An airport apron ground service surveillance algorithm based on improved YOLO network[J]. Electronic Research Archive, 2024, 32(5): 3569-3587. doi: 10.3934/era.2024164
Yaxi Xu, Yi Liu, Ke Shi, Xin Wang, Yi Li, Jizong Chen. An airport apron ground service surveillance algorithm based on improved YOLO network[J]. Electronic Research Archive, 2024, 32(5): 3569-3587. doi: 10.3934/era.2024164
Figure 2. Sample image of airport apron area surveillance dataset
Figure 3. Data collection processing
Figure 4. Annotation sample of the dataset
Figure 5. Cases of airport for each category
Figure 6. SPD-Conv structure when scale = 2
Figure 7. Algorithm architecture figure of YOLOv5s-SPD-Conv
Figure 8. The schematic figure of detection algorithm result. (The category name in the figure is the label name, not the exclusive noun of this category)
Figure 9. Similarities between the easily distinguishable category and micro-differences between the easily confusable categories
Figure 10. Visualized heatmaps of categories at different scales
Figure 11. The similarities and differences in categories
DownLoad:
