Embedded system for road damage detection by deep convolutional neural network

Siyu Chen; Yin Zhang; Yuhang Zhang; Jiajia Yu; Yanxiang Zhu; Siyu Chen; Yin Zhang; Yuhang Zhang; Jiajia Yu; Yanxiang Zhu

doi:10.3934/mbe.2019402

Mathematical Biosciences and Engineering

2019, Volume 16, Issue 6: 7982-7994. doi: 10.3934/mbe.2019402

Previous Article Next Article

Research article

Embedded system for road damage detection by deep convolutional neural network

1.
Department of Electronic and Computer Engineering, Southeast University Chengxian College, Nanjing 210088, China;
2.
Department of Mechanical and Electrical Engineering, Southeast University Chengxian College, Nanjing 210088, China;
3.
Verimake Research, Nanjing Qujike Info-tech Co., Ltd., Nanjing 210088, China

Received: 02 June 2019 Accepted: 15 August 2019 Published: 03 September 2019

Road pavement could be damaged due to various reasons, causing damages such as cracks and pits. These damages cause potential dangers in traffic safety. It is necessary for road maintenance departments to find damages in time before maintenance. At present, maintenance departments of some high-level roads are equipped with specialized detection vehicles such as laser scanning vehicles to detect road damages. These kinds of devices can get good detection performance, but the economic cost is very high. In this paper, we use a road damage image dataset to train an object detection model based on deep convolutional neural network and deploy it on a low-cost embedded platform to form an embedded system. The system uses a common camera mounted on windshield of a common vehicle as sensor to detect road damages. The embedded system consumes about 352 ms to process one frame of image and can achieve a recall rate of about 76% which is higher than some previous related works. The recall rate of this scheme using common cameras is less than that of high-level specialized detectors, but the economic cost is much lower than them. After subsequent development, the road maintenance department with limited funds can consider about schemes like this.

Keywords:

Citation: Siyu Chen, Yin Zhang, Yuhang Zhang, Jiajia Yu, Yanxiang Zhu. Embedded system for road damage detection by deep convolutional neural network[J]. Mathematical Biosciences and Engineering, 2019, 16(6): 7982-7994. doi: 10.3934/mbe.2019402

Related Papers:

[1]	Eugene Kashdan, Dominique Duncan, Andrew Parnell, Heinz Schättler . Mathematical methods in systems biology. Mathematical Biosciences and Engineering, 2016, 13(6): i-ii. doi: 10.3934/mbe.201606i
[2]	Janine Egert, Clemens Kreutz . Realistic simulation of time-course measurements in systems biology. Mathematical Biosciences and Engineering, 2023, 20(6): 10570-10589. doi: 10.3934/mbe.2023467
[3]	Adam Peddle, William Lee, Tuoi Vo . Modelling chemistry and biology after implantation of a drug-eluting stent. Part Ⅱ: Cell proliferation. Mathematical Biosciences and Engineering, 2018, 15(5): 1117-1135. doi: 10.3934/mbe.2018050
[4]	Anissa Guillemin, Michael P. H. Stumpf . Non-equilibrium statistical physics, transitory epigenetic landscapes, and cell fate decision dynamics. Mathematical Biosciences and Engineering, 2020, 17(6): 7916-7930. doi: 10.3934/mbe.2020402
[5]	Urszula Ledzewicz, Avner Friedman, Jacek Banasiak, Heinz Schättler, Edward M. Lungu . From the guest editors. Mathematical Biosciences and Engineering, 2013, 10(3): i-ii. doi: 10.3934/mbe.2013.10.3i
[6]	Avner Friedman, Kang-Ling Liao . The role of the cytokines IL-27 and IL-35 in cancer. Mathematical Biosciences and Engineering, 2015, 12(6): 1203-1217. doi: 10.3934/mbe.2015.12.1203
[7]	Lin Zhang, Yongbin Ge, Zhi Wang . Positivity-preserving high-order compact difference method for the Keller-Segel chemotaxis model. Mathematical Biosciences and Engineering, 2022, 19(7): 6764-6794. doi: 10.3934/mbe.2022319
[8]	Cristina De Ambrosi, Annalisa Barla, Lorenzo Tortolina, Nicoletta Castagnino, Raffaele Pesenti, Alessandro Verri, Alberto Ballestrero, Franco Patrone, Silvio Parodi . Parameter space exploration within dynamic simulations of signaling networks. Mathematical Biosciences and Engineering, 2013, 10(1): 103-120. doi: 10.3934/mbe.2013.10.103
[9]	Fred Brauer, Carlos Castillo-Chavez, Thomas G. Hallam, Jia Li, Jianhong Wu, Yicang Zhou . From the Guest Editors. Mathematical Biosciences and Engineering, 2006, 3(1): i-ix. doi: 10.3934/mbe.2006.3.1i
[10]	Maria Vittoria Barbarossa, Christina Kuttler, Jonathan Zinsl . Delay equations modeling the effects of phase-specific drugs and immunotherapy on proliferating tumor cells. Mathematical Biosciences and Engineering, 2012, 9(2): 241-257. doi: 10.3934/mbe.2012.9.241

Abstract

References

[1]	E. Chuo, Research history and prospect of domestic pavement automatic detection system, China High-Tech. Enterp., 1 (2011), 1-3.
[2]	G. E. Hinton, S. Osindero and Y. W. Teh, A fast learning alg Comput., 18 (2006), 1527-1554. rithm for deep belief nets, Neural
[3]	L. Zhang, F. Yang, Y. D. Zhang, et al., Road crack detection using deep convolutional neural network, 2016 IEEE Int. Conf. Image Process. (ICIP), 3708-3712.
[4]	H. Maeda, Y. Sekimoto, T. Seto, et al., Road damage detection using deep neural networks with images captured through a smartphone, Comput. Aided Civ. Infrastruct. Eng., 33 (2018), 1127-1141. doi: 10.1111/mice.12387
[5]	W. Liu, D. Anguelov, D. Erhan, et al., SSD:Single shot multiBox detector, 2016 European Conf. Comput. Vision (ECCV), 21-37.
[6]	A. G. Howard, M. Zhu, B. Chen, et al., MobileNets:Efficient convolutional neural networks for mobile vision applications, preprint, arXiv:1704.04861.
[7]	A. He, Advantages of JG-1 laser 3D pavement inspection system, China Highw., 16 (2005), 94-95.
[8]	R. Girshick, J. Donahue, T. Darrell, et al., Rich feature hierarchies for accurate object detection and semantic segmentation, 2014 IEEE Conf. Comput. Vision Pattern 587. Recogn. (CVPR), 580-587
[9]	S. Ren, K. He, R. Girshick, et al., Faster R-CNN:Towards real-time object detection with region Proposal networks, Adv. Neural Inf. Process. Syst., (2015), 91-99.
[10]	J. Redmon, S. Divvala, R. Girshick, et al., You only look once:Unified, Real-Time object detection, 2016 IEEE Conf. Comput. Vision Pattern Recogn. (CVPR), 779-788.
[11]	R. Joseph and A. Farhadi, YOLO v3:An incremental improvement, preprint, arXiv:1804.02767.
[12]	S. Karen and A. Zisserman, Very recognition, preprint, arXiv:1409.1556. deep convolutional networks for Large-Scale image
[13]	Z. Zhou, Model evaluating and selecting, in Machine Learn ng (eds. Zhihua Zhou), Tsinghua University Press, (2016), 23-52.
[14]	T. Lin, M. Maire, S. Belongie, et al., Microsoft COCO:Common objects in context, 2014 European Conf. Comput. Vision (ECCV), 740-755.

This article has been cited by:

Charles L. Wiseman, Jarrod P. Holmes, Carmen Calfa, Shaker R. Dakhil, Saveri Bhattacharya, George E. Peoples, Markus D. Lacher, Miguel Lopez-Lago, Alex Kharazi, Giuseppe Del Priore, Mingjin Chang, Daniel L. Adams, William V. Williams, Results of a phase I/IIa trial of SV-BR-1-GM inoculation with low-dose cyclophosphamide and interferon alpha (Bria-IMT) in metastatic breast cancer, 2024, 20, 2164-5515, 10.1080/21645515.2024.2379864

Reader Comments

Your name:*

Email:*
© 2019 the Author(s), licensee AIMS Press. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0)