A long-range, wide-area network is a cost-effective, energy-efficient technology for wide-area sensor networks. But the massive Internet of Things (IoT) brings challenges such as increased traffic and energy consumption. Thus, there is a pressing need to design a scheduling strategy to improve network energy efficiency without compensating for its reliability. We have proposed a deep deterministic policy gradient-based scheduling algorithm with a frequency-hopping spread spectrum that avoids repeated collisions and retransmissions. Frequency-hopping divides frequency channels into subchannels, allowing multiple devices to operate simultaneously. This makes it a favorable scheduling strategy for dense networks, as it reduces collisions and energy consumption. Scheduling in a long-range, wide-area network involves selecting transmission parameters for each device, which can be cumbersome. We used the deep deterministic policy gradient algorithm to optimize schedule generation for high-density networks, enhancing energy efficiency. In this paper, we compared the performance of the frequency-hopping spread spectrum with other heuristic and machine learning-based algorithms using the LoRaSim simulator. We observed a 42% increase in the packet delivery ratio and a 17% improvement in energy efficiency with our solution, along with detailed results on the transmission time and collision reduction.
Citation: Jui Mhatre, Ahyoung Lee, Ramazan Aygun. Frequency-hopping scheduling algorithm for energy-efficient IoT, long-range, wide-area networks[J]. Applied Computing and Intelligence, 2024, 4(2): 300-327. doi: 10.3934/aci.2024018
A long-range, wide-area network is a cost-effective, energy-efficient technology for wide-area sensor networks. But the massive Internet of Things (IoT) brings challenges such as increased traffic and energy consumption. Thus, there is a pressing need to design a scheduling strategy to improve network energy efficiency without compensating for its reliability. We have proposed a deep deterministic policy gradient-based scheduling algorithm with a frequency-hopping spread spectrum that avoids repeated collisions and retransmissions. Frequency-hopping divides frequency channels into subchannels, allowing multiple devices to operate simultaneously. This makes it a favorable scheduling strategy for dense networks, as it reduces collisions and energy consumption. Scheduling in a long-range, wide-area network involves selecting transmission parameters for each device, which can be cumbersome. We used the deep deterministic policy gradient algorithm to optimize schedule generation for high-density networks, enhancing energy efficiency. In this paper, we compared the performance of the frequency-hopping spread spectrum with other heuristic and machine learning-based algorithms using the LoRaSim simulator. We observed a 42% increase in the packet delivery ratio and a 17% improvement in energy efficiency with our solution, along with detailed results on the transmission time and collision reduction.
| [1] | M. Torchia, A. Shrivastava, K. Chinta, E. Elshewy, M. Fang, N. Guo, et al., Worldwide internet of things spending guide, IDC Corporate, 2019. Available from: https://www.idc.com/getdoc.jsp?containerId=IDC_P29475. |
| [2] | Semtech, What is LoRa, Semtech Corporation, 2024. Available from: https://www.semtech.com/lora/what-is-lora. |
| [3] |
G. Boquet, P. Tuset-Peiró, F. Adelantado, T. Watteyne, X. Vilajosana, Lr-fhss: overview and performance analysis, IEEE Commun. Mag., 59 (2021), 30–36. https://doi.org/10.1109/MCOM.001.2000627 doi: 10.1109/MCOM.001.2000627
|
| [4] | Y. Li, J. Yang, J. Wang, Dylora: towards energy efficient dynamic lora transmission control, Proceedings of IEEE INFOCOM 2020—IEEE Conference on Computer Communications, 2020, 2312–2320. https://doi.org/10.1109/INFOCOM41043.2020.9155407 |
| [5] |
L. Tu, A. Bradai, Y. Pousset, A. Aravanis, Energy efficiency analysis of LoRa networks, IEEE Wirel. Commun. Le., 10 (2021), 1881–1885. https://doi.org/10.1109/LWC.2021.3084996 doi: 10.1109/LWC.2021.3084996
|
| [6] | SonicWall, Wireless: SNR, RSSI and noise basics of wireless troubleshooting, SonicWall, 2019. Available from: https://www.sonicwall.com/support/knowledge-base/wireless-snr-rssi-and-noise-basics-of-wireless-troubleshooting/180314090744170/. |
| [7] | R. Sanchez-Iborra, J. Sánchez-Gómez, J. Santa, P. J. Fernández, A. F. Skarmeta, IPv6 communications over LoRa for future IoV services, Proceedings of IEEE 4th World Forum on Internet of Things (WF-IoT), 2018, 92–97. https://doi.org/10.1109/WF-IoT.2018.8355231 |
| [8] | A. Gloria, C. Dionisio, G. Simões, P. Sebastião, Lora transmission power self configuration for low power end devices, Proceedings of 22nd International Symposium on Wireless Personal Multimedia Communications (WPMC), 2019, 1–6. https://doi.org/10.1109/WPMC48795.2019.9096197 |
| [9] | D. Zorbas, K. Q. Abdelfadeel, V. Cionca, D. Pesch, B. O'Flynn, Offline scheduling algorithms for time-slotted lora-based bulk data transmission, Proceedings of IEEE 5th World Forum on Internet of Things (WF-IoT), 2019,949–954. https://doi.org/10.1109/WF-IoT.2019.8767277 |
| [10] |
D. Zorbas, C. Caillouet, K. Abdelfadeel Hassan, D. Pesch, Optimal data collection time in lora networks—a time-slotted approach, Sensors, 21 (2021), 1193. https://doi.org/10.3390/s21041193 doi: 10.3390/s21041193
|
| [11] | C. Pham, A. Bounceur, L. Clavier, U. Noreen, M. Ehsan, Radio channel access challenges in LoRa low-power wide-area networks, LPWAN Technologies for IoT and M2M Applications, 2020, 65–102. https://doi.org/10.1016/B978-0-12-818880-4.00004-1 |
| [12] | J. Moraes, N. Matni, A. Riker, H. Oliveira, E. Cerqueira, C. Both, et al., An efficient heuristic LoRaWAN adaptive resource allocation for IoT applications, Proceedings of IEEE Symposium on Computers and Communications (ISCC), 2020, 1–6. https://doi.org/10.1109/ISCC50000.2020.9219600 |
| [13] |
K. Q. Abdelfadeel, D. Zorbas, V. Cionca, D. Pesch, $Free$—fine-grained scheduling for reliable and energy-efficient data collection in lorawan, IEEE Internet Things, 7 (2020), 669–683. https://doi.org/10.1109/JIOT.2019.2949918 doi: 10.1109/JIOT.2019.2949918
|
| [14] | J. Mhatre, A. Lee, H. Lee, Frequency hopping scheduling algorithm in green lorawan: reinforcement learning approach, Proceedings of IEEE Conference on Standards for Communications and Networking (CSCN), 2023,216–221. https://doi.org/10.1109/CSCN60443.2023.10453154 |
| [15] | T. Yatagan, S. Oktug, Smart spreading factor assignment for lorawans, Proceedings of IEEE Symposium on Computers and Communications (ISCC), 2019, 1–7. https://doi.org/10.1109/ISCC47284.2019.8969608 |
| [16] | M. El-Aasser, A. Gasser, M. Ashour, T. Elshabrawy, Performance analysis comparison between LoRa and frequency hopping-based LPWAN, Proceedings of IEEE Global Conference on Internet of Things (GCIoT), 2019, 1–6. https://doi.org/10.1109/GCIoT47977.2019.9058411 |
| [17] | A. Varga, R. Hornig, An overview of the OMNeT++ simulation environment, Proceedings of 1st International ICST Conference on Simulation Tools and Techniques for Communications, Networks and Systems, 2010, 1–10. https://doi.org/10.4108/ICST.SIMUTOOLS2008.3027 |
| [18] |
M. A. Ullah, K. Mikhaylov, H. Alves, Analysis and simulation of LoRaWAN LR-FHSS for direct-to-satellite scenario, IEEE Wirel. Commun. Le., 11 (2022), 548–552. https://doi.org/10.1109/LWC.2021.3135984 doi: 10.1109/LWC.2021.3135984
|
| [19] | M. C. Bor, U. Roedig, T. Voigt, J. M. Alonso, Do LoRa low-power wide-area networks scale? Proceedings of the 19th ACM International Conference on Modeling, Analysis and Simulation of Wireless and Mobile Systems, 2016, 59–67. https://doi.org/10.1145/2988287.2989163 |
| [20] | I. Ilahi, M. Usama, M. O. Farooq, M. U. Janjua, J. Qadir, Intelligent resource allocation in dense lora networks using deep reinforcement learning, arXiv: 2012.11867. https://doi.org/10.48550/arXiv.2012.11867 |
| [21] |
R. Hamdi, E. Baccour, A. Erbad, M. Qaraqe, M. Hamdi, LoRa-RL: deep reinforcement learning for resource management in hybrid energy lora wireless networks, IEEE Internet Things, 9 (2022), 6458–6476. https://doi.org/10.1109/JIOT.2021.3110996 doi: 10.1109/JIOT.2021.3110996
|
| [22] | J. Mhatre, A. Lee, Dynamic reinforcement learning based scheduling for energy-efficient edge-enabled lorawan, Proceedings of IEEE International Performance, Computing, and Communications Conference (IPCCC), 2022,412–413. https://doi.org/10.1109/IPCCC55026.2022.9894340 |
| [23] | LoRaWAN, Notice of use and disclosure, LoRa Alliance, Inc., 2020. Available from: https://lora-alliance.org/wp-content/uploads/2020/11/RP_2-1.0.2.pdf. |
| [24] |
L. Zhang, B. Yang, X. You, Received signal strength indicator-based recursive set-membership localization with unknown transmit power and path loss exponent, IEEE Sens. J., 21 (2021), 26175–26185. https://doi.org/10.1109/JSEN.2021.3118536 doi: 10.1109/JSEN.2021.3118536
|
| [25] | J. Miranda, R. Abrishambaf, T. Gomes, P. Gonçalves, J. Cabral, A. Tavares, et al., Path loss exponent analysis in wireless sensor networks: Experimental evaluation, Proceedings of 11th IEEE international conference on industrial informatics (INDIN), 2013, 54–58. https://doi.org/10.1109/INDIN.2013.6622857 |
| [26] | D. Hermans, When it comes to Wi-Fi coverage, green is not always a good color, Cambium Networks, 2018. Available from: https://www.cambiumnetworks.com/blog/when-it-comes-to-wi-fi-coverage-green-is-not-always-a-good-color/. |
| [27] | D. Silver, G. Lever, N. Heess, T. Degris, D. Wierstra, M. Riedmiller, Deterministic policy gradient algorithms, Proceedings of the 31st International Conference on Machine Learning, 2014,387–395. |
| [28] |
Y. Wang, W. Fang, Y. Ding, N. Xiong, Computation offloading optimization for UAV-assisted mobile edge computing: a deep deterministic policy gradient approach, Wireless Netw., 27 (2021), 2991–3006. https://doi.org/10.1007/s11276-021-02632-z doi: 10.1007/s11276-021-02632-z
|
| [29] | RF Wireless, LoRaWAN MAC layer message formats, RF Wireless World, 2024. Available from: https://www.rfwireless-world.com/Tutorials/LoRaWAN-MAC-layer-inside.html. |
| [30] |
K. Koriakin, R. K. Boughton, Vaginal birthing sensors as a tool to monitor calving on large scale applications, Comput. Electron. Agr., 182 (2021), 106035. https://doi.org/10.1016/j.compag.2021.106035 doi: 10.1016/j.compag.2021.106035
|
| [31] | The Things Network, RSSI and SNR, The Things Industries, 2024. Available from: https://www.thethingsnetwork.org/docs/lorawan/rssi-and-snr/. |