Equal Energy Consumption Routing Protocol Algorithm Based on Q-Learning for Extending the Lifespan of Ad-Hoc Sensor Network


KIPS Transactions on Computer and Communication Systems, Vol. 10, No. 10, pp. 269-276, Oct. 2021
https://doi.org/10.3745/KTCCS.2021.10.10.269,   PDF Download:  
Keywords: Reinforcement Learning, Q-learning, Ad-Hoc Sensornetwork, energy consumption
Abstract

Recently, smart sensors are used in various environments, and the implementation of ad-hoc sensor networks (ASNs) is a hot research topic. Unfortunately, traditional sensor network routing algorithms focus on specific control issues, and they can’t be directly applied to the ASN operation. In this paper, we propose a new routing protocol by using the Q-learning technology, Main challenge of proposed approach is to extend the life of ASNs through efficient energy allocation while obtaining the balanced system performance. The proposed method enhances the Q-learning effect by considering various environmental factors. When a transmission fails, node penalty is accumulated to increase the successful communication probability. Especially, each node stores the Q value of the adjacent node in its own Q table. Every time a data transfer is executed, the Q values are updated and accumulated to learn to select the optimal routing route. Simulation results confirm that the proposed method can choose an energy-efficient routing path, and gets an excellent network performance compared with the existing ASN routing protocols.


Statistics
Show / Hide Statistics

Statistics (Cumulative Counts from September 1st, 2017)
Multiple requests among the same browser session are counted as one view.
If you mouse over a chart, the values of data points will be shown.


Cite this article
[IEEE Style]
K. K. Sang and K. S. Wook, "Equal Energy Consumption Routing Protocol Algorithm Based on Q-Learning for Extending the Lifespan of Ad-Hoc Sensor Network," KIPS Transactions on Computer and Communication Systems, vol. 10, no. 10, pp. 269-276, 2021. DOI: https://doi.org/10.3745/KTCCS.2021.10.10.269.

[ACM Style]
Kim Ki Sang and Kim Sung Wook. 2021. Equal Energy Consumption Routing Protocol Algorithm Based on Q-Learning for Extending the Lifespan of Ad-Hoc Sensor Network. KIPS Transactions on Computer and Communication Systems, 10, 10, (2021), 269-276. DOI: https://doi.org/10.3745/KTCCS.2021.10.10.269.