Apriori Based Big Data Processing System for Improve Sensor Data Throughput in IoT Environments


KIPS Transactions on Computer and Communication Systems, Vol. 10, No. 10, pp. 277-284, Oct. 2021
https://doi.org/10.3745/KTCCS.2021.10.10.277,   PDF Download:
Keywords: IoT, Smart Home, Apache Spark, Redis, Association Algorithm
Abstract

Recently, the smart home environment is expected to be a platform that collects, integrates, and utilizes various data through convergence with wireless information and communication technology. In fact, the number of smart devices with various sensors is increasing inside smart homes. The amount of data that needs to be processed by the increased number of smart devices is also increasing, and big data processing systems are actively being introduced to handle it effectively. However, traditional big data processing systems have all requests directed to cluster drivers before they are allocated to distributed nodes, leading to reduced cluster-wide performance sharing as cluster drivers managing segmentation tasks become bottlenecks. In particular, there is a greater delay rate on smart home devices that constantly request small data processing. Thus, in this paper, we design a Apriori-based big data system for effective data processing in smart home environments where frequent requests occur at the same time. According to the performance evaluation results of the proposed system, the data processing time was reduced by up to 38.6% from at least 19.2% compared to the existing system. The reason for this result is related to the type of data being measured. Because the amount of data collected in a smart home environment is large, the use of cache servers plays a major role in data processing, and association analysis with Apriori algorithms stores highly relevant sensor data in the cache.


Statistics
Show / Hide Statistics

Statistics (Cumulative Counts from September 1st, 2017)
Multiple requests among the same browser session are counted as one view.
If you mouse over a chart, the values of data points will be shown.


Cite this article
[IEEE Style]
S. J. Su, K. S. Jin, Y. T. Shin, "Apriori Based Big Data Processing System for Improve Sensor Data Throughput in IoT Environments," KIPS Transactions on Computer and Communication Systems, vol. 10, no. 10, pp. 277-284, 2021. DOI: https://doi.org/10.3745/KTCCS.2021.10.10.277.

[ACM Style]
Song Jin Su, Kim Soo Jin, and Young Tae Shin. 2021. Apriori Based Big Data Processing System for Improve Sensor Data Throughput in IoT Environments. KIPS Transactions on Computer and Communication Systems, 10, 10, (2021), 277-284. DOI: https://doi.org/10.3745/KTCCS.2021.10.10.277.