A Survey on the Classification Algorithms based on Big Data

Xudong Wei ； Zhaofei Li ； Zenan Wang ； Yumei Chen ； Xiaodong Tong ； Sijing Deng ； Wei Pu ； Yuanbo Zhang ； Xueshen Liu ； Li He ； Bin Liu

《International Core Journal of Engineering》 7卷5期 (2021/05) Pp. 222-228

https://doi.org/10.6919/ICJE.202105_7(5).0029

摘要

With the explosive growth of data, the use of big data technology machine learning classification algorithms to predict the results can improve the intelligent classification of data. It can provide data support for predicting classification in advance. Filter out the classification results to improve the efficiency of data processing and data realization. This article first introduces the development process of machine learning under big data, introduces the mainstream distributed processing framework spark, and then compares the advantages and disadvantages of classification algorithms under big data.

關鍵字

Big Data ； Spark ； Machine Learning ； Classification Algorithm

參考文獻

Han Chengcheng, Zeng Sitao, Lin Qiang, Cao Yongchun, Man Zhengxing. Summary of stream data classification algorithms based on decision trees[J]. Journal of Northwest University for Nationalities (Natural Science Edition), 2020, 41(02): 20-30 .

Ou Huajie. Overview of machine learning algorithms in the context of big data[J]. China Information Technology, 2019(04):50-51.

Liu Xia, Ou Zhipeng, Chen Yinan, Li Yuanhui, Chen Lei. Route passenger flow prediction simulation based on three models[J]. Journal of Henan Education Institute (Natural Science Edition), 2019, 28(01): 37-40+46.

Fan Xinxin, Chen Xiuguo, Yang Ya, Yan Hongmei, Wang Jianbin. Communication power state evaluation system based on SVM in cloud environment[J]. Journal of Anhui Electrical Engineering Vocational and Technical College, 2019, 24(01): 114-117.

Cao Hui, Yang Lijian. A three-dimensional contour reconstruction algorithm for magnetic flux leakage signal defects based on bias estimation [J]. Nondestructive Testing, 2019, 41(02): 33-39.