Liang Wei, Chen Xiaohong, Huang Suzhen, Xiong Guanghao, Yan Ke, Zhou Xiaokang
Business School, Central South University, Changsha, 410083, China.
Changsha Social Laboratory of Artificial Intelligence, Hunan University of Technology and Business, Changsha, 410205, China.
Comput Commun. 2023 Apr 15;204:33-42. doi: 10.1016/j.comcom.2023.03.009. Epub 2023 Mar 22.
As one of the important research topics in the field of natural language processing, sentiment analysis aims to analyze web data related to COVID-19, e.g., supporting China government agencies combating COVID-19. There are popular sentiment analysis models based on deep learning techniques, but their performance is limited by the size and distribution of the dataset. In this study, we propose a model based on a federal learning framework with Bert and multi-scale convolutional neural network (Fed_BERT_MSCNN), which contains a Bidirectional Encoder Representations from Transformer modules and a multi-scale convolution layer. The federal learning framework contains a central server and local deep learning machines that train local datasets. Parameter communications were processed through edge networks. The weighted average of each participant's model parameters was communicated in the edge network for final utilization. The proposed federal network not only solves the problem of insufficient data, but also ensures the data privacy of the social platform during the training process and improve the communication efficiency. In the experiment, we used datasets of six social platforms, and used accuracy and F1-score as evaluation criteria to conduct comparative studies. The performance of the proposed Fed_BERT_MSCNN model was generally superior than the existing models in the literature.
作为自然语言处理领域的重要研究课题之一,情感分析旨在分析与新冠疫情相关的网络数据,例如,为中国政府机构抗击新冠疫情提供支持。有一些基于深度学习技术的流行情感分析模型,但其性能受到数据集大小和分布的限制。在本研究中,我们提出了一种基于联邦学习框架的模型,该模型结合了Bert和多尺度卷积神经网络(Fed_BERT_MSCNN),其中包含来自Transformer模块的双向编码器表示和一个多尺度卷积层。联邦学习框架包含一个中央服务器和训练本地数据集的本地深度学习机器。参数通信通过边缘网络进行处理。每个参与者模型参数的加权平均值在边缘网络中进行通信以供最终使用。所提出的联邦网络不仅解决了数据不足的问题,还在训练过程中确保了社交平台的数据隐私并提高了通信效率。在实验中,我们使用了六个社交平台的数据集,并以准确率和F1分数作为评估标准进行了比较研究。所提出的Fed_BERT_MSCNN模型的性能总体上优于文献中的现有模型。