Department of Computer Engineering, Chosun University, 309 Pilmun-daero, Dong-gu, Gwangju 61452, Korea.
Department of Communication, Department of Computer Science, William Paterson University of New Jersey, 300 Pompton Rd, Wayne, NJ 07470, USA.
Sensors (Basel). 2020 Dec 30;21(1):199. doi: 10.3390/s21010199.
The classification and recommendation system for identifying social networking site (SNS) users' interests plays a critical role in various industries, particularly advertising. Personalized advertisements help brands stand out from the clutter of online advertisements while enhancing relevance to consumers to generate favorable responses. Although most user interest classification studies have focused on textual data, the combined analysis of images and texts on user-generated posts can more precisely predict a consumer's interests. Therefore, this research classifies SNS users' interests by utilizing both texts and images. Consumers' interests were defined using the Curlie directory, and various convolutional neural network (CNN)-based models and recurrent neural network (RNN)-based models were tested for our user interest classification system. In our hybrid neural network (NN) model, CNN-based classification models were used to classify images from users' SNS postings while RNN-based classification models were used to classify textual data. The results of our extensive experiments show that the classification of users' interests performed best when using texts and images together, at 96.55%, versus texts only, 41.38%, or images only, 93.1%. Our proposed system provides insights into personalized SNS advertising research and informs marketers on making (1) interest-based recommendations, (2) ranked-order recommendations, and (3) real-time recommendations.
用于识别社交网络服务 (SNS) 用户兴趣的分类和推荐系统在各个行业中起着至关重要的作用,特别是在广告领域。个性化广告有助于品牌在众多网络广告中脱颖而出,同时增强与消费者的相关性,从而产生有利的反馈。尽管大多数用户兴趣分类研究都集中在文本数据上,但对用户生成帖子中的图像和文本进行综合分析可以更准确地预测消费者的兴趣。因此,本研究通过同时使用文本和图像来对 SNS 用户的兴趣进行分类。消费者的兴趣是使用 Curlie 目录定义的,并且针对我们的用户兴趣分类系统测试了各种基于卷积神经网络 (CNN) 的模型和基于循环神经网络 (RNN) 的模型。在我们的混合神经网络 (NN) 模型中,基于 CNN 的分类模型用于对用户 SNS 帖子中的图像进行分类,而基于 RNN 的分类模型用于对文本数据进行分类。我们广泛的实验结果表明,当同时使用文本和图像进行用户兴趣分类时,分类效果最佳,达到 96.55%,而仅使用文本时为 41.38%,仅使用图像时为 93.1%。我们提出的系统为个性化 SNS 广告研究提供了深入的见解,并为营销人员提供了基于 (1) 兴趣的推荐、(2) 排序推荐和 (3) 实时推荐的信息。