• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

使用来自Transformer的双向编码器表征(BERT)模型进行情感分类的迁移学习

Transfer Learning for Sentiment Classification Using Bidirectional Encoder Representations from Transformers (BERT) Model.

作者信息

Areshey Ali, Mathkour Hassan

机构信息

Department of Computer Science, College of Computer and Information Sciences, King Saud University, Riyadh 11543, Saudi Arabia.

出版信息

Sensors (Basel). 2023 May 31;23(11):5232. doi: 10.3390/s23115232.

DOI:10.3390/s23115232
PMID:37299959
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC10255967/
Abstract

Sentiment is currently one of the most emerging areas of research due to the large amount of web content coming from social networking websites. Sentiment analysis is a crucial process for recommending systems for most people. Generally, the purpose of sentiment analysis is to determine an author's attitude toward a subject or the overall tone of a document. There is a huge collection of studies that make an effort to predict how useful online reviews will be and have produced conflicting results on the efficacy of different methodologies. Furthermore, many of the current solutions employ manual feature generation and conventional shallow learning methods, which restrict generalization. As a result, the goal of this research is to develop a general approach using transfer learning by applying the "BERT (Bidirectional Encoder Representations from Transformers)"-based model. The efficiency of BERT classification is then evaluated by comparing it with similar machine learning techniques. In the experimental evaluation, the proposed model demonstrated superior performance in terms of outstanding prediction and high accuracy compared to earlier research. Comparative tests conducted on positive and negative Yelp reviews reveal that fine-tuned BERT classification performs better than other approaches. In addition, it is observed that BERT classifiers using batch size and sequence length significantly affect classification performance.

摘要

由于来自社交网站的大量网络内容,情感分析目前是最新兴的研究领域之一。对于大多数人来说,情感分析是推荐系统的一个关键过程。一般来说,情感分析的目的是确定作者对某个主题的态度或文档的整体基调。有大量的研究致力于预测在线评论的有用性,并且在不同方法的有效性上产生了相互矛盾的结果。此外,当前的许多解决方案采用手动特征生成和传统的浅层学习方法,这限制了泛化能力。因此,本研究的目标是通过应用基于“BERT(来自变换器的双向编码器表示)”的模型来开发一种使用迁移学习的通用方法。然后通过将其与类似的机器学习技术进行比较来评估BERT分类的效率。在实验评估中,与早期研究相比,所提出的模型在出色的预测和高精度方面表现出卓越的性能。对Yelp上的正面和负面评论进行的对比测试表明,微调后的BERT分类比其他方法表现更好。此外,观察到使用批量大小和序列长度的BERT分类器会显著影响分类性能。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7160/10255967/b6488015d3fc/sensors-23-05232-g010.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7160/10255967/5073a90e199d/sensors-23-05232-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7160/10255967/a29893965b49/sensors-23-05232-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7160/10255967/5c865f059e89/sensors-23-05232-g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7160/10255967/59e4b375b985/sensors-23-05232-g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7160/10255967/f5e6de8153c9/sensors-23-05232-g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7160/10255967/bbedb2f9f3fd/sensors-23-05232-g006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7160/10255967/8b3520a0373a/sensors-23-05232-g007.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7160/10255967/2f81776fc4f0/sensors-23-05232-g008.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7160/10255967/9dd9c86c4a9d/sensors-23-05232-g009.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7160/10255967/b6488015d3fc/sensors-23-05232-g010.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7160/10255967/5073a90e199d/sensors-23-05232-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7160/10255967/a29893965b49/sensors-23-05232-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7160/10255967/5c865f059e89/sensors-23-05232-g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7160/10255967/59e4b375b985/sensors-23-05232-g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7160/10255967/f5e6de8153c9/sensors-23-05232-g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7160/10255967/bbedb2f9f3fd/sensors-23-05232-g006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7160/10255967/8b3520a0373a/sensors-23-05232-g007.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7160/10255967/2f81776fc4f0/sensors-23-05232-g008.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7160/10255967/9dd9c86c4a9d/sensors-23-05232-g009.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7160/10255967/b6488015d3fc/sensors-23-05232-g010.jpg

相似文献

1
Transfer Learning for Sentiment Classification Using Bidirectional Encoder Representations from Transformers (BERT) Model.使用来自Transformer的双向编码器表征(BERT)模型进行情感分类的迁移学习
Sensors (Basel). 2023 May 31;23(11):5232. doi: 10.3390/s23115232.
2
Vaccine sentiment analysis using BERT + NBSVM and geo-spatial approaches.使用BERT + NBSVM和地理空间方法的疫苗情绪分析。
J Supercomput. 2023 May 7:1-31. doi: 10.1007/s11227-023-05319-8.
3
Comparing deep learning architectures for sentiment analysis on drug reviews.比较药物评论情感分析的深度学习架构。
J Biomed Inform. 2020 Oct;110:103539. doi: 10.1016/j.jbi.2020.103539. Epub 2020 Aug 17.
4
A BERT Framework to Sentiment Analysis of Tweets.一种用于推文情感分析的BERT框架。
Sensors (Basel). 2023 Jan 2;23(1):506. doi: 10.3390/s23010506.
5
Multi-Label Classification in Patient-Doctor Dialogues With the RoBERTa-WWM-ext + CNN (Robustly Optimized Bidirectional Encoder Representations From Transformers Pretraining Approach With Whole Word Masking Extended Combining a Convolutional Neural Network) Model: Named Entity Study.基于RoBERTa-WWM-ext + CNN(带有全词掩码扩展的基于变换器预训练方法的稳健优化双向编码器表示与卷积神经网络相结合)模型的医患对话多标签分类:命名实体研究
JMIR Med Inform. 2022 Apr 21;10(4):e35606. doi: 10.2196/35606.
6
Research on sentiment classification for netizens based on the BERT-BiLSTM-TextCNN model.基于BERT-BiLSTM-TextCNN模型的网民情感分类研究
PeerJ Comput Sci. 2022 Jun 8;8:e1005. doi: 10.7717/peerj-cs.1005. eCollection 2022.
7
Text Sentiment Classification Based on BERT Embedding and Sliced Multi-Head Self-Attention Bi-GRU.基于 BERT 嵌入和切片多头自注意力 Bi-GRU 的文本情感分类
Sensors (Basel). 2023 Jan 28;23(3):1481. doi: 10.3390/s23031481.
8
A Fine-Tuned Bidirectional Encoder Representations From Transformers Model for Food Named-Entity Recognition: Algorithm Development and Validation.基于 Transformer 的双向编码器表示模型的精细调整在食品命名实体识别中的应用:算法开发与验证。
J Med Internet Res. 2021 Aug 9;23(8):e28229. doi: 10.2196/28229.
9
Extracting Multiple Worries From Breast Cancer Patient Blogs Using Multilabel Classification With the Natural Language Processing Model Bidirectional Encoder Representations From Transformers: Infodemiology Study of Blogs.使用基于Transformer的自然语言处理模型双向编码器表征的多标签分类从乳腺癌患者博客中提取多种担忧:博客的信息流行病学研究
JMIR Cancer. 2022 Jun 3;8(2):e37840. doi: 10.2196/37840.
10
tRF-BERT: A transformative approach to aspect-based sentiment analysis in the bengali language.tRF-BERT:一种用于孟加拉语基于方面的情感分析的变革方法。
PLoS One. 2024 Sep 20;19(9):e0308050. doi: 10.1371/journal.pone.0308050. eCollection 2024.

引用本文的文献

1
Exploring the Determinants of Patient Experiences Using the Digital Topic Modeling Approach.使用数字主题建模方法探索患者体验的决定因素。
J Nurs Manag. 2025 Jul 11;2025:8183250. doi: 10.1155/jonm/8183250. eCollection 2025.
2
Industrial applications of large language models.大语言模型的工业应用。
Sci Rep. 2025 Apr 21;15(1):13755. doi: 10.1038/s41598-025-98483-1.
3
Multi-dimensional perceptual recognition of tourist destination using deep learning model and geographic information system.基于深度学习模型和地理信息系统的旅游目的地多维感知识别

本文引用的文献

1
Text Sentiment Classification Based on BERT Embedding and Sliced Multi-Head Self-Attention Bi-GRU.基于 BERT 嵌入和切片多头自注意力 Bi-GRU 的文本情感分类
Sensors (Basel). 2023 Jan 28;23(3):1481. doi: 10.3390/s23031481.
2
A BERT Framework to Sentiment Analysis of Tweets.一种用于推文情感分析的BERT框架。
Sensors (Basel). 2023 Jan 2;23(1):506. doi: 10.3390/s23010506.
3
Transfer Learning for Sentiment Analysis Using BERT Based Supervised Fine-Tuning.基于 BERT 的有监督微调的情感分析中的迁移学习。
PLoS One. 2025 Feb 7;20(2):e0318846. doi: 10.1371/journal.pone.0318846. eCollection 2025.
4
Cross-Domain Sentiment Analysis Based on Feature Projection and Multi-Source Attention in IoT.基于特征投影和多源注意力的物联网跨域情感分析
Sensors (Basel). 2023 Aug 20;23(16):7282. doi: 10.3390/s23167282.
Sensors (Basel). 2022 May 30;22(11):4157. doi: 10.3390/s22114157.