Sentiment Analysis of COVID-19 Public Activity Restriction (PPKM) Impact using BERT Method

Sentiment Analysis of COVID-19 Public Activity Restriction (PPKM) Impact using BERT Method
  IJETT-book-cover           
  
© 2022 by IJETT Journal
Volume-70 Issue-12
Year of Publication : 2022
Author : Fransiscus, Abba Suganda Girsang
DOI : 10.14445/22315381/IJETT-V70I12P226

How to Cite?

Fransiscus, Abba Suganda Girsang, "Sentiment Analysis of COVID-19 Public Activity Restriction (PPKM) Impact using BERT Method," International Journal of Engineering Trends and Technology, vol. 70, no. 12, pp. 281-288, 2022. Crossref, https://doi.org/10.14445/22315381/IJETT-V70I12P226

Abstract
Covid-19 has grown rapidly in all parts of the world and is considered an international disaster because of its wide-reaching impact. The impact of Covid-19 has spread to Indonesia, especially in the slowdown in economic growth. This was influenced by the implementation of Community Activity Restrictions (PPKM) which limited community economic activities. This study analyzes the mapping of public sentiment towards PPKM policies in Indonesia during the pandemic based on Twitter data. Knowing the mapping of public sentiment regarding PPKM is expected to help stakeholders in the policy evaluation process for each region. The method used is BERT with IndoBERT specific model. The results showed the evaluation value of the IndoBERT f-1 score reached 84%, precision 86%, and recall 84%. Meanwhile, f-1 scores 70%, 72% precision, and 70% recall for evaluating the use of SVM. Multinominal Naïve Bayes evaluation shows an f-1 score of 83%, precision of 78%, and recall of 80%. In conclusion, the BERT method with the IndoBERT model is proven to be higher than classical methods such as SVM and Multinominal Naïve Bayes.

Keywords
Sentiment analysis, PPKM, BERT, SVM, Naïve bayes.

References
[1] Dina Fitria Murad et al., “The Impact of the COVID-19 Pandemic in Indonesia (Face to Face Versus Online Learning),” in 2020 Third International Conference on Vocational Education and Electrical Engineering (ICVEE), pp. 1–4, 2020. Crossref, https://doi.org/10.1109/ICVEE50212.2020.9243202
[2] Muhyiddin Muhyiddin, and Hanan Nugroho, “A Year of Covid-19: A Long Road to Recovery and Acceleration of Indonesia’s Development,” The Indonesian Journal of Development Planning, vol. 5, no. 1, pp. 1–19, 2021. Crossref, https://doi.org/10.36574/jpp.v5i1.181
[3] Digitalization of MSMEs in the Midst of the Covid-19 Pandemic, Katadata, 2020. [Online]. Available: https://Katadata.Co.Id/Umkm
[4] A. F. Thaha, “Impact of Covid-19 on MSMEs in Indonesia,” Jurnal Lentera Bisnis, vol. 2, no. 1, pp. 147–153, 2020. [Online]. Available: https://ejournals.umma.ac.id/index.php/brand
[5] Eki Aidio Sukma et al., “Sentiment Analysis of the New Indonesian Government Policy (Omnibus Law) on Social Media Twitter,” 2020 International Conference on Informatics, Multimedia, Cyber and Information System (ICIMCIS), pp. 153–158, 2020. Crossref, https://doi.org/10.1109/ICIMCIS51567.2020.9354287
[6] Digital 2021: The Latest Insights into the State of Digital, We Are Social, 2021. [Online]. Available: https://Wearesocial.com/Blog/2021/01/Digital-2021-the-Latest-Insights-Into-the-State-of-Digital
[7] Afreen Jaha et al., "Text Sentiment Analysis Using Naïve Baye’s Classifier," International Journal of Computer Trends and Technology, vol. 68, no. 4, pp. 261-265, 2020. Crossref, https://doi.org/10.14445/22312803/IJCTT-V68I4P141
[8] Himanshu Thakur, and Aman Kumar Sharma, "Supervised Machine Learning Classifiers: Computation of Best Result of Classification Accuracy," International Journal of Computer Trends and Technology, vol. 68, no. 10, pp. 1-8, 2020. Crossref, https://doi.org/10.14445/22312803/IJCTT-V68I10P101
[9] Hamed Jelodar et al., “Deep Sentiment Classification and Topic Discovery on Novel Coronavirus or COVID-19 Online Discussions: NLP Using LSTM Recurrent Neural Network Approach,” IEEE Journal of Biomedical and Health Informatics, vol. 24, no. 10, pp. 2733–2742, 2020. Crossref, https://doi.org/10.1109/JBHI.2020.3001216
[10] Mehryar Mohri, Afshin Rostamizadeh, and Ameet Talwalkar, Foundations of Machine Learning, MIT Press, 2018.
[11] Jacob Devlin et al., “Bert: Pre-Training of Deep Bidirectional Transformers for Language Understanding,” Proceedings of NAACL-HLT 2019, pp. 4171-4186, 2018. Crossref, https://doi.org/10.48550/arXiv.1810.04805
[12] Quoc Thai Nguyen et al., “Fine-Tuning Bert for Sentiment Analysis of Vietnamese Reviews,” in 2020 7th NAFOSTED Conference on Information and Computer Science (NICS), pp. 302–307, 2020. Crossref, https://doi.org/10.1109/NICS51282.2020.9335899
[13] Tianyi Wang et al., “COVID-19 Sensing: Negative Sentiment Analysis on Social Media in China via BERT Model,” IEEE Access, vol. 8, P. 1, 2020, Crossref, https://doi.org/10.1109/ACCESS.2020.3012595
[14] Liviu-Adrian Cotfas et al., “The Longest Month: Analyzing Covid-19 Vaccination Opinions Dynamics From Tweets in the Month Following the First Vaccine Announcement,” IEEE Access, vol. 9, pp. 33203–33223, 2021. Crossref, https://doi.org/10.1109/access.2021.3059821
[15] Afreen Jaha et al., “Text Sentiment Analysis Using Naïve Baye’s Classifier,” International Journal of Computer Trends and Technology, vol. 68, no. 4, pp. 261-265, 2020. Crossref, 10.14445/22312803/IJCTT-V68I4P141
[16] Kuncahyo Setyo Nugroho et al., “BERT Fine-Tuning for Sentiment Analysis on Indonesian Mobile Apps Reviews,” in 6th International Conference on Sustainable Information Engineering and Technology 2021, pp. 258–264, 2021. Crossref, https://doi.org/10.48550/arXiv.2107.06802
[17] Fajri Koto et al., “Indolem and Indobert: A Benchmark Dataset and Pre-Trained Language Model for Indonesian NLP,” Proceedings of the 28th International Conference on Computational Linguistics, Arxiv Preprint Arxiv:2011.00677, pp. 757-770, 2020. Crossref, https://doi.org/10.48550/arXiv.2011.00677
[18] Saurav Pradha et al., “Effective Text Data Preprocessing Technique for Sentiment Analysis in Social Media Data,” 2019 11th International Conference on Knowledge and Systems Engineering (KSE), pp. 1–8, 2019. Crossref, https://doi.org/10.1109/KSE.2019.8919368
[19] Pooja Mehta, and Dr.Sharnil Pandya, “A Review on Sentiment Analysis Methodologies, Practices and Applications,” International Journal of Scientific and Technology Research, vol. 9, no. 2, pp. 601–609, 2020.
[20] Sarojadevi Palani, Prabhu Rajagopal, and Sidharth Pancholi, “T-BERT--Model for Sentiment Analysis of Micro-Blogs Integrating Topic Model and BERT,” Arxiv Preprint Arxiv:2106.01097, pp. 1-9, 2021. Crossref, https://doi.org/10.48550/arXiv.2106.01097
[21] Jay-Ar Lalata, Bobby Dioquino Gerardo, and Ruji Medina, “A Sentiment Analysis Model for Faculty Comment Evaluation Using Ensemble Machine Learning Algorithms,” Proceedings of the 2019 International Conference on Big Data Engineering, pp. 68–73, 2019. Crossref, https://doi.org/10.1145/3341620.3341638
[22] Sonia Saini et al., “Sentiment Analysis on Twitter Data Using R,” 2019 International Conference on Automation, Computational and Technology Management (ICACTM), 2019, pp. 68–72. Crossref, https://doi.org/10.1109/ICACTM.2019.8776685
[23] RavinderAhuja et al., “The Impact of Features Extraction on the Sentiment Analysis,” Procedia Comput Science, vol. 152, pp. 341–348, 2019. Crossref, https://doi.org/10.1016/j.procs.2019.05.008
[24] P. Karthika, R. Murugeswari, and R. Manoranjithem, “Sentiment Analysis of Social Media Network Using Random Forest Algorithm,” 2019 IEEE International Conference on Intelligent Techniques in Control, Optimization and Signal Processing (INCOS), pp. 1–5, 2019. Crossref, https://doi.org/10.1109/INCOS45849.2019.8951367
[25] Tiara Lailatul Nikmah et al., “Comparison of LSTM, SVM, and Naive Bayes for Classifying Sexual Harassment Tweets,” Journal of Soft Computing Exploration, vol. 3, no. 2, pp. 131–137, 2022. Crossref, https://doi.org/10.52465/joscex.v3i2.85
[26] Usman Naseem et al., “Covidsenti: A Large-Scale Benchmark Twitter Data Set for COVID-19 Sentiment Analysis,” IEEE Trans Comput Social System, vol. 8, no. 4, pp. 1003–1015, 2021. Crossref, https://doi.org/10.1109/TCSS.2021.3051189
[27] Heru Suroso et al., “Sentiment Analysis on ‘Homecoming Tradition Restriction’ Policy on Twitter,” 2020 3rd International Conference on Computer and Informatics Engineering (IC2IE) pp. 75–79, 2020. Crossref, https://doi.org/10.1109/IC2IE50715.2020.9274609
[28] Maryum Bibi et al., “A Cooperative Binary-Clustering Framework Based on Majority Voting for Twitter Sentiment Analysis,” IEEE Access, vol. 8, pp. 68580–68592, 2020. Crossref, https://doi.org/10.1109/ACCESS.2020.2983859
[29] Meylan Wongkar, and Apriandy Angdresey, “Sentiment Analysis Using Naive Bayes Algorithm of the Data Crawler: Twitter,” in 2019 Fourth International Conference on Informatics and Computing (ICIC), pp. 1–5, 2019. Crossref, https://doi.org/10.1109/ICIC47613.2019.8985884
[30] M. K. Gupta, and P. Chandra, “A Comprehensive Survey of Data Mining,” International Journal of Information Technology, vol. 12, no. 4, pp. 1243–1257, 2020. Crossref, https://doi.org/10.1007/s41870-020-00427-7
[31] Jose Angel Diaz-Garcia et al., “Non-Query-Based Pattern Mining and Sentiment Analysis for Massive Microblogging Online Texts,” IEEE Access, vol. 8, pp. 78166–78182, 2020. Crossref, https://doi.org/10.1109/ACCESS.2020.2990461
[32] Rohitash Chandra, and Ritij Saini, “Biden vs Trump: Modeling US General Elections Using BERT Language Model,” IEEE Access, vol. 9, pp. 128494–128505, 2021. Crossref, https://doi.org/10.1109/ACCESS.2021.3111035