IJBTT

Sentiment Analysis of Amazon Review using Improvised Conditional Based Convolutional Neural Network and Word Embedding

Sentiment Analysis of Amazon Review using Improvised Conditional Based Convolutional Neural Network and Word Embedding
	© 2022 by IJETT Journal
	Volume-70 Issue-12
	Year of Publication : 2022
	Author : Madhuri V. Joseph
	DOI : 10.14445/22315381/IJETT-V70I12P220

How to Cite?

Madhuri V. Joseph, "Sentiment Analysis of Amazon Review using Improvised Conditional Based Convolutional Neural Network and Word Embedding," International Journal of Engineering Trends and Technology, vol. 70, no. 12, pp. 194-209, 2022. Crossref, https://doi.org/10.14445/22315381/IJETT-V70I12P220

Abstract
Online shopping websites such as Amazon demands a platform for customers to share their opinion about various products. The objective is to evaluate the sentiment analysis of amazon product reviews using an improvised conditional-based Convolutional Neural Network (CNN) with word embedding. The employed improvised conditional-based CNN makes the corresponding model asynchronous in computation and hence speeds up the training period to a great extent. This conditional random field was applied to capture the dependencies between the neighboring tags to obtain the optimum tag for the whole sequence. Sentiment Analysis is the research process that helps the users to confront their opinions on the products in a review. In this proposed methodology, the data collected from the Amazon dataset contains customer reviews about various products. Before analysis, the collected data undergoes pre-processing, eliminating the unimportant text and keeping only the important information. The classification of sentiment analysis has been considered the major part, followed by extracting the important information. Here conditional-based CNN is used to classify the polarity set of reviews such as positive, negative, or neutral. Based on the reviews, the specified product has been evaluated. The data or the information is retrieved from the database of Amazon reviews of various products by customers. After the data is acquired, the data preprocessing is done. The significant features have been determined using word embedding. Using the proposed conditionalbased CNN approach, the sentiment analysis is evaluated accurately, and the performance is compared with various existing approaches in factors like recall, accuracy, f-measure and precision. The proposed method provides better performance, like identifying the product review. The system obtained an average recall of 0.605, an average F-measure value of 0.7332, and an accuracy of 0.4427, which are comparatively higher than existing traditional methods.

Keywords
CNN-Convolutional Neural Network, Sentiment analysis, NLP-Natural Language Processing, DL-Deep Learning, Decision making, Word embedding

References
[1] Samuel Abalansa, Badr El Mahrad, and Godwin Kofi Vondolia, "The Marine Plastic Litter Issue: A Social-Economic Analysis," Sustainability, vol. 12, no. 20, p. 8677, 2020. Crossref, https://doi.org/10.3390/su12208677
[2] Qurat Tul Ain et al., "Sentiment Analysis Using Deep Learning Techniques : A Review," International Journal of Advanced Computer Science and Applications, vol. 8, no. 6, pp. 424-433, 2017. Crossref, https://doi.org/10.14569/IJACSA.2017.080657
[3] Mohammad AL-Smadi et al., "Using Long Short-Term Memory Deep Neural Networks for Aspect-Based Sentiment Analysis of Arabic Reviews," International Journal of Machine Learning and Cybernetics, vol. 10, no. 8, pp. 2163-2175, 2019. Crossref, https://doi.org/10.1007/s13042-018-0799-4
[4] Nehal Mohamed Ali, Marwa Mostafa Abd El Hamid, and Aliaa Youssif, "Sentiment Analysis for Movies Reviews Dataset Using Deep Learning Models," International Journal of Data Mining & Knowledge Management Process, vol. 9, no. 2, 2019.
[5] Sara Ashour Aljuhani, and Norah Saleh Alghamdi, "A Comparison of Sentiment Analysis Methods on Amazon Reviews of Mobile Phones," International Journal of Advanced Computer Science and Applications, vol. 10, no. 6, pp. 608-617, 2019. Crossref, https://doi.org/10.14569/IJACSA.2019.0100678
[6] Łukasz Augustyniak, Tomasz Kajdanowicz, and Przemysław Kazienko, "Comprehensive Analysis of Aspect Term Extraction Methods using Various Text Embeddings," Computer Speech & Language, vol. 69, 2021. Crossref, https://doi.org/10.1016/j.csl.2021.101217
[7] Mohammad EhsanBasiri et al., "ABCDM: An Attention-Based Bidirectional CNN-RNN Deep Model for Sentiment Analysis," Future Generation Computer Systems, vol. 115, pp. 279-294, 2021. Crossref, https://doi.org/10.1016/j.future.2020.08.005
[8] Rajesh Bose et al., "Sentiment Analysis on Online Product Reviews," Information and Communication Technology for Sustainable Development, Springer, pp. 559-569, 2020. Crossref, https://doi.org/10.1007/978-981-13-7166-0_56
[9] Junyi Chen, Shankai Yan, and Ka-Chun Wong, "Verbal Aggression Detection on Twitter Comments: Convolutional Neural Network for Short-Text Sentiment Analysis," Neural Computing and Applications, vol. 32, no. 15, pp. 10809-10818, 2020. Crossref, https://doi.org/10.1007/s00521-018-3442-0
[10] Xin Dong, and Gerard de Melo, "Cross-Lingual Propagation for Deep Sentiment Analysis," Thirty-Second AAAI Conference on Artificial Intelligence, vol. 32, no. 1, 2018. Crossref, https://doi.org/10.1609/aaai.v32i1.12071
[11] Elshrif Ibrahim Elmurngi, and Abdelouahed Gherbi, "Unfair Reviews Detection on Amazon Reviews Using Sentiment Analysis with Supervised Learning Techniques," Journal of Computer Science, vol. 14, no. 5, pp. 714-726, 2018. Crossref, https://doi.org/10.3844/jcssp.2018.714.726
[12] Yang Gao et al., "Alexa, My Love: Analyzing Reviews of Amazon Echo," 2018 IEEE SmartWorld, Ubiquitous Intelligence & Computing, Advanced & Trusted Computing, Scalable Computing & Communications, Cloud & Big Data Computing, Internet of People and Smart City Innovation (SmartWorld/SCALCOM/UIC/ATC/CBDCom/IOP/SCI), pp. 372-380, 2018. Crossref, https://doi.org/10.1109/SmartWorld.2018.00094
[13] Ziyu Guan et al., "Weakly-Supervised Deep Learning for Customer Review Sentiment Classification," Proceedings of the TwentyFifth International Joint Conference on Artificial Intelligence, pp. 3719-3725, 2016.
[14] Jihun Hong, Alex Nam, and Austin Cai, "Multi-Class Text Sentiment Analysis," 2019.
[15] Rajkumar S. Jagdale, Vishal S. Shirsat, and Sachin N. Deshmukh, "Sentiment Analysis on Product Reviews using Machine Learing Techniques," Cognitive Informatics and Soft Computing, Springer, pp. 639-647, 2019. Crossref, https://doi.org/10.1007/97 8-981-13-0617-4_61
[16] Vinay Kumar Jain, Shishir Kumar, and Prabhat Mahanti, "Sentiment Recognition in Customer Reviews Using Deep Learning," International Journal of Enterprise Information Systems, vol. 14, no. 2, pp. 77-86, 2018. Crossref, https://doi.org/10.4018/IJEIS.201804010
[17] Zhao Jianqiang, Gui Xiaolin, and Zhang Xuejuna, "Deep Convolution Neural Networks for Twitter Sentiment Analysis," IEEE Access, vol. 6, pp. 23253-23260, 2018. Crossref, https://doi.org/10.1109/ACCESS.2017.2776930
[18] Erick Kauffmann et al., "A Framework for Big Data Analytics in Commercial Social Networks: A Case Study on Sentiment Analysis and Fake Review Detection for Marketing Decision-Making," Industrial Marketing Management, vol. 90, pp. 523-537, 2020. Crossref, https://doi.org/10.1016/j.indmarman.2019.08.003
[19] Hannah Kim, and Young-Seob Jeong, "Sentiment Classification Using Convolutional Neural Networks," Applied Sciences, vol. 9, no. 11, p. 2347, 2019. Crossref, https://doi.org/10.3390/app9112347
[20] Konstantinas Korovkinas, Paulius Danenas, and Gintautas Garsva, "SVM and Na¨ ýve Bayes Classification Ensemble Method for Sentiment Analysis," Baltic Journal of Modern Computing, vol. 5, no. 4, pp. 398-409, 2017. Crossref, http://dx.doi.org/10.22364/bjmc.2017.5.4.06
[21] Konstantinas Korovkinas, Paulius Danenas, and Gintautas Garsva, "SVM and k-Means Hybrid Method for Textual Data Sentiment Analysis," Baltic Journal of Modern Computing, vol. 7, no. 1, pp. 47-60, 2019. Crossref, https://doi.org/10.22364/bjmc.2019.7.1.04
[22] Dong-yub Lee, Jae-Choon Jo, and Heui-Seok Lim, "User Sentiment Analysis on Amazon Fashion Product Review using Word Embedding," Journal of the Korea Convergence Society, vol. 8, no. 4, pp. 1-8, 2017. Crossref, https://doi.org/10.15207/JKCS.2017.8.4.001
[23] Ruijun Liu et al., "A Survey of Sentiment Analysis Based on Transfer Learning," IEEE Access, vol. 7, pp. 85401-85412, 2019. Crossref, https://doi.org/10.1109/ACCESS.2019.2925059
[24] Trupthi Mandhula, Suresh Pabboju, and Narsimha Gugulotu, "Predicting the Customer's Opinion on Amazon Products Using Selective Memory Architecture-Based Convolutional Neural Network," The Journal of Supercomputing, vol. 76, no. 8, pp. 5923- 5947, 2020. Crossref, https://doi.org/10.1007/s11227-019-03081-4
[25] Shervin Minaee, Elham Azimi, and AmirAli Abdolrashidi, "Deep-Sentiment: Sentiment Analysis using Ensemble of CNN and BiLSTM Models," arXiv preprint arXiv:1904.04206, 2019. Crossref, https://doi.org/10.48550/arXiv.1904.04206
[26] Makoto Okada, Hidekazu Yanagimoto, and Kiyota Hashimoto, "Sentiment Classification with Gated CNN for Customer Reviews," 2018 International Joint Symposium on Artificial Intelligence and Natural Language Processing (iSAI-NLP), pp. 1-5, 2018. Crossref, https://doi.org/10.1109/iSAI-NLP.2018.8692959
[27] Jagadeesh Panthati et al., "Sentiment Analysis of Product Reviews using Deep Learning," 2018 International Conference on Advances in Computing, Communications and Informatics (ICACCI), pp. 2408-2414, 2018. Crossref, https://doi.org/10.1109/ICACCI.2018.8554551
[28] Park Ho-yeon, and Kim Kyoung-jae, "Sentiment Analysis of Movie Reviews Using Integrated CNN-LSTM Mode," Journal of Intelligence and Information Systems, vol. 25, no. 4, pp. 141-154, 2019. Crossref, https://doi.org/10.13088/jiis.2019.25.4.141
[29] Gabriele Pergola, and Lin Gui Yulan He, "TDAM: A Topic-Dependent Attention Model for Sentiment Analysis," Information Processing & Management, vol. 56, no. 6, p. 102084, 2019. Crossref, https://doi.org/10.1016/j.ipm.2019.102084
[30] Kareem Mohamed, and Ümmü Altan Bayraktar, "Analyzing the Role of Sentiment Analysis in Public Relations: Brand Monitoring and Crisis Management," SSRG International Journal of Humanities and Social Science, vol. 9, no. 3, pp. 116-126, 2022. Crossref, https://doi.org/10.14445/23942703/IJHSS-V9I3P116
[31] Alec Radford, Rafal Jozefowicz, and Ilya Sutskever, "Learning to Generate Reviews and Discovering Sentiment," arXiv preprint arXiv:1704.01444, 2017. Crossref, https://doi.org/10.48550/arXiv.1704.01444
[32] Sujata Rani, and Parteek Kumar, "Deep Learning Based Sentiment Analysis using Convolution Neural Network," Arabian Journal for Science and Engineering, vol. 44, no. 4,pp. 3305-3314, 2019. Crossref, https://doi.org/10.1007/s13369-018-3500-z
[33] Abhilasha Singh Rathora, Amit Agarwal, and Preeti Dimri, "Comparative Study of Machine Learning Approaches for Amazon Reviews," Procedia Computer Science, vol. 132, pp. 1552-1561, 2018. Crossref, https://doi.org/10.1016/j.procs.2018.05.119
[34] H. Sankar et al., "Intelligent Sentiment Analysis Approach using Edge Computing‐Based Deep Learning Technique," Software: Practice and Experience, vol. 50, no. 5, pp. 645-657, 2020. Crossref, https://doi.org/10.1002/spe.2687
[35] Afreen Jaha et al., "Text Sentiment Analysis Using Naïve Baye's Classifier," International Journal of Computer Trends and Technology, vol. 68, no. 4, pp. 261-265, 2020. . Crossref, https://doi.org/10.14445/22312803/IJCTT-V68I4P141
[36] Sunil Saumya, Jyoti Prakash Singh, and Yogesh K. Dwivedi, "Predicting the Helpfulness Score of Online Reviews using Convolutional Neural Network," Soft Computing, vol. 24, pp. 10989-11005, 2019. Crossref, https://doi.org/10.1007/s00500-019- 03851-5
[37] Sungyong Seo et al., "Representation Learning of Users and Items for Review Rating Prediction Using Attention-Based Convolutional Neural Network," International Workshop on Machine Learning Methods for Recommender Systems, 2017.
[38] K. Kavitha, and Suneetha Chittineni, "Efficient Sentimental Analysis using Hybrid Deep Transfer Learning Neural Network," International Journal of Engineering Trends and Technology, vol. 70, no. 10, pp. 155-165, 2022. Crossref, https://doi.org/10.14445/22315381/IJETT-V70I10P216
[39] Nishit Shrestha, and Fatma Nasoz, "Deep Learning Sentiment Analysis of Amazon.Com Reviews and Ratings," International Journal on Soft Computing, Artificial Intelligence and Applications, vol. 8, no. 1, 2019.
[40] Jaspreet Singh, Gurvinder Singh, and Rajinder Singh, "Optimization of Sentiment Analysis using Machine Learning Classifiers," Human-Centric Computing and Information Sciences, vol. 7, no. 1, p. 32, 2017. Crossref, https://doi.org/10.1186/s13673-017-0116-3
[41] Quoc-Tuan Truong, and Hady W. Lauw, "Visual Sentiment Analysis for Review Images with Item-Oriented and User-Oriented CNN," Proceedings of the 25th ACM International Conference on Multimedia, pp. 1274-1282, 2017. Crossref, https://doi.org/10.1145/3123266.3123374
[42] Madhuri V. Joseph, "A Bi-LSTM and GRU Hybrid Neural Network with BERT Feature Extraction for Amazon Textual Review Analysis," International Journal of Engineering Trends and Technology, vol. 70, no. 5, pp. 1-8, 2022. Crossref, https://doi.org/10.14445/22315381/IJETT-V70I5P216
[43] Vinh D. Van, Thien Thai, and Minh-Quoc Nghiem, "Combining Convolution and Recursive Neural Networks for Sentiment Analysis," Proceedings of the Eighth International Symposium on Information and Communication Technology, 2017. Crossref, https://doi.org/10.1145/3155133.3155158
[44] G Vinodhini, and R.M Chandrasekaran, "A Comparative Performance Evaluation of Neural Network Based Approach for Sentiment Classification of Online Reviews," Journal of King Saud University-Computer and Information Sciences, vol. 28, no. 1, pp. 2-12, 2016. Crossref, https://doi.org/10.1016/j.jksuci.2014.03.024
[45] Hu Xu et al., "Double Embeddings and CNN-Based Sequence Labeling for Aspect Extraction," Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, vol. 2, pp. 592-598, 2018. Crossref, https://doi.org/10.18653/v1/P18-2094
[46] Hu Xu et al., "Bert Post-Training for Review Reading Comprehension and Aspect-Based Sentiment Analysis," arXiv preprint arXiv:1904.02232, 2019. Crossref, https://doi.org/10.48550/arXiv.1904.02232
[47] Wei Xue, and Tao Li, "Aspect-Based Sentiment Analysis with Gated Convolutional Networks," Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, vol. 1, pp. 2514-2523, 2018. Crossref, https://doi.org/10.18653/v1/P18- 1234
[48] Ashima Yadav, and Dinesh Kumar Vishwakarma, "Sentiment Analysis using Deep Learning Architectures: A Review," Artificial Intelligence Review, vol. 53, pp. 4335-4385, 2020. Crossref, https://doi.org/10.1007/s10462-019-09794-5
[49] Kaustubh Yadav, "A Comprehensive Survey on Aspect-Based Sentiment Analysis," arXiv preprint arXiv:2006.04611, 2020. Crossref, https://doi.org/10.48550/arXiv.2006.04611