Developing Arabic Sentiment Analysis for Saudi Arabia's Telecommunication Companies using Deep and Ensemble Learning

Sara Manour Almutairi, Fahad Mazead Alotaibi

Resumo


Sentiment analysis is a type of artificial intelligence that uses algorithms to determine whether an opinion is positive or negative. Arabic Sentiment Analysis (ASA) is responsible for assessing people’s opinions, feelings, and responses to a variety of products and services on social and commercial networking sites. In this article, we develop a new Arabic sentiment analysis model for Saudi Arabia's telecommunication companies (Zain, Mobily, and STC). We create and develope a new dataset, called  Sara-Dataset, for analyzing customer opinions towards Saudi Arabian communication firms. using Google Colabs libraries (e.g., Keras), our dataset consists of 50532 tweets. After processing and preparation it becomes 27294 tweets. The dataset is divided into three parts: training, validation, and testing, which each represent 70\%, 10\%, and 20\%, respectively. The proposed model depends on deep learning models: LSTM (long-short-term memory) and CNN (conventional neural network). We evaluate our model using several parameters. The number of training epochs, the loss function, the optimizer (Adadelta, Adagrad, and Adam), batch size, and the ensemble learning approach We evaluate our model in terms of accuracy, precision, F-measure, R-call, ROC, and loss function. When compared to other models, our results indicate significant enhancements. The best accuracy results of the LSTM model with the Adam optimizer and 32-batch size are 94.97\%. The best accuracy result of the CNN model with the Adam optimizer and 32-batch size is 96.83\%. Our future work is to use ensemble learning model.


Palavras-chave


ASA; Deep learning; CoLabs; Sara-Data-set; Accuracy; Prepossessing; LSTM; CNN; ROC; Zain; Mobily

Texto completo:

PDF (English)

Referências


Nassif, Ali Bou, Ashraf Elnagar, Ismail Shahin, and Safaa Henno “Deep learning for Arabic subjective sentiment analysis: Challenges and research opportunities.” Journal of Applied Soft Computing 98 (2020): 106836.

Al−Ayyoub, M., Khamaiseh, A. A., Jararweh, Y., & Al−Kabi, M. N. (2018). “A comprehensive survey of arabic sentiment analysis.” Journal of Information processing management, 56 (2019): 320-342.

Guellil, Imane, Faical Azouaou, and Marcelo Mendoza. "Arabic sentiment analysis: studies, resources, and tools." Social Network Analysis and Mining 9.1 (2019): 1-17.

Abbasi, Ahmed, Hsinchun Chen, and Arab Salem. "Sentiment analysis in multiple languages: Feature selection for opinion classification in web forums." ACM transactions on information systems (TOIS) 26.3 (2008): 1-34.

Mdhaffar, S., Bougares, F., Esteve, Y., & Hadrich-Belguith, L. (2017, April). Sentiment analysis of tunisian dialects: Linguistic ressources and experiments. In Third Arabic Natural Language Processing Workshop (WANLP) (pp. 55-61).

Alayba, Abdulaziz M., Vasile Palade, Matthew England, and Rahat Iqbal. "A combined CNN and LSTM model for arabic sentiment analysis." In International cross-domain conference for machine learning and knowledge extraction, pp. 179-191. Springer, Cham, 2018.

Alayba, Abdulaziz M., Vasile Palade, Matthew England, and Rahat Iqbal. "Arabic language sentiment analysis on health services." In 2017 1st international workshop on arabic script analysis and recognition (asar), pp. 114-118. IEEE, 2017.

Abdullah, Malak, and Mirsad Hadzikadic. "Sentiment analysis on arabic tweets: Challenges to dissecting the language." International Conference on Social Computing and Social Media. Springer, Cham, 2017.

Heikal, Maha, Marwan Torki, and Nagwa El-Makky. "Sentiment analysis of Arabic tweets using deep learning." Procedia Computer Science 142 (2018): 114-122..

Rasool, Abdur, et al. "Twitter sentiment analysis: a case study for apparel brands." Journal of Physics: Conference Series. Vol. 1176. No. 2. IOP Publishing, 2019.

P. Karthika, R. Murugeswari and R. Manoranjithem, "Sentiment Analysis of Social Media Network Using Random Forest Algorithm," 2019 IEEE International Conference on Intelligent Techniques in Control, Optimization and Signal Processing (INCOS), Tamilnadu, India, 2019, pp. 1-5, doi: 10.1109/INCOS45849.2019.8951367.

Sokolova, Marina, Nathalie Japkowicz, and Stan Szpakowicz. "Beyond accuracy, F-score and ROC: a family of discriminant measures for performance evaluation." Australasian joint conference on artificial intelligence. Berlin, Heidelberg: Springer Berlin Heidelberg, 2006.

Sherstinsky, Alex. "Fundamentals of recurrent neural network (RNN) and long short-term memory (LSTM) net-work." Physica D: Nonlinear Phenomena 404 (2020): 132306.

F. Kratzert, D. Klotz, C. Brenner, K. Schulz, M. Herrnegger,"Rainfall–runoff modelling using long short-term memory (LSTM) networks. Hydrology and Earth System Sciences", 22(11), pp. 6005-6022, 2019

Li, Z., Liu, F., Yang, W., Peng, S. and Zhou, J., 2021. A survey of convolutional neural networks: analysis, applications, and prospects. IEEE transactions on neural networks and learning systems.

Bisong, E. and Bisong, E., 2019. Google colaboratory. Building machine learning and deep learning models on google cloud platform: a comprehensive guide for beginners, pp.59-64.

Gulli A, Pal S. Deep learning with Keras. Packt Publishing Ltd; 2017 Apr 26.

Heikal, Maha, Marwan Torki, and Nagwa El-Makky. "Sentiment analysis of Arabic tweets using deep learning." Procedia Computer Science 142 (2018): 114-122..

Aldayel, Haifa K., and Aqil M. Azmi. "Arabic tweets sentiment analysis–a hybrid scheme." Journal of Information Science 42.6 (2016): 782-797.

Elzayady, Hossam, Khaled M. Badran, and Gouda I. Salama. "Arabic Opinion Mining Using Combined CNN-LSTM Models." International Journal of Intelligent Systems & Applications 12.4 (2020).

Altaher, Altyeb. "Hybrid approach for sentiment analysis of Arabic tweets based on deep learning model and features weighting." Int. J. Adv. Appl. Sci 4.8 (2017): 43-49.

Khalil, Enas A. Hakim, Enas MF El Houby, and Hoda Korashy Mohamed. "Deep learning for emotion analysis in Arabic tweets." Journal of Big Data 8.1 (2021): 1-15.

Al-Smadi, Mohammad, Bashar Talafha, Mahmoud Al-Ayyoub, and Yaser Jararweh. "Using long short-term memory deep neural networks for aspect-based sentiment analysis of Arabic reviews." International Journal of Machine Learning and Cybernetics 10, no. 8 (2019): 2163-2175.

Almutairi, Sara Manour, and Fahad Mazead Alotaibi. "A Comparative Analysis for Arabic Sentiment Analysis Models In E-Marketing Using Deep Learning Techniques." Journal of Engineering and Applied Sciences 10.1 (2023): 19-19.




DOI: https://doi.org/10.20397/2177-6652/2023.v23i4.2709

Métricas do artigo

Carregando Métricas ...

Metrics powered by PLOS ALM

Apontamentos

  • Não há apontamentos.




Direitos autorais 2023 Revista Gestão & Tecnologia

Licença Creative Commons
Esta obra está licenciada sob uma licença Creative Commons Atribuição - NãoComercial 4.0 Internacional.