Persian Slang Text Conversion to Formal and Deep Learning of Persian Short Texts on Social Media for Sentiment Classification

Khazeni, M.; Heydari, M.; Albadvi, A.

doi:10.22061/jecei.2024.10745.731

Articles in Press

Document Type : Original Research Paper

Authors

Department of IT Engineering, Faculty of Industrial and Systems Engineering, Tarbiat Modares University, Tehran, Iran.

https://doi.org/10.22061/jecei.2024.10745.731

Abstract

Background and Objectives: The lack of a suitable tool for the analysis of conversational texts in Persian language has made various analyzes of these texts, including Sentiment Analysis, difficult. In this research, it has we tried to make the understanding of these texts easier for the machine by providing PSC, Persian Slang Convertor, a tool for converting conversational texts into formal ones, and by using the most up-to-date and best deep learning methods along with the PSC, the sentiment learning of short Persian language texts for the machine in a better way.
Methods: Be made More than 10 million unlabeled texts from various social networks and movie subtitles (as dialogue texts) and about 10 million news texts (as official texts) have been used for training unsupervised models and formal implementation of the tool. 60,000 texts from the comments of Instagram social network users with positive, negative, and neutral labels are considered as supervised data for training the emotion classification model of short texts. The latest methods such as LSTM, CNN, BERT, ELMo, and deep processing techniques such as learning rate decay, regularization, and dropout have been used. LSTM has been utilized in the research, and the best accuracy has been achieved using this method.
Results: Using the official tool, 57% of the words of the corpus of conversation were converted. Finally, by using the formalizer, FastText model and deep LSTM network, the accuracy of 81.91 was obtained on the test data.
Conclusion: In this research, an attempt was made to pre-train models using unlabeled data, and in some cases, existing pre-trained models such as ParsBERT were used. Then, a model was implemented to classify the Sentiment of Persian short texts using labeled data.

Keywords

Main Subjects

Natural Language Processing

Open Access

This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit: http://creativecommons.org/licenses/by/4.0/

Publisher’s Note

JECEI Publisher remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Publisher

Shahid Rajaee Teacher Training University

References

[1] N. Armin, M. Shamsfard, “converting Persian colloquium text to formal by n-grams,” in Computer Society of Iran. for statistical machine translation, in Proc. 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP): 1724-1734, 2011.

[2] M. Heydari, “Sentiment analysis challenges in persian language,” arXiv Prepr. arXiv1907.04407, 2019.

[3] S. Zobeidi, M. Naderan, S. E. Alavi, “Opinion mining in Persian language using a hybrid feature extraction approach based on convolutional neural network,” Multimed. Tools Appl., 78(22): 32357-32378, 2019.

[4] B. Liu, L. Zhang, “A survey of opinion mining and sentiment analysis,” in Mining Text Data, C. C. Aggarwal and C. Zhai, Eds. Boston, MA: Springer US, pp. 415-463, 2012.

[5] B. Pang, L. Lee, “Opinion mining and sentiment analysis,” Found. Trends Inf. Retr., 2(1–2): 1-135, 2008.

[6] G. Song, Y. Ye, X. Du, X. Huang, S. Bie, “Short text classification: a survey,” J. Multimed., 9(5): 635-643, 2014.

[7] A. Naemi, M. Mansourvar, M. Naemi, B. Damirchilu, A. Ebrahimi, U. Kock Wiil, “Informal-to-formal word conversion for persian language using natural language processing techniques,” ACM Int. Conf. Proceeding Ser., 19: 1-7, 2021.

[8] V. Tajalli, F. Kalantari, M. Shamsfard, "Developing an informal-formal persian corpus," arXiv preprint arXiv:2308.05336, 2023.

[9] M. S. Rasooli, et al., "Automatic standardization of colloquial persian," arXiv preprint arXiv:2012.05879, 2020.

[10] M. Mazoochi, et al., "Constructing colloquial dataset for persian sentiment analysis of social microblogs," arXiv preprint arXiv:2306.12679, 2023.

[11] M. Adibian, S. Momtazi, "Using transformer-based neural models for converting informal to formal text in persian," Lang. Ling., 18(35): 47-69, 2022.

[12] Z. Bokaee Nezhad, M. A. Deihimi, "Sarcasm detection in persian," J. Inf. Commun. Technol., 20(1): 1-20, 2021.

[13] P. Golazizian et al., "Irony detection in Persian language: A transfer learning approach using emoji prediction," in Proc. Twelfth Language Resources and Evaluation Conference, 2020.

[14] M. Mirzarezaee, M. M. Pedram, "Improving polarity identification in sentiment analysis using sarcasm detection and machine learning algorithms in persian tweets," J. Inf. Commun. Technol. 53(14): 14-23, 2023.

[15] F. Najafi-Lapavandani, M. H. Shirali-Shahreza, “Humor detection in persian: a transformers-based approach,” Int. J. Inf. Commun. Technol. Res., 15(1): 56-62, 2023.

[16] A. K. Sharma, S. Chaurasia, D. K. Srivastava, “Sentimental short sentences classification by using CNN deep learning model with fine tuned Word2Vec,” Procedia Comput. Sci., 167: 1139-1147, 2020.

[17] P. F. Muhammad, R. Kusumaningrum, A. Wibowo, “Sentiment analysis using Word2vec and long short-term memory (LSTM) for Indonesian hotel reviews,” Procedia Comput. Sci., 179: 728-735, 2021.

[18] L. Ouchene, S. Bessou, “FastText embedding and LSTM for sentiment analysis: An empirical study on algerian tweets,” in Proc. 2023 International Conference on Information Technology (ICIT): 51-55, 2023.

[19] A. Patel, A. Kapoor, M. Mahato, S. Raut, B. B. Sinha, “Enhancing rumour detection: A hybrid deep learning approach with ELMo embeddings & CNN,” in Proc. 2024 IEEE International Conference on Interdisciplinary Approaches in Technology and Management for Social Innovation (IATMSI), 2: 1-6, 2024.

[20] M. Farahani, M. Gharachorloo, M. Farahani, M. Manthouri, “ParsBERT: Transformer-based model for persian language understanding,” ArXiv, vol. abs/2005.1, 2020.

[21] T. Pires, E. Schlinger, D. Garrette, “How multilingual is multilingual BERT?,” arXiv Prepr. arXiv1906.01502, 2019.

[22] S. Mihi, B. Ait Benali, N. Laachfoubi, “Automatic sarcasm detection in Arabic tweets: resources and approaches,” J. Intell. & Fuzzy Syst., 45(6): 9483-9497, 2023.

[23] C. I. Eke, A. A. Norman, L. Shuib, “Context-based feature technique for sarcasm identification in benchmark datasets using deep learning and BERT model,” IEEE Access, 9: 48501-48518, 2021.

[24] F. Shatnawi, M. Abdullah, M. Hammad, M. Al-Ayyoub, “Comprehensive study of pre-trained language models: detecting humor in news headlines,” Soft Comput., 27(5): 2575-2599, 2023.

[25] I. Annamoradnejad, G. Zoghi, “ColBERT: Using BERT sentence embedding in parallel neural networks for computational humor,” Expert Syst. Appl., 249: 123685, 2024.

[26] S. M. Sadjadi, Z. Rajabi, L. Rabiei, M. S. Moin, “FarSSiBERT: A novel transformer-based model for semantic similarity measurement of persian social networks informal texts,” arXiv Prepr. arXiv2407.19173, 2024.

[27] P. Falakaflaki, M. Shamsfard, “Formality style transfer in persian,” arXiv Prepr. arXiv2406.00867, 2024.

[28] S. M. S. Dashti, A. Khatibi Bardsiri, M. Jafari Shahbazzadeh, “PERCORE: A deep learning-based framework for persian spelling correction with phonetic analysis,” Int. J. Comput. Intell. Syst., 17(1): 1-23, 2024.

[29] E. Kebriaei et al., “Persian offensive language detection,” Mach. Learn., 113(7): 4359-4379, 2024.

[30] Y. Z. Vakili, A. Fallah, S. Zakeri, “Enhancing sentiment analysis of persian tweets: A transformer-based approach,” in Proc. 10th International Conference on Web Research (ICWR): 226-230, 2024.

LETTERS TO EDITOR

Journal of Electrical and Computer Engineering Innovations (JECEI) welcomes letters to the editor for the post-publication discussions and corrections which allows debate post publication on its site, through the Letters to Editor. Letters pertaining to manuscript published in JECEI should be sent to the editorial office of JECEI within three months of either online publication or before printed publication, except for critiques of original research. Following points are to be considering before sending the letters (comments) to the editor.

[1] Letters that include statements of statistics, facts, research, or theories should include appropriate references, although more than three are discouraged.

[2] Letters that are personal attacks on an author rather than thoughtful criticism of the author’s ideas will not be considered for publication.

[3] Letters can be no more than 300 words in length.

[4] Letter writers should include a statement at the beginning of the letter stating that it is being submitted either for publication or not.

[5] Anonymous letters will not be considered.

[6] Letter writers must include their city and state of residence or work.

[7] Letters will be edited for clarity and length.

Name *

Email Address *

Affiliation *

Comments *

Security Code *

Journal of Electrical and Computer Engineering Innovations (JECEI)

Persian Slang Text Conversion to Formal and Deep Learning of Persian Short Texts on Social Media for Sentiment Classification

References

References

Send comment about this article

Articles in Press, Accepted Manuscript
Available Online from 18 August 2024

Persian Slang Text Conversion to Formal and Deep Learning of Persian Short Texts on Social Media for Sentiment Classification

References

References

Send comment about this article

Articles in Press, Accepted Manuscript Available Online from 18 August 2024

Articles in Press, Accepted Manuscript
Available Online from 18 August 2024