Sentiment Analysis of Social Media Posts using FastText Embedding and a Hybrid BiLSTM-Attention-CNN Deep Learning Architecture
DOI:
https://doi.org/10.69968/ijisem.2026v5i497-112Keywords:
BiLSTM, Attention, FastText, Twitter, Sentiment AnalysisAbstract
Looking into how people feel about things online now matters a lot when tracking what crowds think, how brands are seen, or spotting shifts in user actions across large groups. Most current methods lean heavily on models like BERT which are powerful at sorting sentiments yet slow to train and hungry for computing power. Instead of following that path, this study presents a simpler mix; it combines FastText with a BiLSTM layer that sees context both ways, adds a slim attention component that highlights key words, then feeds results into a CNN for final output. It grabs small word fragments with the help of FastText, tracks order in sequences using BiLSTM, uses attention to weigh meaningful parts more, while the CNN pinpoints sharp, useful patterns which others might overlook. Testing took place on two open Twitter sentiment datasets. One holds 74,682 labeled entries split into four categories: Positive, Negative, Neutral, Irrelevant. The other includes around 162,000 instances grouped under three labels: Positive, Negative, Neutral. Instead of relying on heavy transformer designs, the approach here keeps computation leaner but still matches standard accuracy levels. Performance stayed strong using a mix of BiLSTM-Attention for features and CNN for final predictions. Metrics like precision, recall, F1, accuracy, along with confusion matrices, confirmed consistency across tests. Both TensorFlowand PyTorch were used to build the system, allowing insights into differences between coding environments. Results point toward a balanced option that works well without demanding excessive resources for analyzing emotions in vast streams of social network posts.
References
[1] Valenzuela, S., Park, N., & Kee, K. F., Is there social capital in a social network site?: Facebook use and college students’ life satisfaction, trust, and participation, Journal of Computer-Mediated Communication, 14, 875–901, 2009.
[2] Al-Saggaf, Y., & Nielsen, S., Self-disclosure on Facebook among female users and its relationship to feelings of loneliness, Computers in Human Behavior, 36, 460–468, 2014.
[3] Shen, J. H., & Rudzicz, F., Detecting anxiety through Reddit, in Pro-ceedings of the Fourth Workshop on Computational Linguistics and Clin-ical Psychology—From Linguistic Signal to Clinical Reality, 2017.
[4] Wang, Y.-C., Kraut, R., & Levine, J. M., To stay or leave? The relation-ship of emotional and informational support to commitment in online health support groups, in Proceedings of the ACM 2012 Conference on Computer Supported Cooperative Work, ACM, 2012.
[5] Iles, D. C., & Newbold, J., Self- and other-diagnosis in user-led mental health online communities, Qualitative Health Research, 21, 419–428, 2011.
[6] Weinberger, A. H., Gbedemah, M., Martinez, A. M., Nash, D., Galea, S., & Goodwin, R. D., Trends in depression prevalence in the USA from 2005 to 2015: widening disparities in vulnerable groups, Psychological Medicine, 48(8), 1308–1315, 2018.
[7] Cambria, E., & White, B., Jumping NLP curves: a review of natural language processing research, IEEE Computational Intelligence Maga-zine, 9(2), 48–57, 2014.
[8] Picard, R. W., Affective computing: challenges, International Journal of Human–Computer Studies, 59(1–2), 55–64, 2003.
[9] Wang, S., Peng, G., Zheng, Z., & Xu, Z., Capturing emotion distribu-tion for multimedia emotion tagging, IEEE Transactions on Affective Computing, 2019. https://doi.org/10.1109/taffc.2019.2900240
[10] Havigerová, J. M., Haviger, J., Kucera, D., & Hoffmannová, P., Text-based detection of the risk of depression, Frontiers in Psychology, 10, 513, 2019.
[11] Devlin, J., Chang, M. W., Lee, K., & Toutanova, K., BERT: Pre-training of deep bidirectional transformers for language understanding, in Pro-ceedings of NAACL-HLT, 2019.
[12] Rahman, Md. M., et al., RoBERTa-BiLSTM: A context-aware hybrid model for sentiment analysis, IEEE Transactions on Emerging Topics in Computational Intelligence, 2025.
[13] Jonnala, N. S., et al., Leveraging hybrid model for accurate sentiment analysis of Twitter data, Scientific Reports, 15(1), 24438, 2025.
[14] Tembhurne, J. V., Lakhotia, K., & Agrawal, A., Twitter sentiment anal-ysis using ensemble of multi-channel model based on machine learn-ing and deep learning techniques, Knowledge and Information Systems, 67(2), 1045–1071, 2025.
[15] Gauraha, R., Agrawal, A. K., & Dubey, P., Capsule-enhanced RoBERTa for hierarchical sentiment analysis on social media texts, Discover Arti-ficial Intelligence, 2026.
[16] Sun, F., & Chu, N., Text sentiment analysis based on CNN-BiLSTM-Attention model, in Proc. International Conference on Robots & Intel-ligent System (ICRIS), Sanya, China, pp. 749–752, 2020.
[17] Ghosh, T., Al Banna, M. H., Al Nahian, M. J., Uddin, M. N., Kaiser,
[18] M. S., & Mahmud, M., An attention-based hybrid architecture with ex-plainability for depressive social media text detection in Bangla, Expert Systems with Applications, 213, 119007, 2023.
[19] Kim, J., Lee, J., Park, E., & Han, J., A deep learning model for detect-ing mental illness from user content on social media, Scientific Reports, 10(1), 1–6, 2020.
[20] Kour, H., & Gupta, M. K., Depression and suicide prediction using natural language processing and machine learning, in Cyber Security, Privacy and Networking: Proceedings of ICSPN 2021, Springer, pp. 117–128, 2022.
[21] jp797498e, Twitter Entity Sentiment Analysis, Kag-gle, https://www.kaggle.com/datasets/jp797498e/ twitter-entity-sentiment-analysis.
[22] Shahane, S., Twitter Sentiment Dataset, Kaggle, https://www.kaggle. com/datasets/saurabhshahane/twitter-sentiment-dataset.
[23] Bojanowski, P., Grave, E., Joulin, A., & Mikolov, T., Enriching word vectors with subword information, Transactions of the Association for Computational Linguistics, 5, 135–146, 2017.
[24] Mikolov, T., Chen, K., Corrado, G., & Dean, J., Efficient estimation of word representations in vector space, 2013, https://arxiv.org/abs/ 1301.3781.
[25] Zhang, H., Liu, Y., & Zhao, X., RMER-DT: Robust multimodal emotion recognition in conversational contexts based on diffusion and transform-ers, IEEE Transactions on Affective Computing, 2024 (early access).
[26] Zhou, Y., Chen, R., & Wang, S., RAFT: Robust Adversarial Fusion Transformer for multimodal sentiment analysis, Array, 100445, 2023.
[27] Li, W., Huang, M., & Guo, J., CIME: Contextual interaction-based multimodal emotion analysis with enhanced semantic information, In-formation Fusion, 96, 102131, 2023.
[28] Li, F., Xu, H., & Zhang, T., Contrastive-based removal of negative information in multimodal emotion analysis, Neural Networks, 163, 524–538, 2023.
[29] Kaveri, T. S., et al., Multimodal sentiment analysis of Twitter data using early fusion along with a fully connected neural network and multilayer perceptron framework, Engineering, Technology & Applied Science Re-search, 16(1), 32148–32158, 2026.
[30] Wang, J., et al., Towards trustworthy image super-resolution via sym-metrical and recursive artificial neural networks, Pattern Recognition, 145, 109920, 2023.
[31] Chen, D., Zhao, K., & Xu, Y., Knowledge generation and distillation for road segmentation in intelligent transportation systems, IEEE Transac-tions on Intelligent Transportation Systems, 24(8), 8895–8907, 2023.
[32] Khasanah, I. N., Sentiment classification using fastText embedding and deep learning model, Procedia Computer Science, 189, 343–350, 2021.
[33] Singh, A., Kaur, S., & Verma, P., A client-server-based recognition sys-tem: non-contact single/multiple emotional and behavioral state assess-ment methods, Expert Systems with Applications, 222, 119744, 2023.
[34] Huang, L., et al., Dynamic spectral graph anomaly detection, Knowledge-Based Systems, 263, 110271, 2023. αt=∑j=1Texp(ej)exp(et)
Downloads
Published
Issue
Section
License
Copyright (c) 2026 Reeta Bourasi, Sakshi Rai

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Re-users must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use. This license allows for redistribution, commercial and non-commercial, as long as the original work is properly credited.





