SMS spam detection using BERT and multi-graph convolutional networks

The surge in smartphone usage has significantly increased Short Message Service (SMS) traffic and, consequently, SMS spam, posing risks such as phishing, financial losses, and privacy breaches. Traditional rule-based and blacklist methods fail against evolving spamming techniques, prompting the adop...

Full description

Saved in:
Bibliographic Details
Main Authors: Linjie Shen, Yanbin Wang, Zhao Li, Wenrui Ma
Format: Article
Language:English
Published: KeAi Communications Co., Ltd. 2025-01-01
Series:International Journal of Intelligent Networks
Subjects:
Online Access:http://www.sciencedirect.com/science/article/pii/S2666603025000089
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:The surge in smartphone usage has significantly increased Short Message Service (SMS) traffic and, consequently, SMS spam, posing risks such as phishing, financial losses, and privacy breaches. Traditional rule-based and blacklist methods fail against evolving spamming techniques, prompting the adoption of machine learning and deep learning approaches. However, models like Convolutional Neural Networks and Recurrent Neural Networks struggle to capture global co-occurrence patterns and complex semantics, while transformer-based models like Bidirectional Encoder Representations from Transformers (BERT) lack explicit syntactic and co-occurrence modeling. To address these limitations, we propose the BERT with Triple-Graph Convolutional Networks (BERT-G3CN) model, the first framework to integrate BERT word embeddings with graph embeddings from Co-occurrence, Heterogeneous, and Integrated Syntactic Graphs. This multigraph approach captures diverse features and models both global and local structures using tailored Graph Convolutional Networks. Experiments on two benchmark datasets demonstrate that BERT-G3CN achieves superior accuracy of 99.28 % and 93.78 %, representing an improvement of approximately 2–3 % over competitive baselines.
ISSN:2666-6030