Comparative Evaluation of Machine Learning Classifiers for SMS Spam Detection with Optimized Feature Extraction

Olumide Simeon Ogunnusi

doi:10.63363/aijfr.2026.v07i05.6200

Comparative Evaluation of Machine Learning Classifiers for SMS Spam Detection with Optimized Feature Extraction

Author(s)	Olumide Simeon Ogunnusi
Country	Nigeria
Abstract	The proliferation of mobile communication has led to a significant rise in unsolicited SMS spam messages, posing threats to user privacy, security, and overall mobile experience. Existing rule-based spam filters are increasingly inadequate against evolving spammer tactics, necessitating more adaptive and accurate detection approaches. This study investigates the application of machine learning techniques to text-based SMS spam detection using the UCI SMS Spam Collection Dataset, which comprises 5,572 messages with a pronounced class imbalance of 86.6% ham to 13.4% spam. Three classifiers were evaluated: Multinomial Naive Bayes, Support Vector Machines, and Random Forest, combined with TF-IDF feature extraction and bigram analysis. Hyperparameter optimization was performed via grid search, and model robustness was assessed through 5-fold cross-validation. The Multinomial Naive Bayes classifier with optimized TF-IDF parameters achieved 99% accuracy on the held-out test set, with a spam-class precision of 99.28%, recall of 92.61%, and an F1-score of 95.83%. Cross-validation yielded a mean F1-score of 0.9556, confirming consistent generalization. Feature importance analysis identified promotional terms such as "claim," "prize," and "have won" as the strongest spam indicators, while informal conversational terms were strongly predictive of legitimate messages. These findings demonstrate that lightweight probabilistic classifiers, when paired with effective feature engineering, can achieve near-perfect spam detection performance and offer a practical, interpretable foundation for real-world SMS filtering systems.
Keywords	SMS Spam Detection, Machine Learning, TF-IDF, Naive Bayes, Text Classification, Natural Language Processing
Field	Computer > Artificial Intelligence / Simulation / Virtual Reality
Published In	Volume 7, Issue 5, September-October 2026
Published On	2026-09-04
DOI	https://doi.org/10.63363/aijfr.2026.v07i05.6200

View / Download PDF File

E-ISSN 3048-7641

doi

CrossRef DOI is assigned to each research paper published in our journal.

AIJFR DOI prefix is
10.63363/aijfr

Downloads

Research Paper Format Copyright Permission Form and Undertaking Form Cover Page Vol 7 Isu 6 Cover Page Vol 7 Isu 4 Cover Page Vol 7 Isu 3

All research papers published on this website are licensed under Creative Commons Attribution-ShareAlike 4.0 International License, and all rights belong to their respective authors/researchers.

CC-BY-SA

About AIJFR Fees & Payment Current Issue Publication Archive	Submit Research Paper Track Submission Status Publication Guidelines Publication Ethics Peer Review & Plagiarism	Join as a Reviewer Editors & Reviewers Reviewer Referral Program Get Reviewer Membership Certi.	Website/Journal Policies Usage Policy Content Policies Privacy Policy

Contact Us		+91-9898-79-39-59	editor@aijfr.com

Advanced International Journal for Research

A Widely Indexed Open Access Peer Reviewed Multidisciplinary Bi-monthly Scholarly International Journal

Comparative Evaluation of Machine Learning Classifiers for SMS Spam Detection with Optimized Feature Extraction

Share this