An Approach for the Normalization of Short Message Service to Detect Shorter Form of Words and Find out Actual Word

Mahbub Alam ； Osman Goni ； Abu Shameem ； Shamimul Islam ； Nayan Kumar Datta ； Shakil Ahmed ； Golam Moazzam

《International Journal of Electronics and Information Engineering》 13卷3期 (2021/09) Pp. 111-118

https://doi.org/10.6636/IJEIE.202109_13(3).04

摘要

Short Message Service (SMS) is one of the most popularly used services for communication between mobile phone users. Nowadays, different Instant Messaging (IM) apps such as messenger, WhatsApp, IMO, WeChat, etc., are becoming more and more popular. SMS communication has a general appeal, especially to the youth, because of its flexible use of alphanumeric characters, with little or no regard for orthographical and grammatical rules. However, this flexibility and freedom pose challenges for translating SMS into formal writing. To overcome this, a pre-processing step known as normalization is required. SMS language has, however, been recognized and accepted as a variant of natural language. Thus, there is compelling motivation to make it possible to build information-based services using SMS communication by normalizing the various forms in which the language appears. Therefore, we aim to find a suitable technique for conveniently normalizing the SMS.

關鍵字

Natural Language Processing ； Normalization ； SMS ； SMS Classification ； SMS Translation