Text normalization algorithm for facebook chats in Hausa language

• المؤلفون الرئيسيون: Jaafar, Zubairu Maitama, Haruna, Usman, Gambo, Abdullahi Ya'u, Thomas, Bimba Andrew, Idris, Norisma, Ya’u Gital, Abdulsalam, Abubakar, Adamu
• التنسيق: Conference or Workshop Item
• اللغة: English; English
• منشور في: IEEE 2014
• الموضوعات: Q350 Information theory
• الوصول للمادة أونلاين: http://irep.iium.edu.my/40213/11/40213-Text%20normalization%20algorithm%20for%20facebook%20chats%20in%20hausa%20language-edited.pdf; http://irep.iium.edu.my/40213/12/40213-Text%20normalization%20algorithm%20for%20facebook%20chats%20in%20hausa%20language_SCOPUS.pdf; http://irep.iium.edu.my/40213/; http://ieeexplore.ieee.org/abstract/document/7020605/

The rapid increase in using non-standard words (NSWs) in communication through the social media is causing difficulties in understanding contents of the text messages. In addition, it affects the performance of several natural language processing (NLP) task such as machine translation, information retrievals, summarization and etc. In this study, we present an automatic text normalization system on Facebook chatting based on Hausa language. The proposed algorithm manually developed dictionary that employ normalization of each non-standard word with its equivalent standard word. This is accomplished through modification of the technique employed by [1] to fit Hausa NSWs' formation. It was found that our proposed algorithm was able to normalized Hausa NSWs with an accuracy of 100%. The results of this research can facilitate comprehensive communication via Facebook using Hausa language.