A novel feature extraction approach for text-based language identification: Binary patterns
| dc.contributor.author | Kaya, Yilmaz | |
| dc.contributor.author | Ertu?rul, Ömer Faruk | |
| dc.date.accessioned | 2024-12-24T19:09:46Z | |
| dc.date.available | 2024-12-24T19:09:46Z | |
| dc.date.issued | 2016 | |
| dc.department | Siirt Üniversitesi | |
| dc.description.abstract | Language identification (LI), which is a major task in natural language processing, is the process of determining the language from a given content. In this paper, a novel approach, which is based on the probability of the use of the characters that have the similar orders with respect to their UTF-8 values, was proposed. In order to evaluate and validate the proposed approach, four datasets, which contain texts in different numbers of languages, were employed. In the proposed approach, the features that were exacted by one-dimensional local binary pattern (1D-LBP) method were classified by various machine learning methods. Achieved LI accuracies in each of four employed datasets were 86.20%, 92.75%, 100% and 89.77%, respectively. The results showed that the proposed approach yields high success rates and it is an efficient way of language identification. | |
| dc.identifier.doi | 10.17341/gummfd.45983 | |
| dc.identifier.endpage | 1094 | |
| dc.identifier.issn | 1300-1884 | |
| dc.identifier.issue | 4 | |
| dc.identifier.scopus | 2-s2.0-85018715436 | |
| dc.identifier.scopusquality | Q2 | |
| dc.identifier.startpage | 1085 | |
| dc.identifier.uri | https://doi.org10.17341/gummfd.45983 | |
| dc.identifier.uri | https://hdl.handle.net/20.500.12604/3756 | |
| dc.identifier.volume | 31 | |
| dc.indekslendigikaynak | Scopus | |
| dc.language.iso | tr | |
| dc.publisher | Gazi Universitesi Muhendislik-Mimarlik | |
| dc.relation.ispartof | Journal of the Faculty of Engineering and Architecture of Gazi University | |
| dc.relation.publicationcategory | Makale - Uluslararası Hakemli Dergi - Kurum Öğretim Elemanı | |
| dc.rights | info:eu-repo/semantics/closedAccess | |
| dc.snmz | KA_20241222 | |
| dc.subject | Feature extraction | |
| dc.subject | Natural language processing | |
| dc.subject | One dimensional local binary patterns | |
| dc.subject | Text-based language identification | |
| dc.title | A novel feature extraction approach for text-based language identification: Binary patterns | |
| dc.title.alternative | Doköman Dili tanima için yeni bir öznitelik çikarim yaklaşimi: Ikili desenler | |
| dc.type | Article |
