A Tokenization System for the Kurdish Language
Authors
VarDial 2020
pp. 114-127
January 1, 2020
Abstract
A Kurdish tokenization system using lexical resources and morphological analysis to address token boundaries, compounds and orthographic variation in Sorani and Kurmanji.
Keywords
Kurdish
Tokenization
Sorani
Kurmanji
Lexical Resources
Related Datasets
KurdishTokenization Lexical Bundle
2020
Lexicon entry total not verified
JSON, Text Corpus Format
Lexical resources accompanying Kurdish tokenization research, including annotated lemmas and compound or multiword variants derived in part from FreeDict and Wîkîferheng.
Citation
Ahmadi, S. (2020). A Tokenization System for the Kurdish Language. Proceedings of the 7th Workshop on NLP for Similar Languages, Varieties and Dialects, 114-127.