SOAS Research Online

A Free Database of the Latest Research by SOAS Academics and PhD Students

[skip to content]

Hill, Nathan W. and Meelen, Marieke (2017) 'Segmenting and POS tagging Classical Tibetan using a memory-based tagger.' Himalayan Linguistics, 16 (2). pp. 64-86.

[img]
Preview
Text - Published Version
Available under License Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 (CC BY-NC-ND 4.0).

Download (951kB) | Preview

Abstract

This paper presents a new approach to two challenging NLP tasks in Classical Tibetan: word segmentation and Part-of-Speech (POS) tagging. We demonstrate how both these problems can be approached in the same way, by generating a memory-based tagger that assigns 1) segmentation tags and 2) POS tags to a test corpus consisting of unsegmented lines of Tibetan characters. We propose a three-stage workflow and evaluate the results of both the segmenting and the POS tagging tasks. We argue that the Memory-Based Tagger (MBT) and the proposed workflow not only provide an adequate solution to these NLP challenges, they are also highly efficient tools for building larger annotated corpora of Tibetan.

Item Type: Journal Article
SOAS Departments & Centres: Departments and Subunits > Department of East Asian Languages & Cultures
Departments and Subunits > School of Languages, Cultures & Linguistics > Department of Linguistics
ISSN: 15447502
DOI (Digital Object Identifier): https://doi.org/10.5070/H916234501
Date Deposited: 03 Feb 2018 14:11
URI: https://eprints.soas.ac.uk/id/eprint/25373
Related URLs: (Publisher URL)
Funders: European Union

Altmetric Data

Statistics

Download activity - last 12 monthsShow export options
Downloads since deposit
6 month trend
384Downloads
6 month trend
549Hits
Accesses by country - last 12 monthsShow export options
Accesses by referrer - last 12 monthsShow export options

Repository staff only

Edit Item Edit Item