Lexd: A Finite-State Lexicon Compiler for Non-Suffixational Morphologies
This paper presents lexd, a lexicon compiler for languages with non-suffixational morphology, which is intended to be faster and easier to use than existing solutions while also being compatible with other tools. We perform a case-study for Chukchi, comparing against a hand-optimised analyser writte...
Main Authors: | , |
---|---|
Format: | Other/Unknown Material |
Language: | English |
Published: |
2021
|
Subjects: | |
Online Access: | http://hdl.handle.net/10138/327807 https://doi.org/10.31885/9789515150257.13 |
id |
ftunivhelsihelda:oai:helda.helsinki.fi:10138/327807 |
---|---|
record_format |
openpolar |
spelling |
ftunivhelsihelda:oai:helda.helsinki.fi:10138/327807 2024-04-21T07:59:48+00:00 Lexd: A Finite-State Lexicon Compiler for Non-Suffixational Morphologies Swanson, Daniel Howell, Nick 2021-03-11T10:16:17Z application/pdf http://hdl.handle.net/10138/327807 https://doi.org/10.31885/9789515150257.13 eng eng http://hdl.handle.net/10138/327807 https://doi.org/10.31885/9789515150257.13 CC BY 4.0 openAccess https://creativecommons.org/licenses/by/4.0/deed.fi lexicon compiler nonlinear morphology morphotactic transducer hyperminimisation finite state morphology Artikkeli kirjassa 2021 ftunivhelsihelda https://doi.org/10.31885/9789515150257.13 2024-03-27T17:50:30Z This paper presents lexd, a lexicon compiler for languages with non-suffixational morphology, which is intended to be faster and easier to use than existing solutions while also being compatible with other tools. We perform a case-study for Chukchi, comparing against a hand-optimised analyser written in lexc, and find that while lexd is easier to use, performance remains an obstacle to its use at production level. We also compare performance between lexd and hfst-lexc for three analysers still in the prototype phase, finding that lexd is at least as fast, sometimes faster, to compile; we conclude it is a reasonable choice for prototyping new analysers. Future work will explore how to move lexd performance toward production-grade. Other/Unknown Material Chukchi HELDA – University of Helsinki Open Repository |
institution |
Open Polar |
collection |
HELDA – University of Helsinki Open Repository |
op_collection_id |
ftunivhelsihelda |
language |
English |
topic |
lexicon compiler nonlinear morphology morphotactic transducer hyperminimisation finite state morphology |
spellingShingle |
lexicon compiler nonlinear morphology morphotactic transducer hyperminimisation finite state morphology Swanson, Daniel Howell, Nick Lexd: A Finite-State Lexicon Compiler for Non-Suffixational Morphologies |
topic_facet |
lexicon compiler nonlinear morphology morphotactic transducer hyperminimisation finite state morphology |
description |
This paper presents lexd, a lexicon compiler for languages with non-suffixational morphology, which is intended to be faster and easier to use than existing solutions while also being compatible with other tools. We perform a case-study for Chukchi, comparing against a hand-optimised analyser written in lexc, and find that while lexd is easier to use, performance remains an obstacle to its use at production level. We also compare performance between lexd and hfst-lexc for three analysers still in the prototype phase, finding that lexd is at least as fast, sometimes faster, to compile; we conclude it is a reasonable choice for prototyping new analysers. Future work will explore how to move lexd performance toward production-grade. |
format |
Other/Unknown Material |
author |
Swanson, Daniel Howell, Nick |
author_facet |
Swanson, Daniel Howell, Nick |
author_sort |
Swanson, Daniel |
title |
Lexd: A Finite-State Lexicon Compiler for Non-Suffixational Morphologies |
title_short |
Lexd: A Finite-State Lexicon Compiler for Non-Suffixational Morphologies |
title_full |
Lexd: A Finite-State Lexicon Compiler for Non-Suffixational Morphologies |
title_fullStr |
Lexd: A Finite-State Lexicon Compiler for Non-Suffixational Morphologies |
title_full_unstemmed |
Lexd: A Finite-State Lexicon Compiler for Non-Suffixational Morphologies |
title_sort |
lexd: a finite-state lexicon compiler for non-suffixational morphologies |
publishDate |
2021 |
url |
http://hdl.handle.net/10138/327807 https://doi.org/10.31885/9789515150257.13 |
genre |
Chukchi |
genre_facet |
Chukchi |
op_relation |
http://hdl.handle.net/10138/327807 https://doi.org/10.31885/9789515150257.13 |
op_rights |
CC BY 4.0 openAccess https://creativecommons.org/licenses/by/4.0/deed.fi |
op_doi |
https://doi.org/10.31885/9789515150257.13 |
_version_ |
1796940444986245120 |