You can’t suggest that?! : Comparisons and improvements of speller error models

In this article, we study correction of spelling errors, specifically on how the spelling errors are made and how can we model them computationally in order to fix them.The article describes two different approaches to generating spelling correction suggestions for three Uralic languages: Estonian,...

Full description

Bibliographic Details
Published in:Nordlyd
Main Authors: Kaalep, Heiki-Jaan, Pirinen, Flammie, Moshagen, Sjur
Format: Article in Journal/Newspaper
Language:English
Published: Septentrio Academic Publishing 2022
Subjects:
fsa
Online Access:https://septentrio.uit.no/index.php/nordlyd/article/view/6349
https://doi.org/10.7557/12.6349
Description
Summary:In this article, we study correction of spelling errors, specifically on how the spelling errors are made and how can we model them computationally in order to fix them.The article describes two different approaches to generating spelling correction suggestions for three Uralic languages: Estonian, North Sámi and South Sámi.The first approach of modelling spelling errors is rule-based, where experts write rules that describe the kind of errors are made, and these are compiled into finite-state automaton that models the errors.The second is data-based, where we show a machine learning algorithm a corpus of errors that humans have made, and it creates a neural network that can model the errors.Both approaches require collection of error corpora and understanding its contents; therefore we also describe the actual errors we have seen in detail.We find that while both approaches create error correction systems, with current resources the expert-build systems are still more reliable.