EVALUATING THE EXTENT OF ETHNIC BIASES IN FINBERT AND EXPLORING DEBIASING TECHNIQUES
Language models are becoming increasingly popular. These models can contain social biases about various groups of people in them. The reproduction of biased beliefs can have harmful impacts on the groups they are about. We explore the extent of ethnic biases in the Finnish language model FinBERT. Ou...
Main Author: | |
---|---|
Other Authors: | , |
Format: | Text |
Language: | English |
Published: |
2022
|
Subjects: | |
Online Access: | https://hdl.handle.net/2077/73771 |
id |
ftunivgoeteborg:oai:gupea.ub.gu.se:2077/73771 |
---|---|
record_format |
openpolar |
spelling |
ftunivgoeteborg:oai:gupea.ub.gu.se:2077/73771 2023-10-29T02:39:53+01:00 EVALUATING THE EXTENT OF ETHNIC BIASES IN FINBERT AND EXPLORING DEBIASING TECHNIQUES Suvanto, Minerva University of Gothenburg / Department of Philosophy,Lingustics and Theory of Science Göteborgs universitet / Institutionen för filosofi, lingvistik och vetenskapsteori 2022-10-07T07:28:49Z application/pdf https://hdl.handle.net/2077/73771 eng eng https://hdl.handle.net/2077/73771 language model BERT FinBERT bias debias Text H2 Student essay 2022 ftunivgoeteborg 2023-10-04T21:17:31Z Language models are becoming increasingly popular. These models can contain social biases about various groups of people in them. The reproduction of biased beliefs can have harmful impacts on the groups they are about. We explore the extent of ethnic biases in the Finnish language model FinBERT. Our work focuses on biases about minority groups in Finland and we evaluate the extent of biases in the ethnic groups Roma, Finnish-Swedish, Sámi, Somali and Russian. In order to quantify the extent of biases, we use a template-based approach of calculating association scores between ethnicities and biased terms. We find that the model produces biased outcomes about the minority groups Roma and Somali. In order to mitigate the detected biases, we attempt debiasing FinBERT using dropout regularization and self-debiasing. The results of these two debiasing techniques do not produce satisfactory results and we conclude that debiasing ethnic biases and Finnish language models requires further research. Text Sámi Sámi University of Gothenburg: GUPEA (Gothenburg University Publications Electronic Archive) |
institution |
Open Polar |
collection |
University of Gothenburg: GUPEA (Gothenburg University Publications Electronic Archive) |
op_collection_id |
ftunivgoeteborg |
language |
English |
topic |
language model BERT FinBERT bias debias |
spellingShingle |
language model BERT FinBERT bias debias Suvanto, Minerva EVALUATING THE EXTENT OF ETHNIC BIASES IN FINBERT AND EXPLORING DEBIASING TECHNIQUES |
topic_facet |
language model BERT FinBERT bias debias |
description |
Language models are becoming increasingly popular. These models can contain social biases about various groups of people in them. The reproduction of biased beliefs can have harmful impacts on the groups they are about. We explore the extent of ethnic biases in the Finnish language model FinBERT. Our work focuses on biases about minority groups in Finland and we evaluate the extent of biases in the ethnic groups Roma, Finnish-Swedish, Sámi, Somali and Russian. In order to quantify the extent of biases, we use a template-based approach of calculating association scores between ethnicities and biased terms. We find that the model produces biased outcomes about the minority groups Roma and Somali. In order to mitigate the detected biases, we attempt debiasing FinBERT using dropout regularization and self-debiasing. The results of these two debiasing techniques do not produce satisfactory results and we conclude that debiasing ethnic biases and Finnish language models requires further research. |
author2 |
University of Gothenburg / Department of Philosophy,Lingustics and Theory of Science Göteborgs universitet / Institutionen för filosofi, lingvistik och vetenskapsteori |
format |
Text |
author |
Suvanto, Minerva |
author_facet |
Suvanto, Minerva |
author_sort |
Suvanto, Minerva |
title |
EVALUATING THE EXTENT OF ETHNIC BIASES IN FINBERT AND EXPLORING DEBIASING TECHNIQUES |
title_short |
EVALUATING THE EXTENT OF ETHNIC BIASES IN FINBERT AND EXPLORING DEBIASING TECHNIQUES |
title_full |
EVALUATING THE EXTENT OF ETHNIC BIASES IN FINBERT AND EXPLORING DEBIASING TECHNIQUES |
title_fullStr |
EVALUATING THE EXTENT OF ETHNIC BIASES IN FINBERT AND EXPLORING DEBIASING TECHNIQUES |
title_full_unstemmed |
EVALUATING THE EXTENT OF ETHNIC BIASES IN FINBERT AND EXPLORING DEBIASING TECHNIQUES |
title_sort |
evaluating the extent of ethnic biases in finbert and exploring debiasing techniques |
publishDate |
2022 |
url |
https://hdl.handle.net/2077/73771 |
genre |
Sámi Sámi |
genre_facet |
Sámi Sámi |
op_relation |
https://hdl.handle.net/2077/73771 |
_version_ |
1781067550605443072 |