Implementation of an Automatic Sign Language Lexical Annotation Framework based on Propositional Dynamic Logic
International audience In this paper, we present the implementation of an automatic Sign Language (SL) sign annotation framework based on a formal logic, the Propositional Dynamic Logic (PDL). Our system relies heavily on the use of a specific variant of PDL, the Propositional Dynamic Logic for Sign...
Main Authors: | , |
---|---|
Other Authors: | , , , , , , , |
Format: | Conference Object |
Language: | English |
Published: |
HAL CCSD
2014
|
Subjects: | |
Online Access: | https://hal.archives-ouvertes.fr/hal-01135588 https://hal.archives-ouvertes.fr/hal-01135588/document https://hal.archives-ouvertes.fr/hal-01135588/file/Curiel_13113.pdf |
id |
ftccsdartic:oai:HAL:hal-01135588v1 |
---|---|
record_format |
openpolar |
spelling |
ftccsdartic:oai:HAL:hal-01135588v1 2023-05-15T16:50:45+02:00 Implementation of an Automatic Sign Language Lexical Annotation Framework based on Propositional Dynamic Logic Curiel Diaz, Arturo Tlacaélel Collet, Christophe Traitement et Compréhension d’Images (IRIT-TCI) Institut de recherche en informatique de Toulouse (IRIT) Université Toulouse 1 Capitole (UT1) Université Fédérale Toulouse Midi-Pyrénées-Université Fédérale Toulouse Midi-Pyrénées-Université Toulouse - Jean Jaurès (UT2J)-Université Toulouse III - Paul Sabatier (UT3) Université Fédérale Toulouse Midi-Pyrénées-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique (Toulouse) (Toulouse INP) Université Fédérale Toulouse Midi-Pyrénées-Université Toulouse 1 Capitole (UT1) Université Fédérale Toulouse Midi-Pyrénées Université Toulouse III - Paul Sabatier (UT3) Reykjavik, Iceland 2014-05-26 https://hal.archives-ouvertes.fr/hal-01135588 https://hal.archives-ouvertes.fr/hal-01135588/document https://hal.archives-ouvertes.fr/hal-01135588/file/Curiel_13113.pdf en eng HAL CCSD hal-01135588 https://hal.archives-ouvertes.fr/hal-01135588 https://hal.archives-ouvertes.fr/hal-01135588/document https://hal.archives-ouvertes.fr/hal-01135588/file/Curiel_13113.pdf OATAO: 13113 info:eu-repo/semantics/OpenAccess Workshop Proceedings - 6th Workshop on the Representation and Processing of Sign Languages: Beyond the Manual Channel The 9th edition of the Language Resources and Evaluation Conference - LREC 2014 https://hal.archives-ouvertes.fr/hal-01135588 The 9th edition of the Language Resources and Evaluation Conference - LREC 2014, May 2014, Reykjavik, Iceland. pp. 29-36 Propositional dynamic logic Sign language framework Automatic annotation [INFO.INFO-GR]Computer Science [cs]/Graphics [cs.GR] [INFO.INFO-TS]Computer Science [cs]/Signal and Image Processing [INFO.INFO-TI]Computer Science [cs]/Image Processing [eess.IV] [INFO.INFO-CV]Computer Science [cs]/Computer Vision and Pattern Recognition [cs.CV] [INFO.INFO-AI]Computer Science [cs]/Artificial Intelligence [cs.AI] info:eu-repo/semantics/conferenceObject Conference papers 2014 ftccsdartic 2021-10-24T12:13:39Z International audience In this paper, we present the implementation of an automatic Sign Language (SL) sign annotation framework based on a formal logic, the Propositional Dynamic Logic (PDL). Our system relies heavily on the use of a specific variant of PDL, the Propositional Dynamic Logic for Sign Language (PDLSL), which lets us describe SL signs as formulae and corpora videos as labeled transition systems (LTSs). Here, we intend to show how a generic annotation system can be constructed upon these underlying theoretical principles, regardless of the tracking technologies available or the input format of corpora. With this in mind, we generated a development framework that adapts the system to specific use cases. Furthermore, we present some results obtained by our application when adapted to one distinct case, 2D corpora analysis with pre-processed tracking information. We also present some insights on how such a technology can be used to analyze 3D real-time data, captured with a depth device. Conference Object Iceland Archive ouverte HAL (Hyper Article en Ligne, CCSD - Centre pour la Communication Scientifique Directe) |
institution |
Open Polar |
collection |
Archive ouverte HAL (Hyper Article en Ligne, CCSD - Centre pour la Communication Scientifique Directe) |
op_collection_id |
ftccsdartic |
language |
English |
topic |
Propositional dynamic logic Sign language framework Automatic annotation [INFO.INFO-GR]Computer Science [cs]/Graphics [cs.GR] [INFO.INFO-TS]Computer Science [cs]/Signal and Image Processing [INFO.INFO-TI]Computer Science [cs]/Image Processing [eess.IV] [INFO.INFO-CV]Computer Science [cs]/Computer Vision and Pattern Recognition [cs.CV] [INFO.INFO-AI]Computer Science [cs]/Artificial Intelligence [cs.AI] |
spellingShingle |
Propositional dynamic logic Sign language framework Automatic annotation [INFO.INFO-GR]Computer Science [cs]/Graphics [cs.GR] [INFO.INFO-TS]Computer Science [cs]/Signal and Image Processing [INFO.INFO-TI]Computer Science [cs]/Image Processing [eess.IV] [INFO.INFO-CV]Computer Science [cs]/Computer Vision and Pattern Recognition [cs.CV] [INFO.INFO-AI]Computer Science [cs]/Artificial Intelligence [cs.AI] Curiel Diaz, Arturo Tlacaélel Collet, Christophe Implementation of an Automatic Sign Language Lexical Annotation Framework based on Propositional Dynamic Logic |
topic_facet |
Propositional dynamic logic Sign language framework Automatic annotation [INFO.INFO-GR]Computer Science [cs]/Graphics [cs.GR] [INFO.INFO-TS]Computer Science [cs]/Signal and Image Processing [INFO.INFO-TI]Computer Science [cs]/Image Processing [eess.IV] [INFO.INFO-CV]Computer Science [cs]/Computer Vision and Pattern Recognition [cs.CV] [INFO.INFO-AI]Computer Science [cs]/Artificial Intelligence [cs.AI] |
description |
International audience In this paper, we present the implementation of an automatic Sign Language (SL) sign annotation framework based on a formal logic, the Propositional Dynamic Logic (PDL). Our system relies heavily on the use of a specific variant of PDL, the Propositional Dynamic Logic for Sign Language (PDLSL), which lets us describe SL signs as formulae and corpora videos as labeled transition systems (LTSs). Here, we intend to show how a generic annotation system can be constructed upon these underlying theoretical principles, regardless of the tracking technologies available or the input format of corpora. With this in mind, we generated a development framework that adapts the system to specific use cases. Furthermore, we present some results obtained by our application when adapted to one distinct case, 2D corpora analysis with pre-processed tracking information. We also present some insights on how such a technology can be used to analyze 3D real-time data, captured with a depth device. |
author2 |
Traitement et Compréhension d’Images (IRIT-TCI) Institut de recherche en informatique de Toulouse (IRIT) Université Toulouse 1 Capitole (UT1) Université Fédérale Toulouse Midi-Pyrénées-Université Fédérale Toulouse Midi-Pyrénées-Université Toulouse - Jean Jaurès (UT2J)-Université Toulouse III - Paul Sabatier (UT3) Université Fédérale Toulouse Midi-Pyrénées-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique (Toulouse) (Toulouse INP) Université Fédérale Toulouse Midi-Pyrénées-Université Toulouse 1 Capitole (UT1) Université Fédérale Toulouse Midi-Pyrénées Université Toulouse III - Paul Sabatier (UT3) |
format |
Conference Object |
author |
Curiel Diaz, Arturo Tlacaélel Collet, Christophe |
author_facet |
Curiel Diaz, Arturo Tlacaélel Collet, Christophe |
author_sort |
Curiel Diaz, Arturo Tlacaélel |
title |
Implementation of an Automatic Sign Language Lexical Annotation Framework based on Propositional Dynamic Logic |
title_short |
Implementation of an Automatic Sign Language Lexical Annotation Framework based on Propositional Dynamic Logic |
title_full |
Implementation of an Automatic Sign Language Lexical Annotation Framework based on Propositional Dynamic Logic |
title_fullStr |
Implementation of an Automatic Sign Language Lexical Annotation Framework based on Propositional Dynamic Logic |
title_full_unstemmed |
Implementation of an Automatic Sign Language Lexical Annotation Framework based on Propositional Dynamic Logic |
title_sort |
implementation of an automatic sign language lexical annotation framework based on propositional dynamic logic |
publisher |
HAL CCSD |
publishDate |
2014 |
url |
https://hal.archives-ouvertes.fr/hal-01135588 https://hal.archives-ouvertes.fr/hal-01135588/document https://hal.archives-ouvertes.fr/hal-01135588/file/Curiel_13113.pdf |
op_coverage |
Reykjavik, Iceland |
genre |
Iceland |
genre_facet |
Iceland |
op_source |
Workshop Proceedings - 6th Workshop on the Representation and Processing of Sign Languages: Beyond the Manual Channel The 9th edition of the Language Resources and Evaluation Conference - LREC 2014 https://hal.archives-ouvertes.fr/hal-01135588 The 9th edition of the Language Resources and Evaluation Conference - LREC 2014, May 2014, Reykjavik, Iceland. pp. 29-36 |
op_relation |
hal-01135588 https://hal.archives-ouvertes.fr/hal-01135588 https://hal.archives-ouvertes.fr/hal-01135588/document https://hal.archives-ouvertes.fr/hal-01135588/file/Curiel_13113.pdf OATAO: 13113 |
op_rights |
info:eu-repo/semantics/OpenAccess |
_version_ |
1766040862030036992 |