The Sweet-Home speech and multimodal corpus for home automation interaction

• Main Authors: Vacher, Michel, Lecouteux, Benjamin, Chahuara, Pedro, Portet, François, Meillon, Brigitte, Bonnefond, Nicolas
• Other Authors: Groupe d’Étude en Traduction Automatique/Traitement Automatisé des Langues et de la Parole (GETALP), Laboratoire d'Informatique de Grenoble (LIG), Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Institut National Polytechnique de Grenoble (INPG)-Centre National de la Recherche Scientifique (CNRS)-Université Pierre Mendès France - Grenoble 2 (UPMF)-Université Joseph Fourier - Grenoble 1 (UJF)-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Institut National Polytechnique de Grenoble (INPG)-Centre National de la Recherche Scientifique (CNRS)-Université Pierre Mendès France - Grenoble 2 (UPMF)-Université Joseph Fourier - Grenoble 1 (UJF), Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Institut National Polytechnique de Grenoble (INPG)-Centre National de la Recherche Scientifique (CNRS)-Université Pierre Mendès France - Grenoble 2 (UPMF)-Université Joseph Fourier - Grenoble 1 (UJF), ANR-09-VERS-0011,SWEET-HOME,Système Domotique d'Assistance au Domicile(2009)
• Format: Conference Object
• Language: English
• Published: HAL CCSD 2014
• Subjects: multimodal data acquisition; natural language and multimodal interactions; voice-actived home automation; Ambient Assisted Living; [INFO.INFO-OH]Computer Science [cs]/Other [cs.OH]; [INFO.INFO-AI]Computer Science [cs]/Artificial Intelligence [cs.AI]; Iceland
• Online Access: https://hal.archives-ouvertes.fr/hal-00953006; https://hal.archives-ouvertes.fr/hal-00953006/document; https://hal.archives-ouvertes.fr/hal-00953006/file/2014_LREC_Vacher_final.pdf

International audience Ambient Assisted Living aims at enhancing the quality of life of older and disabled people at home thanks to Smart Homes and Home Automation. However, many studies do not include tests in real settings, because data collection in this domain is very expensive and challenging and because of the few available data sets. The SWEET-H OME multimodal corpus is a dataset recorded in realistic conditions in D OMUS, a fully equipped Smart Home with microphones and home automation sensors, in which participants performed Activities of Daily living (ADL). This corpus is made of a multimodal subset, a French home automation speech subset recorded in Distant Speech conditions, and two interaction subsets, the first one being recorded by 16 persons without disabilities and the second one by 6 seniors and 5 visually impaired people. This corpus was used in studies related to ADL recognition, context aware interaction and distant speech recognition applied to home automation controled through voice.