Capability Assessments - An Experimental Study of Capability Assessments with Multi-Actor Dependencies
This thesis investigates how multi-actor dependencies affect the ability to assess capability. It is also investigating if the accuracy of capability assessments for tasks where multi-actor dependencies are present, depends on if capability is assessed individually or with all participating actors....
Main Authors: | , |
---|---|
Format: | Other/Unknown Material |
Language: | English |
Published: |
Lunds universitet/Riskhantering (CI)
2016
|
Subjects: | |
Online Access: | http://lup.lub.lu.se/student-papers/record/8871453 |
id |
ftulundlupsp:oai:lup-student-papers.lub.lu.se:8871453 |
---|---|
record_format |
openpolar |
institution |
Open Polar |
collection |
Lund University Publications Student Papers (LUP-SP) |
op_collection_id |
ftulundlupsp |
language |
English |
topic |
Keywords Capability Capability Assessments Risk and vulnerability analyses Multi-actor Dependency models self-assessments peer-assessments Mastermind SPSS Capacity Ability Skill. Sökord Förmåga förmågebedömningar risk- och sårbarhetsanalyser flera aktörer beroendemodeller egenanalys kamratbedömning kapacitet skicklighet Technology and Engineering Social Sciences |
spellingShingle |
Keywords Capability Capability Assessments Risk and vulnerability analyses Multi-actor Dependency models self-assessments peer-assessments Mastermind SPSS Capacity Ability Skill. Sökord Förmåga förmågebedömningar risk- och sårbarhetsanalyser flera aktörer beroendemodeller egenanalys kamratbedömning kapacitet skicklighet Technology and Engineering Social Sciences Hanson, Malin Severinsen, Sebastian Capability Assessments - An Experimental Study of Capability Assessments with Multi-Actor Dependencies |
topic_facet |
Keywords Capability Capability Assessments Risk and vulnerability analyses Multi-actor Dependency models self-assessments peer-assessments Mastermind SPSS Capacity Ability Skill. Sökord Förmåga förmågebedömningar risk- och sårbarhetsanalyser flera aktörer beroendemodeller egenanalys kamratbedömning kapacitet skicklighet Technology and Engineering Social Sciences |
description |
This thesis investigates how multi-actor dependencies affect the ability to assess capability. It is also investigating if the accuracy of capability assessments for tasks where multi-actor dependencies are present, depends on if capability is assessed individually or with all participating actors. Two multi-actor dependency models were considered representative for all cases. Dependency I represents a scenario where two actors have a common goal, but each actor’s individual performance is not affected by the other actor’s performance. Dependency II represents a scenario where two actors have a common goal and the first actor’s individual performance affect the second actor’s performance. It was concluded that the participants tended to be more confident when assessing multi-actor dependency tasks in pairs than individually, although there is no significant difference in accuracy between the assessments. A qualitative analysis suggests that individual capability assessments are more accurate for individual tasks and for Dependency II tasks than for Dependency I tasks. For assessment made with all participating actors there is no significant difference between the dependencies, although assessments for Dependency II tasks tended to be more accurate than Dependency I tasks. Capability Assessments - An Experimental Study of Capability Assessments with Multi-Actor Dependencies When solving a task with someone, you are likely to underestimate your capability to do so. At least if the task is of a cognitive nature and you are dependent on each other. In the conducted experiments the majority of the participants underestimated their capability to perform a given task. In an ever growing complex world, making accurate capability assessments will be an important future tool to allocate resources between relevant actors. This is highly important since the consequences of misplaced resources may be loss of lives. The modern society is growing fast and is increasingly complex, which inherently increases the number of actors who also are dependent on each other. In order to cater for the increasingly complex society several countries, Sweden and United Kingdom among others, have adopted a capability-based planning approach in their national risk and vulnerability analysis. The capability assessments are conducted in Sweden as part of the risk and vulnerability analyses, which every municipality is required to update annually. However, the term capability and how to conduct assessments of capability have not been defined and structured consistently among practitioners. Since the number of actors who are dependent on each other is increasing, it is crucial to understand how multi-actor dependencies affect capability assessments. In this study two different dependencies were tested where all relevant actors have a common goal, called Dependency I and Dependency II. Dependency I simulates two actors where each actor’s individual performance is not affected by the other actor’s performance. Dependency II simulates two actors where the first actor’s individual performance affects the second actor’s performance. The conclusions are that the participants tended to be more confident when assessing multi- actor dependency tasks in pairs than individually, even so a majority of the participants underestimated both their individual and joint capability to solve the tasks. There was a significant difference between capability assessments and performances for all tasks, including the individual task. This suggests that assessing capability is difficult both with or without multi-actor dependencies. However, a qualitative analysis suggests that individual capability assessments are more accurate for individual tasks and Dependency II than for Dependency I. For assessment made in pairs there is no significant difference between the dependencies, although assessments for Dependency II tend to be more accurate than Dependency I. The foundation of this study is the experiment carried out at Lund University, Luleå Technical University and Nils Fredriksson Utbildning. A total of 48 participants took part and performed at least one of the two designed tasks. It is the anticipation that the results from this study will be a stepping stone towards future methods on how to assess capability where multi-actor dependencies are present. |
format |
Other/Unknown Material |
author |
Hanson, Malin Severinsen, Sebastian |
author_facet |
Hanson, Malin Severinsen, Sebastian |
author_sort |
Hanson, Malin |
title |
Capability Assessments - An Experimental Study of Capability Assessments with Multi-Actor Dependencies |
title_short |
Capability Assessments - An Experimental Study of Capability Assessments with Multi-Actor Dependencies |
title_full |
Capability Assessments - An Experimental Study of Capability Assessments with Multi-Actor Dependencies |
title_fullStr |
Capability Assessments - An Experimental Study of Capability Assessments with Multi-Actor Dependencies |
title_full_unstemmed |
Capability Assessments - An Experimental Study of Capability Assessments with Multi-Actor Dependencies |
title_sort |
capability assessments - an experimental study of capability assessments with multi-actor dependencies |
publisher |
Lunds universitet/Riskhantering (CI) |
publishDate |
2016 |
url |
http://lup.lub.lu.se/student-papers/record/8871453 |
long_lat |
ENVELOPE(48.017,48.017,-68.067,-68.067) |
geographic |
Nils |
geographic_facet |
Nils |
genre |
Luleå Luleå Luleå |
genre_facet |
Luleå Luleå Luleå |
op_relation |
http://lup.lub.lu.se/student-papers/record/8871453 ISSN: 1402-3504 ISRN: LUTVDG/TVRH—5019—SE |
_version_ |
1766065369501401088 |
spelling |
ftulundlupsp:oai:lup-student-papers.lub.lu.se:8871453 2023-05-15T17:09:19+02:00 Capability Assessments - An Experimental Study of Capability Assessments with Multi-Actor Dependencies Hanson, Malin Severinsen, Sebastian 2016 application/pdf http://lup.lub.lu.se/student-papers/record/8871453 eng eng Lunds universitet/Riskhantering (CI) Lunds universitet/Avdelningen för Riskhantering och Samhällssäkerhet http://lup.lub.lu.se/student-papers/record/8871453 ISSN: 1402-3504 ISRN: LUTVDG/TVRH—5019—SE Keywords Capability Capability Assessments Risk and vulnerability analyses Multi-actor Dependency models self-assessments peer-assessments Mastermind SPSS Capacity Ability Skill. Sökord Förmåga förmågebedömningar risk- och sårbarhetsanalyser flera aktörer beroendemodeller egenanalys kamratbedömning kapacitet skicklighet Technology and Engineering Social Sciences H2 2016 ftulundlupsp 2021-10-19T20:04:34Z This thesis investigates how multi-actor dependencies affect the ability to assess capability. It is also investigating if the accuracy of capability assessments for tasks where multi-actor dependencies are present, depends on if capability is assessed individually or with all participating actors. Two multi-actor dependency models were considered representative for all cases. Dependency I represents a scenario where two actors have a common goal, but each actor’s individual performance is not affected by the other actor’s performance. Dependency II represents a scenario where two actors have a common goal and the first actor’s individual performance affect the second actor’s performance. It was concluded that the participants tended to be more confident when assessing multi-actor dependency tasks in pairs than individually, although there is no significant difference in accuracy between the assessments. A qualitative analysis suggests that individual capability assessments are more accurate for individual tasks and for Dependency II tasks than for Dependency I tasks. For assessment made with all participating actors there is no significant difference between the dependencies, although assessments for Dependency II tasks tended to be more accurate than Dependency I tasks. Capability Assessments - An Experimental Study of Capability Assessments with Multi-Actor Dependencies When solving a task with someone, you are likely to underestimate your capability to do so. At least if the task is of a cognitive nature and you are dependent on each other. In the conducted experiments the majority of the participants underestimated their capability to perform a given task. In an ever growing complex world, making accurate capability assessments will be an important future tool to allocate resources between relevant actors. This is highly important since the consequences of misplaced resources may be loss of lives. The modern society is growing fast and is increasingly complex, which inherently increases the number of actors who also are dependent on each other. In order to cater for the increasingly complex society several countries, Sweden and United Kingdom among others, have adopted a capability-based planning approach in their national risk and vulnerability analysis. The capability assessments are conducted in Sweden as part of the risk and vulnerability analyses, which every municipality is required to update annually. However, the term capability and how to conduct assessments of capability have not been defined and structured consistently among practitioners. Since the number of actors who are dependent on each other is increasing, it is crucial to understand how multi-actor dependencies affect capability assessments. In this study two different dependencies were tested where all relevant actors have a common goal, called Dependency I and Dependency II. Dependency I simulates two actors where each actor’s individual performance is not affected by the other actor’s performance. Dependency II simulates two actors where the first actor’s individual performance affects the second actor’s performance. The conclusions are that the participants tended to be more confident when assessing multi- actor dependency tasks in pairs than individually, even so a majority of the participants underestimated both their individual and joint capability to solve the tasks. There was a significant difference between capability assessments and performances for all tasks, including the individual task. This suggests that assessing capability is difficult both with or without multi-actor dependencies. However, a qualitative analysis suggests that individual capability assessments are more accurate for individual tasks and Dependency II than for Dependency I. For assessment made in pairs there is no significant difference between the dependencies, although assessments for Dependency II tend to be more accurate than Dependency I. The foundation of this study is the experiment carried out at Lund University, Luleå Technical University and Nils Fredriksson Utbildning. A total of 48 participants took part and performed at least one of the two designed tasks. It is the anticipation that the results from this study will be a stepping stone towards future methods on how to assess capability where multi-actor dependencies are present. Other/Unknown Material Luleå Luleå Luleå Lund University Publications Student Papers (LUP-SP) Nils ENVELOPE(48.017,48.017,-68.067,-68.067) |