Assessing achievements in place-based initiatives : developing a tailor-made tool
Assessing achievements of place-based initiatives (PBIs) has become increasingly important in contemporary evaluation practice. While key characteristics of successful PBIs have been described in the literature, the practicalities of assessing implementation progress across multiple PBIs under the u...
Published in: | Evaluation Journal of Australasia |
---|---|
Main Authors: | , , , , |
Format: | Article in Journal/Newspaper |
Language: | English |
Published: |
U.K., Sage Publications
2022
|
Subjects: | |
Online Access: | https://doi.org/10.1177/1035719X221102278 https://hdl.handle.net/1959.7/uws:67050 |
id |
ftunivwestsyd:oai:researchdirect.westernsydney.edu.au:uws_67050 |
---|---|
record_format |
openpolar |
spelling |
ftunivwestsyd:oai:researchdirect.westernsydney.edu.au:uws_67050 2023-05-15T16:16:40+02:00 Assessing achievements in place-based initiatives : developing a tailor-made tool O’Connor, Patricia M. (R17796) Clune, Eleanor Marriner, Tracey Sheshgir, Shantanu Waddell, Jill 2022 print 20 https://doi.org/10.1177/1035719X221102278 https://hdl.handle.net/1959.7/uws:67050 eng eng U.K., Sage Publications Evaluation Journal of Australasia--1035-719X--2515-9372 Vol. 22 Issue. 3 No. pp: 173-192 XXXXXX - Unknown journal article 2022 ftunivwestsyd https://doi.org/10.1177/1035719X221102278 2022-09-05T22:24:51Z Assessing achievements of place-based initiatives (PBIs) has become increasingly important in contemporary evaluation practice. While key characteristics of successful PBIs have been described in the literature, the practicalities of assessing implementation progress across multiple PBIs under the umbrella of a single program invoke complex challenges. This article presents the process used to develop a tool for assessing implementation progress across a 14-site PBI aimed at improving health and education outcomes for First Nations children in Australia. Sites included a mix of metropolitan, regional, remote and very remote locations around Australia and varying levels of PBI maturity. A literature scan identified the attributes of successful PBIs and indicators/ measures that could be used to evaluate them. These attributes were condensed into eight domains, and a further two were added due to their importance for this evaluation. The identified indicators and measures were mapped against these domains to generate a question bank. A process of consistently rating sites against the measures relevant to each of them enabled the identification of achievements within each site, comparisons between sites and evaluation of the progress of the program overall. The development of this tool provides a case study for developing a practical, fit-forpurpose tool to evaluate PBIs. Article in Journal/Newspaper First Nations University of Western Sydney (UWS): Research Direct Evaluation Journal of Australasia 22 3 173 192 |
institution |
Open Polar |
collection |
University of Western Sydney (UWS): Research Direct |
op_collection_id |
ftunivwestsyd |
language |
English |
topic |
XXXXXX - Unknown |
spellingShingle |
XXXXXX - Unknown O’Connor, Patricia M. (R17796) Clune, Eleanor Marriner, Tracey Sheshgir, Shantanu Waddell, Jill Assessing achievements in place-based initiatives : developing a tailor-made tool |
topic_facet |
XXXXXX - Unknown |
description |
Assessing achievements of place-based initiatives (PBIs) has become increasingly important in contemporary evaluation practice. While key characteristics of successful PBIs have been described in the literature, the practicalities of assessing implementation progress across multiple PBIs under the umbrella of a single program invoke complex challenges. This article presents the process used to develop a tool for assessing implementation progress across a 14-site PBI aimed at improving health and education outcomes for First Nations children in Australia. Sites included a mix of metropolitan, regional, remote and very remote locations around Australia and varying levels of PBI maturity. A literature scan identified the attributes of successful PBIs and indicators/ measures that could be used to evaluate them. These attributes were condensed into eight domains, and a further two were added due to their importance for this evaluation. The identified indicators and measures were mapped against these domains to generate a question bank. A process of consistently rating sites against the measures relevant to each of them enabled the identification of achievements within each site, comparisons between sites and evaluation of the progress of the program overall. The development of this tool provides a case study for developing a practical, fit-forpurpose tool to evaluate PBIs. |
format |
Article in Journal/Newspaper |
author |
O’Connor, Patricia M. (R17796) Clune, Eleanor Marriner, Tracey Sheshgir, Shantanu Waddell, Jill |
author_facet |
O’Connor, Patricia M. (R17796) Clune, Eleanor Marriner, Tracey Sheshgir, Shantanu Waddell, Jill |
author_sort |
O’Connor, Patricia M. (R17796) |
title |
Assessing achievements in place-based initiatives : developing a tailor-made tool |
title_short |
Assessing achievements in place-based initiatives : developing a tailor-made tool |
title_full |
Assessing achievements in place-based initiatives : developing a tailor-made tool |
title_fullStr |
Assessing achievements in place-based initiatives : developing a tailor-made tool |
title_full_unstemmed |
Assessing achievements in place-based initiatives : developing a tailor-made tool |
title_sort |
assessing achievements in place-based initiatives : developing a tailor-made tool |
publisher |
U.K., Sage Publications |
publishDate |
2022 |
url |
https://doi.org/10.1177/1035719X221102278 https://hdl.handle.net/1959.7/uws:67050 |
genre |
First Nations |
genre_facet |
First Nations |
op_relation |
Evaluation Journal of Australasia--1035-719X--2515-9372 Vol. 22 Issue. 3 No. pp: 173-192 |
op_doi |
https://doi.org/10.1177/1035719X221102278 |
container_title |
Evaluation Journal of Australasia |
container_volume |
22 |
container_issue |
3 |
container_start_page |
173 |
op_container_end_page |
192 |
_version_ |
1766002524466184192 |