Assessing achievements in place-based initiatives : developing a tailor-made tool

Assessing achievements of place-based initiatives (PBIs) has become increasingly important in contemporary evaluation practice. While key characteristics of successful PBIs have been described in the literature, the practicalities of assessing implementation progress across multiple PBIs under the u...

Full description

Bibliographic Details
Published in:Evaluation Journal of Australasia
Main Authors: O’Connor, Patricia M. (R17796), Clune, Eleanor, Marriner, Tracey, Sheshgir, Shantanu, Waddell, Jill
Format: Article in Journal/Newspaper
Language:English
Published: U.K., Sage Publications 2022
Subjects:
Online Access:https://doi.org/10.1177/1035719X221102278
https://hdl.handle.net/1959.7/uws:67050
id ftunivwestsyd:oai:researchdirect.westernsydney.edu.au:uws_67050
record_format openpolar
spelling ftunivwestsyd:oai:researchdirect.westernsydney.edu.au:uws_67050 2023-05-15T16:16:40+02:00 Assessing achievements in place-based initiatives : developing a tailor-made tool O’Connor, Patricia M. (R17796) Clune, Eleanor Marriner, Tracey Sheshgir, Shantanu Waddell, Jill 2022 print 20 https://doi.org/10.1177/1035719X221102278 https://hdl.handle.net/1959.7/uws:67050 eng eng U.K., Sage Publications Evaluation Journal of Australasia--1035-719X--2515-9372 Vol. 22 Issue. 3 No. pp: 173-192 XXXXXX - Unknown journal article 2022 ftunivwestsyd https://doi.org/10.1177/1035719X221102278 2022-09-05T22:24:51Z Assessing achievements of place-based initiatives (PBIs) has become increasingly important in contemporary evaluation practice. While key characteristics of successful PBIs have been described in the literature, the practicalities of assessing implementation progress across multiple PBIs under the umbrella of a single program invoke complex challenges. This article presents the process used to develop a tool for assessing implementation progress across a 14-site PBI aimed at improving health and education outcomes for First Nations children in Australia. Sites included a mix of metropolitan, regional, remote and very remote locations around Australia and varying levels of PBI maturity. A literature scan identified the attributes of successful PBIs and indicators/ measures that could be used to evaluate them. These attributes were condensed into eight domains, and a further two were added due to their importance for this evaluation. The identified indicators and measures were mapped against these domains to generate a question bank. A process of consistently rating sites against the measures relevant to each of them enabled the identification of achievements within each site, comparisons between sites and evaluation of the progress of the program overall. The development of this tool provides a case study for developing a practical, fit-forpurpose tool to evaluate PBIs. Article in Journal/Newspaper First Nations University of Western Sydney (UWS): Research Direct Evaluation Journal of Australasia 22 3 173 192
institution Open Polar
collection University of Western Sydney (UWS): Research Direct
op_collection_id ftunivwestsyd
language English
topic XXXXXX - Unknown
spellingShingle XXXXXX - Unknown
O’Connor, Patricia M. (R17796)
Clune, Eleanor
Marriner, Tracey
Sheshgir, Shantanu
Waddell, Jill
Assessing achievements in place-based initiatives : developing a tailor-made tool
topic_facet XXXXXX - Unknown
description Assessing achievements of place-based initiatives (PBIs) has become increasingly important in contemporary evaluation practice. While key characteristics of successful PBIs have been described in the literature, the practicalities of assessing implementation progress across multiple PBIs under the umbrella of a single program invoke complex challenges. This article presents the process used to develop a tool for assessing implementation progress across a 14-site PBI aimed at improving health and education outcomes for First Nations children in Australia. Sites included a mix of metropolitan, regional, remote and very remote locations around Australia and varying levels of PBI maturity. A literature scan identified the attributes of successful PBIs and indicators/ measures that could be used to evaluate them. These attributes were condensed into eight domains, and a further two were added due to their importance for this evaluation. The identified indicators and measures were mapped against these domains to generate a question bank. A process of consistently rating sites against the measures relevant to each of them enabled the identification of achievements within each site, comparisons between sites and evaluation of the progress of the program overall. The development of this tool provides a case study for developing a practical, fit-forpurpose tool to evaluate PBIs.
format Article in Journal/Newspaper
author O’Connor, Patricia M. (R17796)
Clune, Eleanor
Marriner, Tracey
Sheshgir, Shantanu
Waddell, Jill
author_facet O’Connor, Patricia M. (R17796)
Clune, Eleanor
Marriner, Tracey
Sheshgir, Shantanu
Waddell, Jill
author_sort O’Connor, Patricia M. (R17796)
title Assessing achievements in place-based initiatives : developing a tailor-made tool
title_short Assessing achievements in place-based initiatives : developing a tailor-made tool
title_full Assessing achievements in place-based initiatives : developing a tailor-made tool
title_fullStr Assessing achievements in place-based initiatives : developing a tailor-made tool
title_full_unstemmed Assessing achievements in place-based initiatives : developing a tailor-made tool
title_sort assessing achievements in place-based initiatives : developing a tailor-made tool
publisher U.K., Sage Publications
publishDate 2022
url https://doi.org/10.1177/1035719X221102278
https://hdl.handle.net/1959.7/uws:67050
genre First Nations
genre_facet First Nations
op_relation Evaluation Journal of Australasia--1035-719X--2515-9372 Vol. 22 Issue. 3 No. pp: 173-192
op_doi https://doi.org/10.1177/1035719X221102278
container_title Evaluation Journal of Australasia
container_volume 22
container_issue 3
container_start_page 173
op_container_end_page 192
_version_ 1766002524466184192