Assessing achievements in place-based initiatives – developing a tailor-made tool

Assessing achievements of place-based initiatives (PBIs) has become increasingly important in contemporary evaluation practice. While key characteristics of successful PBIs have been described in the literature, the practicalities of assessing implementation progress across multiple PBIs under the u...

Full description

Bibliographic Details
Published in:Evaluation Journal of Australasia
Main Authors: O’Connor, Patricia M, Clune, Eleanor, Marriner, Tracey, Sheshgir, Shantanu, Waddell, Jill
Format: Article in Journal/Newspaper
Language:English
Published: SAGE Publications 2022
Subjects:
Online Access:http://dx.doi.org/10.1177/1035719x221102278
http://journals.sagepub.com/doi/pdf/10.1177/1035719X221102278
http://journals.sagepub.com/doi/full-xml/10.1177/1035719X221102278
id crsagepubl:10.1177/1035719x221102278
record_format openpolar
spelling crsagepubl:10.1177/1035719x221102278 2023-05-15T16:16:41+02:00 Assessing achievements in place-based initiatives – developing a tailor-made tool O’Connor, Patricia M Clune, Eleanor Marriner, Tracey Sheshgir, Shantanu Waddell, Jill 2022 http://dx.doi.org/10.1177/1035719x221102278 http://journals.sagepub.com/doi/pdf/10.1177/1035719X221102278 http://journals.sagepub.com/doi/full-xml/10.1177/1035719X221102278 en eng SAGE Publications http://journals.sagepub.com/page/policies/text-and-data-mining-license Evaluation Journal of Australasia volume 22, issue 3, page 173-192 ISSN 1035-719X 2515-9372 Sociology and Political Science Development journal-article 2022 crsagepubl https://doi.org/10.1177/1035719x221102278 2022-08-12T11:30:21Z Assessing achievements of place-based initiatives (PBIs) has become increasingly important in contemporary evaluation practice. While key characteristics of successful PBIs have been described in the literature, the practicalities of assessing implementation progress across multiple PBIs under the umbrella of a single program invoke complex challenges. This article presents the process used to develop a tool for assessing implementation progress across a 14-site PBI aimed at improving health and education outcomes for First Nations children in Australia. Sites included a mix of metropolitan, regional, remote and very remote locations around Australia and varying levels of PBI maturity. A literature scan identified the attributes of successful PBIs and indicators/measures that could be used to evaluate them. These attributes were condensed into eight domains, and a further two were added due to their importance for this evaluation. The identified indicators and measures were mapped against these domains to generate a question bank. A process of consistently rating sites against the measures relevant to each of them enabled the identification of achievements within each site, comparisons between sites and evaluation of the progress of the program overall. The development of this tool provides a case study for developing a practical, fit-for-purpose tool to evaluate PBIs. Article in Journal/Newspaper First Nations SAGE Publications (via Crossref) Evaluation Journal of Australasia 22 3 173 192
institution Open Polar
collection SAGE Publications (via Crossref)
op_collection_id crsagepubl
language English
topic Sociology and Political Science
Development
spellingShingle Sociology and Political Science
Development
O’Connor, Patricia M
Clune, Eleanor
Marriner, Tracey
Sheshgir, Shantanu
Waddell, Jill
Assessing achievements in place-based initiatives – developing a tailor-made tool
topic_facet Sociology and Political Science
Development
description Assessing achievements of place-based initiatives (PBIs) has become increasingly important in contemporary evaluation practice. While key characteristics of successful PBIs have been described in the literature, the practicalities of assessing implementation progress across multiple PBIs under the umbrella of a single program invoke complex challenges. This article presents the process used to develop a tool for assessing implementation progress across a 14-site PBI aimed at improving health and education outcomes for First Nations children in Australia. Sites included a mix of metropolitan, regional, remote and very remote locations around Australia and varying levels of PBI maturity. A literature scan identified the attributes of successful PBIs and indicators/measures that could be used to evaluate them. These attributes were condensed into eight domains, and a further two were added due to their importance for this evaluation. The identified indicators and measures were mapped against these domains to generate a question bank. A process of consistently rating sites against the measures relevant to each of them enabled the identification of achievements within each site, comparisons between sites and evaluation of the progress of the program overall. The development of this tool provides a case study for developing a practical, fit-for-purpose tool to evaluate PBIs.
format Article in Journal/Newspaper
author O’Connor, Patricia M
Clune, Eleanor
Marriner, Tracey
Sheshgir, Shantanu
Waddell, Jill
author_facet O’Connor, Patricia M
Clune, Eleanor
Marriner, Tracey
Sheshgir, Shantanu
Waddell, Jill
author_sort O’Connor, Patricia M
title Assessing achievements in place-based initiatives – developing a tailor-made tool
title_short Assessing achievements in place-based initiatives – developing a tailor-made tool
title_full Assessing achievements in place-based initiatives – developing a tailor-made tool
title_fullStr Assessing achievements in place-based initiatives – developing a tailor-made tool
title_full_unstemmed Assessing achievements in place-based initiatives – developing a tailor-made tool
title_sort assessing achievements in place-based initiatives – developing a tailor-made tool
publisher SAGE Publications
publishDate 2022
url http://dx.doi.org/10.1177/1035719x221102278
http://journals.sagepub.com/doi/pdf/10.1177/1035719X221102278
http://journals.sagepub.com/doi/full-xml/10.1177/1035719X221102278
genre First Nations
genre_facet First Nations
op_source Evaluation Journal of Australasia
volume 22, issue 3, page 173-192
ISSN 1035-719X 2515-9372
op_rights http://journals.sagepub.com/page/policies/text-and-data-mining-license
op_doi https://doi.org/10.1177/1035719x221102278
container_title Evaluation Journal of Australasia
container_volume 22
container_issue 3
container_start_page 173
op_container_end_page 192
_version_ 1766002531747495936