EVALUATION OF THE WELSH LOCAL GOVERNMENT ASSOCIATION’S IMPROVEMENT PROGRAMME

Descriptions

We are open to bidders’ suggestions on how to approach the evaluation, but the following approach should be considered.The Welsh Government’s preference is for a theory-based approach to the evaluation of the programme. This is particularly important for clarifying the intended outcomes of the programme and developing an understanding of how its various components would contribute to them. Developing a Theory of Change is an important first step in any evaluation and provides the necessary foundation for the evaluation to look notjust at how the intervention is working, what it produces (outputs, outcomes and impacts) butalso to critically assess these against the expectations and assumptions which underlie the programme. Suppliers can offer an alternative approach as long as it is suitably justified.In developing and refining the Theory of Change, the contractor could focus on the following, but not exclusive, objectives:•Draw on existing work and literature on (and relevant to) the three core themes of the Improvement Programme in order to understand the context and progress of each in Wales and, where appropriate, examples from further afield (UK and internationally) that can help develop current thinking around corporate improvement in local and national government.•Consult with colleagues responsible for developing and delivering the programme and related policies, to define the key concepts and establish the focus for the Theory of Change•Establish a first draft Theory of Change in collaboration with programme and policy makers and key stakeholders to gauge their understanding of the key activities and to define intended outcomes of the programme;•Produce a revised Theory of Change (following consultation with policy officials) that includes an outline of the key issues and risks of delivering the programme logics, advice on baseline data and options for future evaluations of the Programme.Develop a framework for the evaluation that outlines the research design and key questions to be answered, any gaps or limitations in the current evidence base, and the research methods (both for analysis and data collection) that can answer the evaluation questions.Developing a Theory of Change will help the contractor to identify the right evaluation type and approach and produce an appropriate plan for the evaluation stage of the research.The evaluation of the programme should focus on two elements:To review the implementation of the programme, in terms of its design and delivery (the “Process Evaluation”). To achieve this, the specific objectives will be, but not be exclusive to:•Understand the context within which the programme is working and the extent to which it aligns with wider commitments of the Welsh Government;•Examine the design, implementation and delivery of the programme across local authorities in Wales;•Identify which aspects of the programmes’ design and implementation work well and why, which aspects of the programme need improvement and why, and to identify any barriers or enablers to improving its implementation; and•Make recommendations for policy and delivery to inform ongoing implementation of the programme and support future developments in providing for strategic improvements in local authorities.To examine the extent to which the programme and its core activities have successfully reached all the people they were intended to and provide appropriate support to recipients (the “Outcome Evaluation”). The specific objectives are, but not exclusive, to:•Examine the extent to which councillors and senior council leaders have been effectively engaged through the interventions;•Provide an assessment of the impact of the interventions on local authorities, with a particular focus on their processes of delivery;•Provide an assessment of the likely impact of the activities implemented on recipients;•Identify which aspects of the programme have been particularly successful and provide examples of good practice; and•Highlight cases where the programme and its activities have worked less well and how any difficulties/obstacles have been overcome.NOTE: The authority is using eTenderwales to carry out this procurement process. To obtain further information record your interest on Sell2Wales at https://www.sell2wales.gov.wales/search/search_switch.aspx?ID=129006