Basic models of suggested evaluation budgets and methods

Last month we published a news story about what we learned from a review of 200 Heritage Grants evaluation reports.

I'm keen to share some of the key findings from the review with OC users. I've already pulled out some dos and don'ts, and below I list some suggested models - and this is just a starting point - around the proportion of expenditure on evaluaton and the type of aceptable methodologies.

The suggestions make a distinction between formative and summative evaluation - 

  • Formative evaluation is defined as any evaluation that takes place before or during a project's implementation with the aim of improving the project's design and performance.  
  • On the other hand, summative evaluation focuses solely on the outcome of a programme and is thus more complex in its requirements.

Remember, these suggested models are provided simply to give grantees a sense of the scale of evaluation activity, the focus of that activity, and how it relates to the outcomes framework.

Under £100k projects

  • Spend on evaluation: Completed internally and up to 3% of budget
  • Type of evaluation: Summative
  • Acceptable Methodologies: Visitor books, Trip Advisor Feedback etc.
  • Outcomes: Focus on participation and engagement

£100k-£300k projects

  • Spend on evaluation: Completed internally and up to 3% of budget
  • Type of evaluation: Summative
  • Acceptable Methodologies: Basic primary research approaches
  • Outcomes: Focus on participation and engagement

£300-£500k projects

  • Spend on evaluation: 3-5% of budget and use of external supplier 
  • Type of evaluation: Summative & Formative
  • Use of baseline: Development of baselines & tracking against them
  • Acceptable Methodologies: Basic primary research approaches
  • Outcomes: Focus on short and medium term objectives 

£500k-£1m projects

  • Spend on evaluation: 5-7% of budget and use of external supplier  
  • Type of evaluation: Summative & Formative
  • Use of baseline: Development of baselines & tracking against them
  • Acceptable Methodologies: Advanced qualitative and quantitative research
  • Outcomes: Focus on all levels of objectives

Over £1m projects

  • Spend on evaluation: 7-10% of budget and use of external supplier  
  • Type of evaluation: Summative & Formative
  • Use of baseline: Development of baselines & tracking against them
  • Acceptable Methodologies: Advanced qualitative and quantitative research
  • Outcomes: Focus on all levels of objectives

 

I'd be keen to hear your thoughts - or questions - on these models, or examples of how you've approached your own evaluation which others might find useful.

View Amy Freeborn's profile Amy Freeborn Aug 11 2017 - 11:54am
Back to top of page