Evaluation may be concerned with impacts prior to initiatives (as part of appraisals) or post implementation. Issues of added value and additionality are important taking account of deadweight, displacement and wider effects and the lessons learnt.

PACEC has been at the forefront of the development of evaluation methodologies for many years and contributed to guidance (such as the BIS IEF and the Green Book). By using a variety of research techniques, in the context of a rigorous conceptual framework, we are able to measure the effects of particular policy instruments and initiatives and separate them from the effects of other economic influences. We have advised a large number of agencies and the private sector on economic impact, cost effectiveness and the efficiency of their policies.

Key Issues

  • Developing evaluation frameworks
  • Clarifying policy aims, and targets
  • Identifying performance measures (quantitative and qualitative)
  • Preparing baseline studies
  • Assessing the impact on partnerships and delivery
  • Measuring immediate, interim and intermediate outputs
  • Measuring improved performance and economic impacts
  • Assessing the wider effects of policy
  • Assessing socio-economic impact of projects or policy
  • The costs and benefits (environmental, social & economic)
  • Additionality and added value

Examples of Evaluations

  • Evaluation Methodologies: Projects for central government and RDAs. HM Treasury, DTI, Small Business Service, ODPM, DfES, and DWP and ONE North East, Yorkshire Forward, and Advantage West Midlands.
  • BIS: National evaluations of the Business Links, HOTS and Scholars Exporting programmes, the International Sales Leads Services, Export Credits, SMART grants for Innovation (R&D grants), Faraday Programme, Teaching Company Scheme and support for Regional Technology Organisations, and the wider effects of inward investment. Evaluations have covered all English regions.
  • DWP: Evaluations of Investors in People, the Leadership Management Development Programme, and the Impact of ESF funding.
  • Scottish Enterprise: Evaluations of national Skillseekers training programme, training for inward investors, capital grants for university training, and investment readiness support.
  • Welsh Assembly Government: Evaluations of inward investment programmes, urban and town centre regeneration grants, the Regional Technology Plan, support for third sector agencies, and regeneration of former steel production areas.
  • Inland Revenue/HMT: Evaluations of the Enterprise Investment Scheme and Venture Capital Trusts.
  • European Commission: Evaluations of Objective 5b policies, the impact of single currency on British banking and financial services, and fisheries policy in the UK.

Examples of economic impact studies

  • European High Speed Rail Network
  • Extension of Docklands Light Railway in London
  • Channel Tunnel Rail Link
  • Impact of EU policy on British Banking
  • Property schemes: retail centres, offices, business and science parks
  • Duty Free Sales and Channel Ferries
  • Hunting with Dogs (Burns Enquiry)
  • Shooting Sports Industry
  • Stansted, Luton and proposed Cliffe airports

The overall impact of agencies

  • South Yorkshire, Objective 1 and 2 policies
  • Scottish Enterprise
  • Surrey and Kent County Council
  • Business Links in Tyneside, Durham, Hampshire, Surrey and Leeds
  • LSCs/TECs in Surrey, Hampshire and Tyneside.
  • One North East. Ongoing programme of output measurement
  • Yorkshire Forward. Appraisal and evaluation systems
  • LDA. Thames Gateway projects

These projects have utilised the PACEC Impact Assessment Model (IAM) which combines national and local evaluation evidence to provide estimates of employment, quality of jobs and income.