Products and Services

Evaluators.EU is specialized in all types of evaluations covering the complete programme and project cycle.

We use the following definition of an evaluation:

• It is an independent, objective examination of the design, implementation, results and impact of public interventions

• It is a management tool allowing to better focus on needs, needs for programme changes and better accountability based on indicators of financial inputs, outputs, results and impacts

• It examines results and impacts assisted by Evaluation Questions and indicators

• It examines the administrative and institutional set-up

The evaluations are based on Logical Framework Approach and related evaluation criteria such as relevance, effectiveness, efficiency, utility and sustainability. Exogenous analyses are included in our evaluations in order to assess the counterfactual situation with no intervention implemented, as well as potential dead-weight, substitution, displacement and leverage effects.

We cover the traditional ex ante evaluations, midterm evaluations and ex post evaluations, as well as the new principles of on-going evaluations to be implemented together with the new Rural Development Programmes 2007-2013.

The services include technical assistance and training to programme development and monitoring; project identification, appraisal and feasibility studies; strategy processes and development and analyses related hereto such as SWOT analysis, Cost-Benefit Analyses and descriptions of appropriate mission and vision statements.

Finally we implement stakeholder and user satisfaction surveys using quantitative as well as qualitative methods.

Our most important products and services are described below.

Ex ante evaluations:
The ex ante evaluations contribute to the quality and effectiveness of programming. Ex ante evaluation is part of each programme and aim to optimise the allocation of budgetary resources and improve programming quality. The ex ante evaluations shall identify and appraise medium and long-term needs of the sector or country in question as well as the goals to be achieved, the results expected, the quantified targets particularly in terms of impact in relation to the baseline situation. Furthermore the Community value-added, the extent to which the Community’s priorities have been taken into account shall be evaluated together with the lessons drawn from previous programming. Finally, the quality of the procedures for implementation, monitoring, evaluation and financial management are evaluated.

Midterm evaluations:
The overall objective of midterm evaluations is to improve the programme and project intervention and to provide recommendations for a reconsideration of objectives, allocation of funds and priorities.  The mid-term evaluations include an assessment of the continued appropriateness of the implemented strategy, relevance and consistency with the programme document, use of input from the programme and initial achievements, results, effectiveness and efficiency of the programme, including financial effectiveness. Finally, the midterm evaluations include an assessment of the appropriateness of programme monitoring and implementation system.

Ex post evaluations:
Ex post evaluations assesses the achievements of the programme and project in terms of inputs, outputs, results and impacts. The utilization of financial resources as well as the effectiveness and efficiency and the sustainability of actions and effects are covered. Furthermore contributions to European policies are assessed, such as the CAP and the acquis. Ex post evaluations contribute with proposals and recommendations for new interventions and programming periods.

On-going evaluations:
The on-going evaluation principles represent a continuous year-by-year monitoring and evaluation of the programme implementation. The on-going evaluations cover the same objectives and criteria as midterm and ex post evaluations, but provide faster and timely data and input to the monitoring authorities in order for them to readjust the programme intervention, if needed.

Strategy development and SWOT analyses
Strategy development services include assistance to organisations in the preparation of strategies at appropriate level including formulation of mission and vision statements, SWOT analyses and action plans. A SWOT analysis is a structured tool to identify internal strengths and weaknesses in order to take advantage of external opportunities and to overcome external threats with the aim to develop a strategy for fulfilment of defined objectives. Our principal approach includes the following steps:
Define internal strengths and weaknesses; Define external opportunities and threats; Set up a SWOT matrix; Define overall objectives; Define various strategic possibilities; Define criteria for choice of strategy; Select strategy; Implement strategy!

User satisfaction and stakeholder analyses
Stakeholder/user satisfaction analyses focus on the assessments of the stakeholders/users satisfaction with the quality and scope of the performances of the organisation or institution in question. As an example it can be the stakeholder satisfaction with a university institute regarding research, education and training, support to public authorities and dissemination of information. Proposals for improved performance and content of services are typically included in the surveys. The analyses are carried out as personal and telephone interviews with stakeholder representatives, supplemented with questionnaires, if quantitative analyses are needed and relevant.