Results of evaluation: Revising programme strategies and plans, Empowering the Organization and increase learning

 

How do we Evaluate Programmes?

Executing  the M&E action

 

An organization aiming at programme program quality should establish a system of Monitoring and Evaluation.  In fact in order to ensure  program quality programme managers need to use the feed back of monitoring and evaluation in order to:

 

Uses of evaluation should be consistent with the set M&E action objectives and with the requirements for organization development.

Empowerment of the employees  can be achieved where M&E processes are aimed at fostering organizational development and learning.

It is very important to link evaluation of managerial processes with the evaluation of the programme/project outcomes. For a manager to learn means to understand the relationship between processes and outcomes since s/he can achieve outcomes only by improving the management of processes.  Although there are different indicators and different information sources for monitoring and evaluating processes  (efficiency, accountability and transparency  , etc.) and outcomes  (effectiveness, sustainability, impact), real understanding can be done only integrating the two dimension in a unitary vision of necessary relationship amongst resources, activities, results, objectives and impacts.  The central element is always the empowerment of the human resources to do actions in a better way so as to achieve better results and obtain better outcomes. 

 

 

 

Templates:

 

--------

Here describe the steps that you take for using effectively the results of evaluation

 

.............

 

The outputs of evaluation can be utilised for:

Supporting project teams and partners in identifying the strengths and gaps in design, development, implementation, monitoring and evaluation of projects, working with them to integrate this learning into projects and sustaining them in their efforts to ensure high quality programmes with long term impact and sustainability.

 

While the Programme Quality Advisor:

a)      evaluates the efficiency, effectiveness and impacts of projects

b)      assesses whether quality processes and procedures have been followed in developing, designing, monitoring and evaluating projects

c)      examines whether the project is within the purview of programme frameworks

d)     assess whether changes in indicators are being measured and are as expected

e)      identifies gaps and elaborates a plan for improving projects and programme quality and accompanies teams to this end

f)       accompanies the programme manager and project managers in improving project and programme quality by tutoring, mentoring, training in the processes and sectors of project management and impact

 

the Programme Manager works with project management teams and partners and relevant stakeholders:

a)      to develop and design the project and ensure that it falls within country programme frameworks and strategies

b)      to define activity workplans and forecast monthly budgets for the financial year

c)      to ensure that the project activities are being implemented according to defined work plans

d)     to ensure that inputs (budgets and human resources) are appropriate and adequate for undertaking planned activities

e)      to make sure that financial, logistic and administrative management is according to mandatory procedures

f)       to monitor that activities are effective in producing planned outputs/deliverables

g)      to make sure that reporting is against planned objectives and activities

 

 

Empowering the country programme teams and partners by increasing their knowledge and understanding on programme quality, impact, accountability and learning and assisting them in developing and prioritising work plans and processes to this end

 

The Programme Manager:

a)      Helps teams to increase their knowledge and understanding on various aspects of project quality

b)      monitors and evaluates whether projects are within programme and strategy frameworks

c)      supports project managers, teams and partners in integrating quality into the processes and components of project management

The Programme Quality Advisor:

a)      Advises the Programme Manager on how to improve the quality of her/his programmes

b)      Works with programme and project managers to establish systematic and structured systems that improve accountability and learning

c)      Evaluates projects and programmes and advises managers on future priorities and strategies for enhancing the quality and impact of work.

 

Spreading the culture of developing and implementing quality programmes, strategies and priorities that integrate monitoring, evaluation and learning, encouraging networking with stakeholders to strengthen this process.

The Programme Quality Advisor:

a)      Assesses needs of communities and project teams

b)      Evaluates projects, make recommendations and elaborate work plans along with managers

c)      Networks with internal and external stakeholders

 

Supporting country programmes to develop structured and systematic processes that are aligned with the Monitoring, Evaluating and Learning plans and processes of the organisation and recommend steps towards this end

 

The Programme Quality Advisor:

a)      Explains the Monitoring, Evaluation and Learning System and processes to the programme and project managers

b)      assists managers in establishing these plans, systems and processes and monitors  implementation

 

Coordinating with organisations and networks working in similar programme sectors so that innovation is encouraged and staff capacity is developed

The Programme Quality Advisor:

a)      works with experts to improve programme quality and bring external learning into the organisation

b)      works with managers to identify their needs and explore ways of responding

 

Advising the Regional Programme Manager on quality standards and achievements made by country programmes and supporting teams in exploring and securing multi-year funding

The Programme Quality Advisor:

a)      Communicates regularly with the Regional Manager on achievements and gaps in project and programme quality and impacts and makes recommendations

b)      works with experts to bring specialised experience and learning into the organisation

c)      works with the Funding Department to understand niches for multiyear funding

 

Supporting senior regional managers in formulating strategies and reporting on programme impact through effective use of existing organizational systems

The Programme Quality Advisor:

a)      Utilises existing systems to analyze the quality and communicate programme work

b)      Analyses the quality of reports and examines on-ground reality

 

Coordinating with other departments and achieving effective cross functioning for better programme quality

 

The Programme Quality Advisor:

a)      Works in synergy with other relevant departments (in region and outside) to support, advise and take support on issues of programme quality

 

 

 

-------------------

Other resources:

IPTET how to manage evaluations, how to assess the quality of an evaluation, and how to get your evaluation results used

IPTET how to reorient your focus from the project level to country, thematic sector, or global levels

 

 

See also:

Job profiles of an evaluation expert in a development organization

 

 

----------

 

 

 

 

Evaluation Constraints
Every program planner faces limitations when conducting an outcome evaluation. You may need to adjust your evaluation to accommodate constraints such as the following:
  • Limited funds
  • Limited staff time or expertise
  • Length of time allotted to the program and its evaluation
  • Organizational restrictions on hiring consultants or contractors
  • Policies that limit your ability to collect information from the public
  • Difficulty in defining the program’s objectives or in establishing consensus on them
  • Difficulty in isolating program effects from other influences on the intended audience in "real world" situations
  • Management perceptions of the evaluation’s value

These constraints may make the ideal evaluation impossible. If you must compromise your evaluation’s design, data collection, or analysis to fit limitations, decide whether the compromises will make the evaluation results invalid. If your program faces severe constraints, do a small-scale evaluation well rather than a large-scale evaluation poorly. Realize that it is not sensible to conduct an evaluation if it is not powerful enough to detect a statistically significant change.

 

 

Other resources: