Results of evaluation: Revising programme strategies and plans, Empowering the Organization and increase learning
How do we Evaluate Programmes?
Executing the M&E action
An organization aiming at programme program quality should establish a system of Monitoring and Evaluation. In fact in order to ensure program quality programme managers need to use the feed back of monitoring and evaluation in order to:
check whether the programme or project is being implemented according to plans and assess whether the programme of project is resulting in the anticipated changes or impacts (thereby fulfilling the basic requirement for a projectized organization);
identify key learning points to feed back in improved programme design and management (thereby fulfilling the basic requirement for a learning organization);
identify the need and the scope to raise the capacity of the human resources of the organization to manage successfully their task and contribute to the generation of a healthy communication climate within the organization and with external stakeholders. (thereby fulfilling the basic requirement for an employee empowering organization).
Building professional reputation and standards in organizational activities and image.
Uses of evaluation should be consistent with the set M&E action objectives and with the requirements for organization development.
Empowerment of the employees can be achieved where M&E processes are aimed at fostering organizational development and learning.
It is very important to link evaluation of managerial processes with the evaluation of the programme/project outcomes. For a manager to learn means to understand the relationship between processes and outcomes since s/he can achieve outcomes only by improving the management of processes. Although there are different indicators and different information sources for monitoring and evaluating processes (efficiency, accountability and transparency , etc.) and outcomes (effectiveness, sustainability, impact), real understanding can be done only integrating the two dimension in a unitary vision of necessary relationship amongst resources, activities, results, objectives and impacts. The central element is always the empowerment of the human resources to do actions in a better way so as to achieve better results and obtain better outcomes.
Templates:
--------
Here describe the steps that you take for using effectively the results of evaluation
.............
The outputs of evaluation can be utilised for:
Supporting project teams and partners in identifying the strengths and gaps in design, development, implementation, monitoring and evaluation of projects, working with them to integrate this learning into projects and sustaining them in their efforts to ensure high quality programmes with long term impact and sustainability.
While the Programme Quality Advisor:
a) evaluates the efficiency, effectiveness and impacts of projects
b) assesses whether quality processes and procedures have been followed in developing, designing, monitoring and evaluating projects
c) examines whether the project is within the purview of programme frameworks
d) assess whether changes in indicators are being measured and are as expected
e) identifies gaps and elaborates a plan for improving projects and programme quality and accompanies teams to this end
f) accompanies the programme manager and project managers in improving project and programme quality by tutoring, mentoring, training in the processes and sectors of project management and impact
the Programme Manager works with project management teams and partners and relevant stakeholders:
a) to develop and design the project and ensure that it falls within country programme frameworks and strategies
b) to define activity workplans and forecast monthly budgets for the financial year
c) to ensure that the project activities are being implemented according to defined work plans
d) to ensure that inputs (budgets and human resources) are appropriate and adequate for undertaking planned activities
e) to make sure that financial, logistic and administrative management is according to mandatory procedures
f) to monitor that activities are effective in producing planned outputs/deliverables
g) to make sure that reporting is against planned objectives and activities
Empowering the country programme teams and partners by increasing their knowledge and understanding on programme quality, impact, accountability and learning and assisting them in developing and prioritising work plans and processes to this end
The Programme Manager:
a) Helps teams to increase their knowledge and understanding on various aspects of project quality
b) monitors and evaluates whether projects are within programme and strategy frameworks
c) supports project managers, teams and partners in integrating quality into the processes and components of project management
The Programme Quality Advisor:
a) Advises the Programme Manager on how to improve the quality of her/his programmes
b) Works with programme and project managers to establish systematic and structured systems that improve accountability and learning
c) Evaluates projects and programmes and advises managers on future priorities and strategies for enhancing the quality and impact of work.
Spreading the culture of developing and implementing quality programmes, strategies and priorities that integrate monitoring, evaluation and learning, encouraging networking with stakeholders to strengthen this process.
The Programme Quality Advisor:
a) Assesses needs of communities and project teams
b) Evaluates projects, make recommendations and elaborate work plans along with managers
c) Networks with internal and external stakeholders
Supporting country programmes to develop structured and systematic processes that are aligned with the Monitoring, Evaluating and Learning plans and processes of the organisation and recommend steps towards this end
The Programme Quality Advisor:
a) Explains the Monitoring, Evaluation and Learning System and processes to the programme and project managers
b) assists managers in establishing these plans, systems and processes and monitors implementation
Coordinating with organisations and networks working in similar programme sectors so that innovation is encouraged and staff capacity is developed
The Programme Quality Advisor:
a) works with experts to improve programme quality and bring external learning into the organisation
b) works with managers to identify their needs and explore ways of responding
Advising the Regional Programme Manager on quality standards and achievements made by country programmes and supporting teams in exploring and securing multi-year funding
The Programme Quality Advisor:
a) Communicates regularly with the Regional Manager on achievements and gaps in project and programme quality and impacts and makes recommendations
b) works with experts to bring specialised experience and learning into the organisation
c) works with the Funding Department to understand niches for multiyear funding
Supporting senior regional managers in formulating strategies and reporting on programme impact through effective use of existing organizational systems
The Programme Quality Advisor:
a) Utilises existing systems to analyze the quality and communicate programme work
b) Analyses the quality of reports and examines on-ground reality
Coordinating with other departments and achieving effective cross functioning for better programme quality
The Programme Quality Advisor:
a) Works in synergy with other relevant departments (in region and outside) to support, advise and take support on issues of programme quality
-------------------
Other resources:
IPTET how to reorient your focus from the project level to country, thematic sector, or global levels
See also:
Job profiles of an evaluation expert in a development organization
----------
Evaluation Constraints |
Every program planner faces
limitations when conducting an outcome evaluation. You may need to
adjust your evaluation to accommodate constraints such as the following:
These constraints may make the ideal evaluation impossible. If you must compromise your evaluation’s design, data collection, or analysis to fit limitations, decide whether the compromises will make the evaluation results invalid. If your program faces severe constraints, do a small-scale evaluation well rather than a large-scale evaluation poorly. Realize that it is not sensible to conduct an evaluation if it is not powerful enough to detect a statistically significant change. |
Other resources: