Measuring Results
A Learning Organization
As a learning organization, Pamoja is keen to find out precisely what impact its projects have. This enables Pamoja to learn from success and failure, plan future projects better and show accountability to the communities it serves as well as to partners and donors. Pamoja learns from its daily work in different ways, for instance by regular review and reflection forums to assess what went well and what could be done better. Over the past years, Pamoja has built a monitoring and results measurement (MRM) system into all its projects. This system measures qualitative and quantitative indicators, covering outputs, outcomes, impact, partners and efficiency.
Pamoja received technical support and advise to develop a MRM framework from external MRM advisors. Pamoja has worked towards aligning its MRM framework to global good-practice standards, such as the Donor Committee on Enterprise Development (DCED) Standards.
Choosing meaningful indicators
Due to the complexity and multi-faceted nature of our operating environment of conflict and development needs, we use a dynamic and flexible framework for capturing results. We use a Mixed-Method Approach to monitor and evaluate peace and development programming, collecting and analysing quantitative and qualitative information and data. To this end, we select meaningful indicators and analyse numerical data, but also social impact and the “human element”, such as changes in knowledge, behavior and attitude. We also record how our programs have removed barriers to enable a shift in behaviour to take place. Our result frameworks are continuously improved and fine-tuned to adapt to the changing dynamics. Data collection tools we use include surveys, observations, focus groups, in-depth interviews, case studies, videos and audios and story-telling.
To ensure lasting gains we continuously develop the capacity to build our learning systems. Once an evaluation has been completed, we use the findings to improve the assessed project and future activities. Whenever appropriate, the findings are disseminated among partner organizations and relevant actors so as to contribute to the policy development thinking and best practice design.