Expectation setting and relationship management are key to good integration of implementer and evaluator activities, especially for complex program evaluations. As mentioned above, it was critical to include the impact evaluation requirement in the CBRLM implementer’s Terms of Reference to establish clear expectations from the outset. However, it is also important to ensure that evaluators approach such arrangements as a partnership, treat the implementer with respect, listen to their concerns, and try to be flexible in addressing them. In addition, for this kind of adaptive pilot, MCC should encourage evaluation teams to consider whether a field-based member of the evaluation team could help monitor the evolution of the program and nurture a relationship with the implementer; and MCAs should encourage implementers to maintain open communication with independent evaluators. While some of these dynamics will be personality-dependent, if expectations are set upfront about the need for mutual respect and coordination, and fostered on both sides by the MCA and MCC contract managers, some of the challenges encountered in this evaluation might be avoided.
Lesson Learned