Job Abstract

Senior Evaluation Officer

Description

Do you want to build a career that is truly worthwhile? The World Bank Group is one of the largest sources of funding and knowledge for developing countries; a unique global partnership of five institutions dedicated to ending extreme poverty and promoting shared prosperity. With 189 member countries and more than 120 offices worldwide, we work with public and private sector partners, investing in groundbreaking projects and using data, research, and technology to develop solutions to the most urgent global challenges. For more information, visit www.worldbank.org.

Background and Context:

The Independent Evaluation Group (IEG)'s mission is to improve World Bank Group (WBG) development results through excellence in evaluation. IEG is responsible for the assessment of the relevance, efficacy, and efficiency of WBG operational policies, programs and activities, and their contribution to development effectiveness. IEG's evaluations aim to enhance accountability and learning to inform the formulation of new (and course corrections of ongoing) core work of the WBG.

IEG is directly responsible for:

IEG's organizational structure comprises: The Office of the Director General, Evaluation (IEGDG) which includes the Methods Advisory Function (IEGMA); the Human Development and Economic Management Department (IEGHE); the Finance, Private Sector and Sustainable Development Department (IEGSP); and the Knowledge and Communications Department (IEGKC). Through the VP and Director General of Evaluation (DGE), IEG reports directly to the Board of Executive Directors.

Methods Advisory Function

IEG’s objective is to help the WBG meet its goals and enhance its development effectiveness through timely, robust evaluation. In 2016, as part of its organizational renewal, IEG’s Methods Advisory Function (IEGMA) was established to help deepen the quality and credibility of IEG evaluation work. The Methods Advisory Function consists of a small centrally located team of data scientists and methodologists managed by the Head of methods.

The team currently has the following roles:
• Advising IEG staff on the best available evaluation methods to address specific evaluation questions and supporting teams in the implementation of those methods.
• Quality assuring IEG’s evaluation products and advising the IEG’s leadership on the credibility and rigor of evaluation plans and reports.
• Ensuring consistent and efficient use of data in evaluations through support to IEG’s data arrangements, systems, and staffing of analysts.
• Researching, generating, piloting and promoting innovative evaluation methodologies including the application of data science and artificial intelligence in the practice of evaluation.
• Through a learning program, supporting the development of evaluation skills among IEG staff and ensuring that internal and external audiences understand and appreciate the rationale for IEG’s evaluation methodologies and approaches.
• Sharing IEG’s methodological knowledge and know-how with the broader international evaluation community, including but not limited to other members of the Evaluation Cooperation Group

Duties and responsibilities:

Embedded in the IEGMA, the successful candidate will:

a) Provide advisory support to evaluation teams. Under the guidance of the Head of Methods, the Senior Evaluation Officer will provide methodological support and coordinate the methodological support of other Methods Team members to evaluation teams. This includes:
a. Conducting Methods and Evaluation Design workshops with evaluation teams to help them build and articulate a rigorous mixed-methods evaluation design.
b. Providing expert advice and feedback to the preparation of Evaluation Approach Paper and Methods Appendix.
c. Providing just-in-time advice on the use of data, sampling and selection strategy, various quantitative and qualitative data collection and analysis
d. Coaching IEG colleagues on the use of specific methods (e.g., econometric analysis, case-based design, interview design, and focus group discussions, etc.)
e. Coordinating with other members of the methods team, and tracking delivery to ensure adequate coverage of evaluations and a good match between evaluation teams’ needs and expertise provided.

b) Quality assurance of evaluation approach papers and reports. Working closely with the Head of methods, the Senior Evaluation Officer will contribute to the quality assurance process of IEG’s approach papers and reports, including by:
a. Reviewing and providing comments on draft papers
b. Participating in key meetings during the evaluations journey (e.g., Concept Note Review, Methods Review, Emerging Findings Review, etc.).
c. Drafting guidance, templates, job aids and good practice notes for each step of the Quality Assurance Process

c) Broadening the range of methods used and fostering innovative evaluation methods. Working closely with the data scientists in the Methods team, the Senior Evaluation Officer will help test, validate and scale the use of innovative methods in the context of IEG evaluations (e.g., application of data science, use of impact evaluation techniques that are amenable to ex-post evaluations, use of geospatial analysis). Including by:
a. Acting as knowledge broker between evaluation teams and data scientists to identify opportunities for applying data science to evaluation work,
b. Guiding teams in developing and disseminating pilots of innovative methodological applications in evaluations
c. Assisting the head of methods in implementing an action plan for scaling-up the use of data science in the practice of evaluation
d. Partnering with other teams across the World Bank Group (e.g., Research Group, DIME, Chief Economists teams, etc.) to share-knowledge and coordinate efforts in scaling up the use of AI

d) Contribute to evaluation staff capacity development and knowledge sharing. The Senior Evaluation Officer will assist the Head of Methods with:
a. Designing and delivering trainings, clinics, and other learning events targeting IEG staffs and consultants, in particular the roll out of the Foundations of Evaluation Design curriculum and its adaptation to an e-learning format.
b. Coordinating the engagement with partners regarding the delivery of training activities to external peers in the framework of the Evaluation Cooperation Group or beyond.
c. Coordinating visiting fellows and special programs related to evaluation methods and data, to help broaden IEG’s exposure to external developments in these spheres and to enhance IEG’s reputation as a leading independent evaluation function in the field of international development.
d. Organizing conferences, BBLs, symposiums and other events – both within the WBG and externally – to spread knowledge about IEG’s evaluation methodologies and approaches and ensure an understanding and appreciation of their rationale and use.
e. (Co)-authoring IEG Methods Papers or evaluation journal articles.

Selection Criteria

The successful candidate is required to have the following qualifications, skills and personal attributes:

• Master’s degree in a relevant field/discipline (evaluation, public policy, political science, economics, international relations or other discipline relevant to the WBG’s mission) plus at least 8years of relevant work experience in evaluation or applied policy-oriented research. Given the fact that the function involves the provision of specialized methodological and data science support to evaluation teams, a PhD would be preferred for this position with equivalent combination of education and experience.
• Experience in designing, conducting, and leading policy-oriented research initiatives. Experience in managing and conducting evaluations highly preferred.
• Advanced knowledge of quantitative and qualitative (evaluation) research methods, including familiarity with data science applications.
• Demonstrated aptitude to provide advice, coaching and support to evaluation or policy-oriented research operating under real-world constraints.
• Strong track record in training professionals in the field of policy-oriented research. Experience in training evaluation stakeholders on evaluation practices and/or methods highly preferred.
• Outstanding analytical aptitude, as evidenced by a strong track record of solid contributions to development evaluations, preferably with a solid track record of publications and presentations at evaluation conferences.
• Knowledge of evaluation processes and products in the context of Multilateral Development Banks (desired).
• Knowledge and understanding of Multilateral Development Banks’ operational strategies, processes, and instruments (desired).
• Excellent teamwork and interpersonal skills, capacity to motivate, develop and supervise teams, and ability to operate collaboratively across organizational boundaries.
• Proactive, inclusive and innovative, with an open and collegial work style and ability to listen and integrate ideas from diverse points of view.
• Proven ability to handle multiple tasks independently, work under pressure with short deadlines, and be a problem solver.
• Strong spoken and written communications skills, including the ability to speak and write persuasively and present ideas clearly and concisely.
• Excellent writing skills in English.

WBG Core Competencies:

Deliver Results for Clients: Achieves results and identifies mission-driven solutions for the client.

• Develops and implements solutions that show understanding of how clients and/or own work achieves results that are financially, environmentally, and socially sustainable.

• Shares new insights based on in-depth understanding of the client and recommends solutions for current and future needs of clients.

• Holds self and team accountable for risk management and outcomes.

Collaborate Within Teams and Across Boundaries: Initiates collaboration across boundaries and broadly across WBG, and brings differing ideas into the forefront.

• Collaborates across organizational boundaries, internally and externally with a sense of mutuality and respect.

• Consistently engages others in open dialogue, brings out any conflicting viewpoints and incorporates viewpoints into solutions, giving credit where credit is due. Leverages expertise of all team members to ensure successful outcomes.

• Makes choices and sets priorities with a WBG corporate perspective in mind.

Create, Apply and Share Knowledge: Creates, applies and shares knowledge from across and outside WBG to strengthen internal and/or external client solutions.

• Ensures systematic sharing of good practice and learning from lessons from across WBG, clients, and partners.

• Is known across WBG in their subject area and is sought out by WBG colleagues to advise, peer review, or contribute to knowledge products of others.

• Seeks mentoring opportunities with more experienced staff to deepen or strengthen their professional knowledge and mentors junior staff.

• Builds networks across the WBG and as part of external professional groups/networks.

Make Smart Decisions: Recommends and takes decisive action.

• Applies critical thinking and seeks inputs and experience from others to recommend a course of action consistent with the WBG’s strategy.

• Evaluates risk and anticipates the short- and long-term implications of decisions.

• Commits to a decision and takes action once a decision has been reached.

World Bank Group Core Competencies

The World Bank Group offers comprehensive benefits, including a retirement plan; medical, life and disability insurance; and paid leave, including parental leave, as well as reasonable accommodations for individuals with disabilities.

We are proud to be an equal opportunity and inclusive employer with a dedicated and committed workforce, and do not discriminate based on gender, gender identity, religion, race, ethnicity, sexual orientation, or disability.

Learn more about working at the World Bank and IFC, including our values and inspiring stories.