Experience

• 

  Sogang language program institute

  Jan 2007 - Aug 2008

  Teacher

  • Taught children aged 4 - 15 a variety of subject matters, assessed student learning, trained new staff, developed materials, and co-wrote a text book.

• 

  Cedpa

  May 2009 - Jan 2010

  Monitoring and evaluation intern

  • Collected, warehoused, cleaned and analyzed performance data from multiple M&E field offices. Continually updated and ensured the validity of the organization’s central international service statistic database. • Wrote evaluation reports, including CEDPA’s annual global performance review; wrote an extensive SPSS and statistics manual to improve performance management and institutional learning capacity; and conducted statistical data analysis using SPSS.• Drafted PMPs, selected performance indicators and wrote content for proposals. • Conducted research in support of project design and performance management. Show less

• 

  The kaizen company

  Mar 2010 - Jun 2010

  Associate

  • Created a PMP for the USAID-funded international portal KaizenConnect, including selecting real-world and online performance indicators, and methods for their measurement.• Wrote three management best-practices guides, captured high-quality management content for the KaizenConnect online portal and wrote an e-marketing plan for the company. • Identified, tracked and analyzed RFPs, wrote various sections of USAID proposals, drafted project budgets and recruited contract personnel. Show less

• 

  Social impact

  Jan 2011 - Aug 2015

  • Departmental Management - Strategic planning and budgeting - Outreach and client relationship management - Organizational initiatives• Personnel Management - Staff supervision, resource leveling, mentoring - Resource management and forecasting, recruiting, hiring• Business Development - Strategy development - Proposal writing - Budgeting, recruiting, teaming• Service Delivery - Manages and provides technical support to an international portfolio of evaluations. Responsibilities include: evaluation design (sampling, instrumentation, etc.); data collection oversight; cleaning, managing and performing statistical analyses on large datasets; synthesizing findings into evaluation reports; and disseminating findings to evaluation stakeholders. Select project experience: • For the past three years, Mateusz has been managing a randomized control trial (RCT) impact evaluation of a sport-for-development program. A Ganar is vocational training program designed to help at-risk youth in Honduras and Guatemala find work and re-enter the formal education system. The study utilizes 27 discrete data collection events to survey thousands of youth at three points in time (baseline, post-program, long-term follow-up). In addition to final outcomes, the study measures participation in risk behaviors, gender norms, professional competencies, self-esteem, and developmental assets. A robust qualitative component, comprised of exit interviews and multi-perspective case studies triangulates and augments quantitative findings. The study has required unconventional solutions to ensuring the safety of evaluators and respondents, quantifying difficult-to-measure constructs, and coordinating with an international team of experts and local implementers in high-threat areas. Show less Managed and provided technical backstopping to a portfolio of multi-year impact evaluation contracts in Indonesia, Honduras and El Salvador, encompassing education, democracy and governance, and economic growth sectors. These evaluations utilized randomization, regression discontinuity, instrumental variable, propensity score matching, and difference-in-differences methodologies.Select project experience: • Served as an Education Evaluation Specialist on a four-person team that conducted a hybrid performance and impact evaluation of a USAID-funded teacher-training program in Malawi. The team was mandated with assessing program impact, conducting cost-effectiveness analysis of various training modalities, and gaging the extent to which the program facilitated stakeholder buy-in, lessons-learned, and prospects for sustainability. Mateusz acted as the team evaluation methodologist, taking the leadership in evaluation design, sampling, and data analysis. He has solely responsible for the IE and cost-effectiveness components of the evaluation, and supported the qualitative components through two weeks of fieldwork. • Acted as an evaluation specialist on an eight-person team tasked with assessing the state of youth development across ten countries in the East and Southern Caribbean. This assignment included the design of five inter-related data collection tools (youth surveys, problem perception measures, organizational capacity assessments, focus group protocols and key informant scripts) as well as the creation of data validation intake forms. Field work included mixed-methods data collection from a range of youth and adult stakeholders across four countries. Upon return, Mateusz led the analysis of quantitative data. • Designed and delivered evaluation trainings in Thailand, Moldova, Zambia, Jordan and the United States. Show less Managed and provided technical backstopping to a portfolio of impact evaluation, performance evaluation and performance monitoring contracts. Select project experience: • Served as a Technical Evaluation Expert on a four-person team tasked with assessing the quality, impact, sustainability, and cost-effectiveness of USAID’s Democratic Indicators Monitoring Survey (DIMS) cooperative agreement (better known as the AmericasBarometer). In this engagement, he was responsible for designing sampling and data collection approaches and conducted fieldwork in Honduras and Washington. Mateusz was solely responsible for conducting the Cost-Effectiveness Analysis. • Led a team of four M&E specialists in designing an integrated M&E system for a Local Governance and Health project in Indonesia. The process involved meetings with a variety of stakeholders in Indonesia and incorporating an Organizational Capacity Assessment (OCA) tool and well as a client survey. The resulting Performance Monitoring Plan included common (Standard Foreign Assistance) and custom indicators, with detailed reference sheets. • Delivered evaluation trainings in Moldova and the United States. Show less

  • Deputy Director, Impact Evaluation

    Nov 2013 - Aug 2015

  • Program Manager

    Mar 2012 - Oct 2013

  • Program Associate

    Jan 2011 - Mar 2012
• 

  Usaid

  Aug 2015 - Aug 2016

  Monitoring and evaluation fellow

  Provides technical and capacity building M&E support to two USAID operating units: PPL/LER and AFR/SD/ED. Assistance is designed to bolster USAID’s capacity to design, procure, manage and utilize high quality M&E services. TECHNICAL ASSISTANCE– Provided technical support in the design and management of impact evaluations, performance evaluations, population-based surveys and performance monitoring systems. Countries supported: Afghanistan, Democratic Republic of Congo, El Salvador, Honduras, Liberia, Rwanda, Senegal, South Sudan, and Uganda.– Facilitated an impact evaluation design workshop for a Youth Secondary Violence Prevention program in Honduras. The five-day workshop occurred during the Democracy, Human Rights and Governance (DRG) Impact Evaluation Clinic in Washington DC. Support included document review, evaluability assessment, and design facilitation with stakeholders from USAID, the implementing partner, and the evaluation partner. – Supported the development and field-testing of the School Related Gender Based Violence (SRGBV) Measurement Framework.– Supported the integration of evidence into activity design through literature reviews, drafting policy briefs, and dissemination of existing research. CAPACITY BUILDING – Developing a two-day training on evaluation challenges at USAID, titled – “Lessons Learned? Common Evaluation Pitfalls and How You Can Avoid Getting Burned” (Addis Ababa, Ethiopia) – Developed and delivered a session about the challenges to implementing rigorous evaluation in the USAID context, titled – “Threats to Impact Evaluation: Theory Meets Reality” (DRG Impact Evaluation Clinic, Washington, DC)– Delivering a session focusing on evaluation challenges, resources and trends at the Africa Regional Education Workshop (Addis Ababa, Ethiopia)– Developing an impact evaluation management guidance document for inclusion in the USAID Evaluation Toolkit. Show less

• 

  Social impact

  Sept 2016 - now

  Mateusz oversees a portfolio of evaluation/research contracts by ensuring technical quality, financial performance, contractual compliance, and client satisfaction. Divisional management responsibilities include strategic planning, resource management, personnel management, business development, and systems development.

  • Vice President, Evaluation, Research, and Analytics

    Jun 2022 - now

  • Vice President, Impact Evaluation

    Jan 2021 - now

  • Senior Director, Impact Evaluation

    Jan 2019 - Dec 2020

  • Director, Impact Evaluation

    Sept 2016 - Dec 2018