Browsing by Subject "Evaluation capacity building"

Now showing 1 - 3 of 3
  • Thumbnail Image
    Item
    Promoting Evaluation Capacity Building in Tanzanian Public Health Organizations
    (2022-08) Mkonyi, Ever
    The need for evaluation capacity building (ECB) by the Ministry of Health, Community Development, Gender and Children (MOHCDGEC) in public health organizations in Tanzania has rapidly increased due to an increased need to engage Tanzanian health professionals at all levels in planning, designing, and implementing a comprehensive evaluation of public health policies and programs. Despite a growing interest by the Ministry of Health, there has been a challenge in how to strengthen evaluation capacity in these organizations. A fundamental question is: how can ECB be promoted in public health organizations (PHOs) in Tanzania to promote an evaluative culture? The purpose of this exploratory study is threefold. First, it intends to explore the current practice of evaluation in PHOs in Tanzania. Second, it explores the challenges and barriers that hinder evaluation capacity development in these organizations. Third, it seeks to determine the most useful and culturally relevant strategies that professionals can adopt to develop evaluation capacity and an evaluative culture specific to PHOs in Tanzania. This study attempts to answer the following research questions: (1) What are the current evaluation practices and efforts to engage in ECB in PHOs in Tanzania? (2) What are the current challenges and barriers that impede evaluation capacity development and strategies to overcome these challenges in PHOs in Tanzania? (3) What are the strategies and approaches to building evaluation capacity and promoting PHOs’ evaluative culture in Tanzania? This study adopted a social constructivism qualitative research method to understand the problem. Thirteen interviews were conducted among managers at both the regional and district municipal councils, representatives from MOHCDGEC, and officials at the President’s Office, Regional Administration, and Local Government (PO-RALG). The interviews were conducted in the Kiswahili language and later translated into English. The study employed thematic analysis to analyze data and generate themes and subthemes. The results of this study show that local staff (at the managerial and non-managerial levels) do most of the evaluation in these PHOs internally. Managers perform a lot of supervision, capacity building, and data quality assessment for staff at the non-managerial level. The findings show a more reasonable evaluation culture at the managerial level than at the non-managerial level. The Ministry of Health managers uses data for planning and decision-making more than non-managerial staff. Findings show a more positive evaluative culture among managers than at the non-managerial level. Despite the presence of an evaluative culture within PHOs, knowledge and skills to perform an evaluation to the fullest are lacking. Participants demonstrated the use of various ECB strategies; however, the most practical, efficient, and effective ones were on-the-job training (i.e., supportive supervision), and hands-on training. Furthermore, the results highlighted several barriers and challenges to the development of ECB, such as a lack of evaluation expertise to provide technical support, a shortage of staff, staff turnover, limited funding, and a lack of clear roles and responsibilities. Generally, this study reveals a high demand for ECB among PHO staff at all levels (managerial, non-managerial, and at the ministry level). The presence of barriers and challenges undermines efforts to develop and sustain ECB in these PHOs. This study supports the findings of other scholars who argue that to build and promote sustainable ECB in an organization, there must be visionary leaders, good communication, and incentives and motivations from the highest policy and management levels. Senior leaders should demonstrate the demand for, and the need for investment in ECB processes to improve the PHOs at all levels. It is important for leaders to be part of the process because they are the key stakeholders in decision-making, and they are the ones who allocate resources. Through the MOHCDGEC and other organizations, the government should consider legal and statutory policies and regulations when designing an evaluation system. This study recommends that managers should design comprehensive ECB activities that are rooted in evaluation approaches, theories, and frameworks to address the needs of the Ministry of Health, the public health system, and the people of Tanzania.
  • Thumbnail Image
    Item
    A retrospective case study of long-term evaluation capacity building at neighborhood house
    (2013-09) Anderson, Kirsten Lynn
    This thesis provides a case study of how evaluation capacity has been built at one mid-size social service non-profit organization over the last eleven years. Through reviewing documents and conducting interviews with current and past staff of Neighborhood House in St. Paul, Minnesota, the author determined the facilitators and barriers to successful evaluation capacity building as well as the indicators and outcomes of successful ECB work in this context. The thesis presents a model, in logic model format, for how ECB has worked at Neighborhood House. The lessons learned over eleven years of sustained ECB work should prove useful to evaluators and ECB practitioners doing similar work.
  • Thumbnail Image
    Item
    Understanding Evaluation's Influence on Stakeholders' Attitudes and Actions at a Social Services Organization
    (2021-06) Anderson, Lindsay
    Research and discussions of evaluation use have a long history in the field of evaluation. Recently, discussions of evaluation use have expanded to include the concept of evaluation influence in an attempt to better understand the impact of evaluation through a variety of approaches. Much of the existing research on evaluation use focuses on how and under what conditions evaluations are used by stakeholders. However, to date, limited research on evaluation influence exists and less is known about the specific ways in which evaluation may influence stakeholders’ attitudes and actions. This study focused on building an understanding of how stakeholder attitudes and actions towards evaluation change as a result of being involved in an evaluation process. An exploratory qualitative approach and case study design was used. The case was a single social services agency. An evaluation of the social service agency’s employment program took place. Participants involved in the study were interviewed before and after the evaluation took place to better understand how they were using evaluation and their attitudes towards evaluation. This study found evaluation influenced stakeholders in multiple ways at the individual, interpersonal, and collective levels. The research demonstrated 1) people recognize the value of evaluation, but in different ways; 2) evaluation is more than just about the results, the process matters; 3) evaluation influences participants at multiple levels of an organization; 4) participating in an evaluation does influence stakeholders’ attitudes towards evaluation in positive ways; 5) evaluation is important in facilitating communication among key stakeholders; and 6) evaluation has the potential to influence future evaluation activities.