Usluga
EXTERNAL EVALUATIONS AND MONITORING FRAMEWORKS


EXTERNAL EVALUATIONS AND MONITORING FRAMEWORKS

1. PROJECTS, PROGRAMS AND PUBLIC POLICIES

MAP is especially recognized for its ample experience in independent evaluations of projects, programs and public policies. We have conducted numerous ex-ante, mid-term, periodic and ex-post evaluations. Thanks to our network of associates, we are able to gather highly competent evaluation teams with specialized knowledge and skills in an array of sectoral fields, using both qualitative and quantitative methods of data gathering, processing, analysis and interpretation.

Context

Over the past decade we have observed an increase in the demand for independent evaluations, both in Croatia and the region, which are slowly becoming part of programming public policies. In the past, evaluations were almost exclusive to interventions funded by international donors, while recently, public bodies are also starting to recognize the value of evaluations for national policies, regardless of the funding source.

Purpose

We approach evaluations as opportunities for organizational/institutional learning, which enable the formulation of evidence-based conclusions and recommendations addressing the implementers, target groups, the wider community and (if applicable) the donor. Our evaluations will provide an independent assessment of the logic of the intervention, as well as an assessment of the extent to which the intervention was successful in reaching its goals, identifying factors contributing to or impeding their realization.

In our evaluations we use the OECD DAC criteria:

  • Relevance with regards to the problem, its definition in the wider social and political context, strategic documents at all levels, as well as with regards to the needs of the target groups of the intervention. We also examine the relationship between the problem definition and the intervention’s specific goals.
  • Effectiveness in relation to reaching goals of the intervention, with special focus on satisfying the needs of the target groups and (if applicable) an assessment of the effectiveness of dealing with the cause rather than the consequence of the problem.
  • Efficiency in reaching the goals in relation to the used resources – time, finances, technical and human capacities of implementers.
  • Impact on the quality of life of target groups, increase in target groups’ capacities and further development of (segments of) society more generally.
  • Sustainability of results in the future.

DATA GATHERING METHODS

We formulate conclusions and recommendations by triangulating various quantitative and qualitative data gathering methods and sources of information, most often including:

  • Document analysis
  • Surveys
  • Semi-structured interviews
  • Focus group discussions
  • Participant observation

The choice of methods is defined specifically for each new assignment and is also determined by the availability of contact information for target groups and/or implementing bodies, financial resources and time constraints.

    • Ministry of Labour and Pension System, Family and Social Policy

      Evaluation of effectiveness, efficiency and impact of the Operational Programme Efficient Human Resources 2014-2020 – Group 3: Evaluation of the Priority axis 3 “Education and lifelong learning”

    • Ministry of Labour and Pension System, Family and Social Policy

      Evaluation of effectiveness, efficiency and impact of the Operational Programme Efficient Human Resources 2014-2020 – Group 6: Evaluating the efficiency, effectiveness, and impact of the OPEHR and European Social Fund (ESF) interventions implementation according to the criteria of regional and local representation with the evaluation of horizontal principles 

    • Croatian Agency for SMEs, Innovations and Investments (HAMAG BICRO)

      Evaluation of project proposals within the ERDF’s Call for proposal “Increasing the development of new products and services arising from research and development activities - phase II“ (subcontract through WYG Consulting).

    • Novi sindikat trade union, Zagreb, Croatia

      External evaluation of the ESF project “Social Dialogue and Contemporary Industrial Relations–yesterday, today, tomorrow-potentials and perspectives - 2030”, in cooperation with association Sirius

    • GONG

      Evaluation of service-learning programmes within the ESF project Active students – useful citizens – just society: partnership in developing service-learning programmes for improving students’ competences and student contribution to local community 

    • Our Hajduk (Naš Hajduk), Split, Croatia

      Evaluation of service-learning programmes within the ESF project With (Hajduk) cooperation and volunteering to social development

    • RIJEKA 2020 LLC

      ‘Monitoring and Evaluation of Rijeka 2020 – European Capital of Culture’ - a longitudinal research to be conducted in 2019/2020/2021 (in consortium with WYG Consulting, Institute for Development and International Relations, University of Zagreb – Faculty of Humanities and Social Sciences and Ipsos)

    • Ministry of Labour and Pension System, Croatia

      Mid-term evaluation of the Youth Employment Initiative (YEI) in Croatia (subcontract through Ipsos) in cooperation with Ipsos

    • GONG

      Final evaluation of project 'GEAR– Global Education and Active Response’

    • Centre for Peace Studies, Zagreb

      Assessment of implementation of the anti-discrimination policy in the Republic of Croatia for the period 2011-2016

    • Association Sunce, Split

      Final external evaluation of the IPA project ‘Responsible for Nature'

    • UNICEF CO Serbia

      External summative evaluation of the project ‘Strengthening Implementation of Justice for Children in the Republic of Serbia (2010-2017)’

    • GONG

      Supporting the project team in the implementation of the EU IN Forum project – expert support in preparing the report on the implementation of the referendum on the EU and in preparing the final project report

    • SIPU International AB TACSO Office in Croatia

      Development of plans for monitoring and evaluation for the needs of state administration bodies in charge of financial supports to civil society organizations

    • Evaluation Department (EVD) of the Council of Europe Development Bank (CEB)

      Evaluation of the CEB-financed projects ‘Housing for Returning Refugees and Displaced Persons in Croatia’

    • Synergies Coopération

      Formative evaluation of the UNICEF CO Croatia program component ‘Strengthening justice system in matters involving child victims and witnesses in criminal proceedings’

    • Zagreb Muscular Dystrophy Association

      Final external evaluation of the ESF project ‘Better Life with a Personal Assistant’

    • Croatian Muscular Dystrophy Association

      Final external evaluation of the ESF project ‘People with Dystrophy Visible in the Community’

    • Knez Branimir High School, Benkovac

      Final external evaluation of the ESF project ‘Let's Manage the Future’

    • DOMINO

      External final evaluation of the PROGRESS project ‘United against Discrimination of the LGBTIQ People’

    • UNDP Croatia

      External final evaluation of the project ‘Strengthening Capacities of the Local government in Western Balkans Countries towards the EU Integration’

    • Center for Training and Education ‘Slava Raškaj’

      Final external evaluation of the IPA project ‘Ears Wide Open - Enhancing competencies of students with hearing and other disabilities in catering sector’

    • GONG

      Developing monitoring plan for the IPA project ‘Enforcement of the Aarhus Convention in the Adriatic Region Countries’

    • Croatian Employment Service (CES)

      Final external evaluation of the PROGRESS project ‘Supporting Diversity in the Croatian Labour Market’

    • High Judicial and Prosecutorial Council of Bosnia and Herzegovina

      Final external evaluation of the project ‘Establishment of better mechanisms for cooperation between police and prosecutors in Bosnia and Herzegovina’

    • Office for Human Rights and Rights of National Minorities of the Government of Croatia

      Technical assistance in drafting of the mid-term report on the implementation of the National Programme for the Promotion and Protection of Human Rights

    • Diakonie Auslands-und Katastrophenhilfe, Austria

      Final external evaluation of project ‘Integration through computer-aided communication’ in integrative kindergarten ‘Sunčani most’ in Mostar 

    • GONG

      Final external evaluation of the IPA-funded project ‘European Class’

    • Green Istria - Istria Verde

      Developing monitoring plan for the PHARE project ‘Democracy in Practice’ 

    • UNDP Hrvatska

      Support to national monitoring mechanisms and alignment with indicators of the UN Convention on the Rights of Persons with Disabilities and UN Treaty Bodies requirements

    • UNIFEM

      External final evaluation of the UNIFEM’s programme ‘Promoting Gender Equality in National Development Policies and Programmes in Moldova’

    • CARITAS Serbia and Montenegro

      External final evaluation of the projects ‘National program for home care and day care assistance for vulnerable elderly and disabled persons in Serbia and Montenegro 2008 – 2010’ and ‘Strengthening Civil Society Through a Model Project of Home Care for Elderly in Serbia and Montenegro’

    • Association SMART

      External final evaluation of the project ‘Framework for volunteering in institutions’

    • Care International NW Balkans

      External final evaluation of the project ‘Strengthening Women’s CSOs in Northern, Western and Eastern B&H’

    • Association ‘Children First’

      External final evaluation of the project ‘Protection of children's rights in treatment of high-risk families’

    • Care International NW Balkans

      External final evaluation of the project ‘Sustainable Economic Development’

    • UNIFEM CEE Office

      External final evaluation of the project ‘Accountability for Protection of Women's Human Rights’

    • UNDP Croatia

      External final evaluation of the project ‘Strengthening Local Development and Inclusion of Marginalized Groups’

    • Green Istria - Istria Verde

      Monitoring and evaluation service for the CARDS 2004 project 'Mobilization of the public to participate in the procedures of environmental impact assessment'

    • Government Office for Cooperation with NGOs, Croatia

      Technical assistance in developing and implementing the system for evaluating CSOs projects financed through the state budget

    • CARITAS Bishops' Conference Bosnia-Herzegovina

      External final evaluation of the project ‘Development of home care structures in Bosnia and Herzegovina, Serbia and Montenegro 2008 – 2010’

    • Care International NW Balkans

      External final evaluation of the projects (1) ‘Strengthening anti-trafficking Networks in Western Balkans’; (2) ‘Combating Human Trafficking Initiative in Bosnia and Herzegovina, Serbia, Croatia and Montenegro’ and (3) ‘Montenegro Anti-Trafficking and Human Rights Initiative’

    • CESI - Center for Education, Counselling and Research

      External final evaluation of the CARDS project ‘Improvement of legal and institutional framework for achieving gender equality’

    • Care International NW Balkans

      Mid-term and final evaluation of the project ‘Combating Gender Based Violence in the Western Balkans’

    • Public Open University (POU) Zagreb

      External final evaluation of the CARDS 2003 project ‘WAIST-line - national cuisine in a modern educational environment’

    • GONG

      Monitoring and evaluation service for CARDS 2004 project ‘Promotion of good governance principles and citizen participation in decision-making in Croatia’

    • King Zvonimira Vocational School, Knin

      External final evaluation of the CARDS 2003 project ‘Classroom of New Technology’

    • City of Knin Tourist Board

      External final evaluation of the project ‘Development of tourism in the wider Knin area’

    • Association SMART

      External final evaluation of the CARDS 2002 project ‘Project Proficient - strengthening the local capacities and the City of Rijeka and Primorje-Gorski Kotar County’

    • Nature park Vransko jezero, Croatia

      Monitoring and evaluation service for the project ‘Sustainable Tourism Development in the Nature Park Vransko Lake’

    • The association of the blind of the Koprivnica-Križevci County

      Midterm and final external evaluation of the CARDS 2002 project ‘The library services for the blind and visually impaired’

    • World Learning Inc.

      Impact assessment of the STAR Network of World Learning

    • CARE International Bosnia&Herzegovina and Croatia

      Monitoring and evaluation service for the project ‘Sustainable Development in Return Areas - Civil Society Project’

2. ORGANISATIONS / INSTITUTIONS

MAP also provides services related to assessments of organisations/institutions, as a specific type of evaluation using insights from human resource development and management. These are done for the purpose of an in-depth analysis of the organisational climate and factors contributing to employee (dis)satisfaction and working environment. 

The service can be useful to organisations/institutions entering a new phase of development, changing leadership or facing difficulties, including financial issues, high levels of employee fluctuation, etc. 

This service complements Strategic Planning service.

These types of services are always tailored to the specific needs of clients and the emphasis that the clients place on certain aspects of research and evaluation in their organisations/institutions.

    • European Parliament Office in Croatia

      Drafting the registry of potential partners and associates of the European Office in Croatia

    • Faculty of Political Science, University of Zagreb

      Expert support in moderating the process of participative analysis of the Faculty’s quality management system 

    • Association Terra, Rijeka

      External organizational evaluation

    • Croatian Association of Treated and Ill with Hepatitis 'Hepatos', Split

      External assessment of organizational effectiveness and impact 

    • Association for the Homeless and Socially Vulnerable 'Oaza', Rijeka, Croatia

      Analysis of the organizational structure and HR management practices

    • SOS Kinderdorf Croatia

      Analysis of the organizational climate and factors that influence staff satisfaction

    • Association SRMA, Sinj, Croatia

      Analysis of service development and social entrepreneurship activities

    • Care International NW Balkans

      Capacity assessment of partner organizations in the Regional Roma Women’s Empowerment Project

    • HR assessment, development of organizational communication system and coaching HR manager in staff performance evaluation for beneficiary organization Serbian Democratic Forum 

    • Association for Therapeutic Riding Krila, Zagreb, Croatia

      Organisational analysis and preparation of organisational development plan 

    • Organisation for Citizens’ Initiatives (OGI), Osijek, Croatia

      Staff performance evaluation

    • Croatian Association for Guide Dogs and Mobility, Zagreb

      Social impact assessment of the organization, needs analysis and organizational development recommendations