JOURNAL METRICS

CiteScore 2023: 2.2 ℹCiteScore:

CiteScore is the number of citations received by a journal in one year to documents published in the three previous years, divided by the number of documents indexed in Scopus published in those same three years.

SCImago Journal Rank (SJR) 2023: 0.27 ℹSCImago Journal Rank (SJR):

The SJR is a size-independent prestige indicator that ranks journals by their 'average prestige per article'. It is based on the idea that 'all citations are not created equal'. SJR is a measure of scientific influence of journals that accounts for both the number of citations received by a journal and the importance or prestige of the journals where such citations come from It measures the scientific influence of the average article in a journal, it expresses how central to the global scientific discussion an average article of the journal is.

Source Normalized Impact per Paper (SNIP) 2023: 0.637 ℹSource Normalized Impact per Paper(SNIP):

SNIP measures a source’s contextual citation impact by weighting citations based on the total number of citations in a subject field. It helps you make a direct comparison of sources in different subject fields. SNIP takes into account characteristics of the source's subject field, which is the set of documents citing that source.

qqtu_pian_20240428144739.png

Evaluating Conservation Assistance Programs in the Anambas Islands Marine Protected Area Using the CIPP Model

Muhammad Lukman Faishol^* | Moris Adidi Yogia | Rendi Prayuda | Khotami | Septian Wahyudi

Department of Administrative Sciences, Riau Islamic University, Pekanbaru Riau 113, Indonesia

Corresponding Author Email:

muhammad_lukman@student.uir.ac.id

Received:

10 August 2023

Revised:

14 November 2023

Accepted:

23 November 2023

Available online:

28 April 2024

| Citation

ijsdp_19.04_29.pdf

OPEN ACCESS

Abstract:

The purpose of establishing a conservation area is to protect and preserve biodiversity and its ecosystem so that people can continue to use it sustainably. Effective management of conservation areas requires the role and participation of the community. Community empowerment efforts must be carried out by conservation area managers, one of which is by distributing aid to the community. This study aims to evaluate and examine the effectiveness of the Program by using the CIPP evaluation model and to identify the constraints and obstacles to its implementation. The CIPP evaluation model is a program evaluation model which was developed by Daniel Stufflebeam and colleagues in the 1960s. CIPP is an acronym for context, input, process and product. CIPP is a decision-focused approach to evaluation and emphasizes the systematic provision of information for program management and operation. The sampling method in this study used a purposive sampling technique with typical case sampling. The author interviewed twelve informants who were competent in providing various information and data required. The research results show that this program has run well and effectively. This is proven by (1) the increase in income of community groups after receiving the assistance program and (2) they are actively involved in supporting marine protected area manager in increasing the effectiveness of their management. The hope is that this program should continue and be further improved as much as possible with a larger and broader scope. Thus, more and more community groups will also feel the positive impact of this program.

Keywords:

CIPP evaluation model, community empowerment, marine conservation, Anambas Islands Marine Protected Area, Indonesia

1. Introduction

Marine protected areas (MPA) are protected water areas, managed by a zoning system to realize sustainable management of fish resources and their environment (Law Number 45 of 2009 on Fisheries). Talking about conservation areas is not only about protection and preservation but also emphasizes the importance of sustainable use of conservation areas for people's welfare.

In the management of conservation areas, community empowerment is very important because the characteristics of conservation areas in Indonesia cannot be separated from the interactions and interests of the local community. This is in line with the new paradigm of conservation area management which views local communities as partners in management, no longer as enemies and threats [1]. Community empowerment in conservation areas is a process of strengthening communities so that they are empowered and participate in area conservation. This requires an empowerment strategy that will be carried out by the management unit to achieve the goals of effective and sustainable conservation area management. Community empowerment around conservation areas can be pursued in various ways such as outreach, coaching and empowering [2].

One of the community empowerment efforts in marine protected areas that has been carried out by the Government is by assisting community groups in the vicinity. This community empowerment program which is packaged in the form of conservation assistance is one of the national priority programs at the Ministry of Marine Affairs and Fisheries (MMAF). This conservation assistance is part of an effort to accelerate the effectiveness of the management of conservation areas and the management of endangered and/or protected fish species both inside and outside conservation areas.

Based on Figure 1, since this program was launched in 2016 to 2022, 223 (two hundred and twenty-three) packages of conservation assistance have been distributed by the MMAF to Conservationist Community Groups (KOMPAK) spread from Sabang to Merauke.

Referring to Table 1, it is known that the distribution of conservation assistance in Riau Islands Province has been ongoing since 2017. There are 18 (eighteen) KOMPAK receiving conservation assistance until 2022 with details of 2 (two) KOMPAKs in Bintan Regency and 16 (sixteen) KOMPAKs in Anambas Islands Regency. This indicates that Anambas Islands Regency is one of the locations that the Central Government pays more attention to in implementing conservation assistance programs because the Anambas Islands Regency has a very large conservation area and its people are active in conservation activities.

The Agency of National Marine Protected Area of Pekanbaru (LKKPN Pekanbaru) is one of the Technical Implementation Units under the Directorate General of Marine Spatial Management which was given a mandate by the MMAF to manage a national MPA located in western Indonesia, namely the Pieh Island MPA. in West Sumatra Province and the Anambas Islands MPA in the Riau Islands Province. Administratively, the Anambas Islands MPA is located in the Anambas Islands Regency with a conservation area of around 1,265,401.51 hectares [3].

LKKPN Pekanbaru duties as stipulated in MMAF Regulation Number 37 of 2021 juncto MMAF Regulation Number 65 of 2020 is to carry out the protection, preservation, and utilization of marine conservation areas following statutory provisions. These tasks are then deciphered into several program activities, one of which is the Community Outreach and Empowerment Program in Conservation Areas: Distribution of Conservation Assistance.

The author's reasons for choosing a research location in the Anambas Islands MPA are because: 1). this area has very rich and diverse aquatic biological resource potential; 2). the socio-cultural conditions that are owned by Anambas Islands Regency are unique and interesting; and 3). this MPA is located in a remote area and borders with the neighboring countries. Therefore, the authors feel challenged to evaluate a policy that is one of the government's national priority programs. In addition, the authors are interested in conducting research related to the evaluation of this conservation assistance program because until now there has been no in-depth study regarding the program so the effectiveness of the program is unknown both in terms of implementation and benefits for the community.

Based on the author's observations in the field, several phenomena were found, including:

The evaluation has been carried out independently by LKKPN Pekanbaru, but it is limited to the progress of using the aid by KOMPAK and the problems encountered. The author still finds that there is a gap between das sein und das sollen, such as the target of aid recipients should be community groups that are active in conservation activities. However, in reality the author observed that only group leaders who have been actively carrying out conservation activities while most of its members are still very rarely involved in active conservation activities;

tu_pian_1.png

Figure 1. Amount of conservation assistance in 2016-2022

Source: Directorate for Marine Conservation and Biodiversity, DGMSM-MMAF, 2022

Table 1. Data on recipients of conservation assistance in the Riau Islands Province in 2017-2022

No.	Group Name	Regency/City	Year	Aid Provider
1	Elang Laut	Anambas Islands	2017	Directorate for MCB
2	Tiga Bintang Laut Timur	Anambas Islands	2017	Directorate for MCB
3	Batu Belah Bersatu	Anambas Islands	2017	Directorate for MCB
4	Kuda Laut	Anambas Islands	2017	Directorate for MCB
5	Pokmaswas Sebong Pereh	Bintan	2018	BPSPL Padang
6	Mutiara Mapur	Bintan	2018	BPSPL Padang
7	Kelompok Masyarakat Konservas Desa Landak	Anambas Islands	2018	LKKPN Pekanbaru
8	Anambas Snorkeling Community (ASC)	Anambas Islands	2018	LKKPN Pekanbaru
9	Pavona Dive	Anambas Islands	2018	LKKPN Pekanbaru
10	Tujuh Bersaudara Pesona Anambas (TBPA) Dive	Anambas Islands	2018	LKKPN Pekanbaru
11	KUB Anggoli	Anambas Islands	2019	LKKPN Pekanbaru
12	Napoleon Anambas Dive Center (NADC)	Anambas Islands	2019	LKKPN Pekanbaru
13	Komunitas Pecinta Alam Anambas (KOMPAS)	Anambas Islands	2019	LKKPN Pekanbaru
14	Pokmaswas Desa Kiabu	Anambas Islands	2020	LKKPN Pekanbaru
15	Shark Dive	Anambas Islands	2021	LKKPN Pekanbaru
16	Kelompok Pemandu Wisata dan Pelestarian Objek Wisata Kecamatan Palmatak	Anambas Islands	2021	LKKPN Pekanbaru
17	Kepiting Laut	Anambas Islands	2021	LKKPN Pekanbaru
18	Kelompok Penyu Jemaja Lestari	Anambas Islands	2022	LKKPN Pekanbaru

Source: Directorate for MCB, 2022, and author's modification.

Indicators of successful outcomes (in technical guidelines) from the distribution of this conservation assistance are increased efforts to protect, preserve, and/or utilize the conservation area or fish species that are endangered and/or protected. However, based on the author's observation there is still no visible indicator of success, what is seen is only an indicator of output success in the form of distribution of relief goods to KOMPAK. Meanwhile, the contribution or role of KOMPAK to LKKPN Pekanbaru to increase the effectiveness of the management of the Anambas Islands MPA is still not visible.

Based on the background of the problems and phenomena above, the authors are interested in examining this research more deeply with the title "Evaluating Conservation Assistance Program in the Anambas Islands Marine Protected Area Using the CIPP Model".

2. Literature Review

2.1 Public administration concept

Public administration in Indonesia is better known as state administration. Public administration is one of the disciplines of administration as an aspect of government activities. According to Leonard D. White in broadest terms, public administration consists of all those operations having for their purpose the fulfillment or enforcement of public policy. implementing and imposing public policy on state policy. Meanwhile, Kasim explain states that public administration is very influential not only at the level of policy formulation but also at the level of policy implementation [4].

Public policies relating to fisheries and marine conservation are usually closely correlated. These policies aim to protect natural resources, ensure the sustainability of marine ecosystems, and maintain aquatic biodiversity. Some correlations that can be found between public policies and fisheries and marine conservation programs include:

Catch Restrictions
Habitat Protection
Education and Counseling
Regulation of Aquatic Management
Research and Development

2.2 Public policy concept

Public policy according to Chandler and Plano, is the strategic use of existing resources to solve public problems. That is, that public policy is intended for the benefit of society or the public [5].

Provides an interpretation of public policy as a result of the formulation of a government. In this view, public policy is better understood as what is done by the government rather than the process of making results [6]. Whereas Islamy, states that a state policy will be effective if it is implemented and has a positive impact on society, in other words, the actions or deeds of humans who are members of society are following what is desired by the government or the state [7].

Based on Robert S. Effective management of marine protected areas (MPAs) requires continuous feedback of information to achieve objectives. In 2000, a collaborative initiative was launched to improve the management of MPAs. The initiative focused on working with managers, planners, and other decision-makers to develop a set of indicators for assessing the effectiveness of MPA use. This initiative was aimed at both enhancing the potential and capability for adaptive management of MPAs, as well as improving our understanding of how effective MPAs that are now being used around the world.

2.3 Evaluation concept

Suchman views evaluation as a process of determining the results achieved by several planned activities to support the achievement of goals. In addition, a well-known program evaluation expert, Stufflebeam said that evaluation is a process of describing, searching, and providing information that is very useful for decision-makers in determining alternative decisions [8]. While the concept of evaluation criteria according to Kadir [9] consists of effectiveness, efficiency, adequacy, alignment, responsiveness and accuracy.

Subarsono explains that evaluation has several objectives, namely: 1). Determining the level of performance of a policy; 2). Measuring the level of efficiency of a policy; 3). Measuring the level of output (outcome) of a policy; 4). Measuring the impact of a policy; 5). To find out if there is a deviation; and 6). As input for future policies [10].

2.4 Program evaluation concept

It is known together, that one of the objects in the evaluation is a program. Ralph Tyler, 1950 defines program evaluation as a process to find out whether program objectives have been realized [11]. Meanwhile, Cronbach and Stufflebeam explained that program evaluation is an effort to provide information to be conveyed to decision-makers [12].

Burke Johnson translating program evaluation is the use of research procedures to systematically examine the effectiveness and intervention of a program [13]. Program evaluation is an activity or effort to obtain information about a program being implemented to assess the extent to which the activity has been carried out by a predetermined plan and then to find out what decisions can be made related to the assessment that has been carried out [14].

2.5 Program evaluation model Context, Input, Process and Product (CIPP)

There are many program evaluation models developed by experts that can be used to evaluate a program. One of these models is the evaluation of the CIPP model (Context, Input, Process, and Product). This evaluation model was first offered by Stufflebeam and developed in 1966. Stufflebeam, in his book Education Evaluation and Decision Making, cited by Daryanto [15], describes four scopes or evaluation aspects of the CIPP model, namely:

Context Evaluation; This evaluation identifies and assesses the underlying needs of a program. Context evaluation mainly leads to the identification of organizational strengths and weaknesses and to providing input to improve the organization.
Input Evaluation; This evaluation identifies problems, assets, and opportunities to help decision-makers define objectives, and priorities, and form groups of users to more broadly assess program objectives, priorities, and benefits, assess alternative approaches, action plans, staff plans, and budget for facilities and potential to meet targeted needs and objectives.
Process Evaluation; Process evaluation serves to provide input that can help the organization's staff carry out the program according to plan, or perhaps modify plans that turn out badly. In turn, process evaluation becomes a vital source of information for interpreting product evaluation results.
Product Evaluation; Aims to assess the success of the program in meeting the needs of the target program. These judgments about the success of the program or organization are collected from the people involved individually or collectively and then analyzed.

2.6 Conservation assistance program

Government assistance in the field of conservation is one of the MMAF's national priority programs. Apart from being an effort to accelerate the effectiveness of conservation area management involving the community, this assistance is also part of the empowerment efforts carried out by the Government for community groups in coastal areas and small islands, especially people who are concerned and active in carrying out conservation efforts both inside and outside conservation areas [16].

Conservation assistance is government assistance that is distributed by the MMAF to community groups with conservation activities, in the context of empowering communities in coastal areas and small islands, to increase the effectiveness of management of marine protected areas and/or management of protected and/or extinct threatened fish species.

3. Methods

This research was designed using a descriptive research type with a qualitative approach. The descriptive method describes the state of certain objects at present based on visible facts or as they are [17]. Bogdan and Taylor [5] state that qualitative research is a research procedure that produces descriptive data in the form of written or spoken words from people and observable behavior, the approach is directed at the background and individual holistically [18] (Table 2).

Table 2. Informants

No.	Informants	Number
1.	Head of LKKPN Pekanbaru	1 person
2.	Implementing Staff of Conservation Assistance Distribution of LKKPN Pekanbaru	1 person
3.	Head of Department of the Fisheries, Agriculture and Food. District Government of Anambas Islands.	1 person
4.	Fisheries Instructor	1 person
5.	Village Head	2 persons
6.	Community Groups that have received conservation assistance	6 persons
Total of Informants		12 persons

The author's considerations for choosing to use a qualitative approach include: 1). Allows the author to study selected issues, cases or events in depth and in more detail; 2). Data collection is not limited by predetermined categories; 3). There are no false data findings, so the author can measure the reactions of many people to a limited set of questions; and 4). Qualitative data provides depth and detail through direct quotes and careful descriptions of the evaluated programs, events, people, interactions and behaviors observed.

The sampling method in this study used a purposive sampling technique with typical case sampling. The author interviewed twenty informants who were competent in providing various information and data required.

The author determined these informants because they are directly involved in each stage of the assistance program activities, such as planning, budgeting, implementation and monitoring. The questions asked during the interview were customized depending on the informant being interviewed.

Data triangulation in marine conservation program evaluation research is an important approach to ensure the validity and reliability of research results. Triangulation involves collecting and analyzing data from multiple sources or methods to corroborate findings and conclusions. In the context of marine conservation program evaluation, the following are some of the data sources that can be used to triangulate:

Statistical and Quantitative Data: Includes data on fish populations, ecosystem conditions, fishing patterns, or physical and chemical changes in the ocean. This data can come from government agencies, research institutions, or relevant scientific institutions.
Field Studies and Observations: Involves direct observations at the site of marine conservation programs, such as observations of coral reefs, marine animal movements, or direct assessments of program success in the field.
Interviews and Questionnaires: Involves direct interaction with relevant stakeholders, such as fishers, local communities, local government, or conservation officers. This helps to understand perceptions, experiences, and impacts of the program firsthand.
Document and Policy Analysis: Exploring official documents related to marine conservation policies, program reports, government decisions, or administrative data to gain a deeper understanding of the program context.

The main data source in this study is the words that come from informants through interviews which are primary data. The secondary data in this study include laws and regulations, books, journals, articles, and reports related to the research topic.

Data collection techniques are the most strategic step in research because the main goal of research is to get data. The author uses several techniques or methods in collecting data and information needed in this study, namely interviews, observation, and documentation. The data analysis technique used by the author in this study is the Miles and Huberman model with the stages of data reduction, data presentation, and drawing conclusion [19]. In marine conservation program evaluation research, document data can be an invaluable source of information. Here are some types of documents that can be important sources of data:

Conservation Plans and Policies: Official documents that outline the goals, strategies, and steps taken in a conservation program. This could be a marine conservation plan, coral reef management plan, or habitat protection policy.
Program Reports: Official documents that summarize the progress, achievements, challenges, and evaluation of a conservation program. Annual reports, project reports, or internal evaluations are examples of these reports.
Catch Data and Fisheries Statistics: Official data or reports from government agencies or relevant organizations that record the amount of fishing, types of fish caught, fishing areas, and other relevant information.
Legal and Regulatory Documents: Includes laws, regulations, or policies relating to environmental protection, marine resource conservation, or fisheries management.
Case Studies and Research Reports: Documents containing results from past research, case studies of conservation program success or failure, or reports from relevant research institutions.
Administrative Documents: This includes administrative documents related to conservation program operations such as budgets, activity plans, and other administrative documentation.

Internal and External Communication Documents: Letters, memos, or other official communications between various stakeholders involved in the conservation program.

4. Result and Findings

Establishment of Conservation Areas: The establishment of marine protected areas, such as marine parks or conservation zones, to protect important marine ecosystems. Resource Management: Marine resource management regulations and practices, including fishing quotas, safeguards for coral reef ecosystems, and protection of threatened species. Community Empowerment: Engaging local communities in conservation efforts, including education about the importance of the marine environment and training programs for sustainable resource management.

Ecotourism Development: Development of sustainable tourism by utilizing the natural beauty of the ocean as an alternative source of income for local communities. Collaboration with External Parties: Collaboration with external parties such as non-governmental organizations (NGOs), research institutions, or central/regional governments to support and strengthen conservation programs. Environmental Survey and Monitoring: Data collection and continuous monitoring of marine environmental conditions to evaluate program effectiveness and adjust strategies as needed.

From 2018 to 2022, LKKPN Pekanbaru implemented a conservation assistance program for community groups who are active in carrying out protection, preservation, and utilization activities in the Anambas Islands MPA. The types and details of the aid items that have been distributed vary, including boats, diving equipment, conservation gazebos, and others that are used to support the activities of community groups in and around conservation areas, as well as boost the community's economy through sustainable utilization of maritime potential.

Table 3. Data on distribution of conservation assistance by LKKPN Pekanbaru in the Anambas Islands MPA 2018-2022

No.	Group Name	Receiving Year	Relief Items Received
1.	Kelompok Masyarakat Konservasi Desa Landak	2018	Fiber Boat with Engine Underwater Camera Snorkel equipment
2.	Anambas Snorkeling Community	2018	Underwater Camera Snorkel equipment Dome Tent
3.	Pavona Dive	2018	Underwater Camera Diving Equipment
4.	Tujuh Bersaudara Pesona Anambas	2018	Underwater Camera Diving Equipment
5.	KUB Anggoli	2019	Wooden Boat equipped withe Engine, basic navigation equipment and life jackets
6.	KOMPAS	2019	Conservation Gazebos Laptop LCD Projector and Screen
7.	Napoleon Anambas Dive Center	2019	Fiber Boat with Engine Life Jackets
8.	Pokmaswas Desa Kiabu	2020	Wooden boat with engine Basic navigation equipment and life jackets
9.	Kepiting Laut	2021	Diving Equipment Underwater Camera
10.	Pemandu Wisata Kecamatan Palmatak (Anambas Tour)	2021	Snorkeling Equipment Laptop Printer Underwater Camera Action Camera
11.	Shark Dive	2021	Dive Equipment Underwater Camera
12.	Penyu Jemaja Lestari	2022	Fiber Boat with 25HP Engine Underwater Camera Life Jackets Headlight

Source: LKKPN Pekanbaru, 2022

Referring to the Table 3 above, it can be seen that LKKPN Pekanbaru has been implementing a conservation assistance program since 2018 or has been running for 5 (five) years in the Anambas Islands MPA and has distributed conservation assistance to 12 (twelve) community groups.

The results of the evaluation of the conservation assistance program in the Anambas Islands MPA using the CIPP model are presented in the following discussion:

1. Context Evaluation

This evaluation is to identify the strengths or advantages of the program being evaluated, the suitability of program objectives with the vision and mission of the organization, and the legality of the program [20]. The conservation assistance program is intended to provide a stimulus to the people who carry out conservation efforts both inside and outside the marine protected area.

According to the statement from the Head of LKKPN Pekanbaru, this conservation assistance program is a form of government support and an effort to empower conservation activist community groups to be more actively involved and contribute positively to the management of conservation areas. The assistance provided can be used for a multi-purpose, such as for activities to protect and preserve biota-ecosystems that are beneficial for environmental sustainability as well as activities for utilizing marine resources that can improve the welfare of groups and surrounding communities.

This program already has a legal shelter, namely Law number 1 of 2014 juncto Law nnumber 27 of 2007 concerning the Management of Coastal Areas and Small Islands. Article 63 states that the Government and Regional Governments are obliged to empower the community in improving their welfare. Then, the derived rule is Regulation of the Minister of Marine Affairs and Fisheries Number 2 of 2021 concerning the Distribution of Government Assistance within the MMAF. Meanwhile, as a guideline for the implementation of activities, it has been strengthened by Ministerial Decree number 4/SJ of 2022 concerning Technical Guidelines for the Distribution of Conservation Assistance in 2022.

The conservation assistance program in the Anambas Islands MPA is aimed at increasing community participation in the protection, preservation, and utilization of conservation areas so that the value of the effectiveness of MPA management will be even better. This means that the program is very relevant to the vision and mission of LKKPN Pekanbaru for 2020-2024, namely the Management of National Marine Protected Areas under the authority of LKKPN Pekanbaru which is Prosperous and Sustainable Towards the Realization of Directorate General Marine Spatial Management's Vision.

Based on a context evaluation (Table 4), this conservation assistance program aims to empower communities to be more actively involved in the management of conservation areas while at the same time increasing their economic income thanks to this assistance. This means that the conservation assistance program in the Anambas Islands MPA is very good. In addition to having clear and strong legality, the objectives of this program are also relevant to the organization's vision and mission in efforts to increase the effectiveness of management of the Anambas Islands MPA through community empowerment around the conservation area.

Table 4. Context evaluation

No.	Context Evaluation Aspects	Evaluation Data Results
1	Background of program implementation	The need to support and empower community groups to be more actively involved and contribute positively in the management of marine conservation areas and fish species that are endangered and/or protected by providing stimulus in the form of relief goods that can support their conservation efforts.
2	Analysis of the needs for conservation assistance programs	The assistance provided is used for multi-purpose purposes, such as protecting and preserving biota ecosystems that are beneficial for environmental sustainability and resource utilization activities that can improve the welfare of the group and the surrounding community.
3	Relevance of program objectives and organizational vision and mission	The program objectives are very relevant to the organization's vision and mission, namely to increase the effectiveness of conservation area management.
4	The legal basis for implementing the program	Law 1 of 2014 jo. Law 27 of 2007 on Management of Coastal Zone and Small Islands; Regulation of the Minister of MAF 2 of 2021 on the Distribution of Government Assistance in MMAF; Decree of the Minister of MAF 4/SJ of 2022 on Technical Guidelines for Distribution of Conservation Assistance in 2022.

Table 5. Input evaluation

No.	Input Evaluation Aspect	Evaluation Data Results
1	Human Resources	Sufficient human resources are available to run conservation assistance programs.
2	Cost/Budget	The availability of the budget is sufficient, sourced from the APBN of IDR 100,000,000 per community group.
3	Facilities and infrastructure	Facilities and infrastructure are sufficient but still not optimal to reach remote and remote locations.
4	Stakeholder support	The Regional Government strongly supports the conservation assistance program by disseminating program information to all community groups it supports and providing recommendations for potential beneficiaries to LKKPN Pekanbaru; Fisheries Instructors assist community groups in the program implementation process; The Village Head also supports the program through endorsement of the KOMPAK assistance proposal in his area.

2. Input Evaluation (Table 5)

This evaluation is to identify internal and external strengths in the implementation of the program as human resources, program funding, facilities and infrastructure, and support from stakeholders [21].

Based on the data obtained, the source of funding for this conservation assistance program comes from the State Budget (APBN) and is budgeted every year because it is one of the government's priority programs for community empowerment. According to the explanation from LKKPN Pekanbaru staff, on average each year the target of aid is to be distributed to 2 (two) KOMPAK with a nominal value of aid equivalent to one hundred million rupiahs per group.

To carry out the conservation assistance program in the Anambas Islands MPA so that it is implemented properly, the Human Resources are needed. Based on the author's direct observations from the field and information from the Head of LKKPN Pekanbaru, the availability of human resources owned by LKKPN Pekanbaru is sufficient to carry out this conservation assistance program starting from preparation, and implementation to assistance after receiving assistance providing guidance and direction to KOMPAK recipients of assistance. While the facilities and infrastructure owned by LKKPN Pekanbaru are still inadequate, especially the transportation facilities (ships/speedboats) that are owned are not safe enough to reach locations that are very remote and difficult to reach, given the geographical conditions of Anambas Islands Regency which is an archipelago and the average population lives in the area isolated.

Department of Fisheries, Agriculture and Food of Anambas Islands Regency (DP3 KKA) support in implementing this program was very influential so that LKKPN Pekanbaru did not work alone. DP3 KKA disseminates information on the assistance program to the community groups it fosters. DP3 KKA also provides recommendations or suggestions to aid providers in KOMPAK proposals that apply for conservation assistance. The Head of DP3 KKA explained that the Regional Government had a role in conveying initial information on the conservation assistance program to community groups and then providing recommendations for potential beneficiaries who were eligible and met the requirements/criteria to LKKPN Pekanbaru. Support from other stakeholders also came from Fisheries Instructor and Village Heads in Anambas Islands Regency with their respective roles. The Fisheries Instructor's role is to assist community groups in implementing programs such as preparing aid proposals and utilizing aid goods. Meanwhile, the village head has the role of validating aid proposals as one of the prerequisites for obtaining conservation assistance.

That is, based on the evaluation of inputs, the conservation assistance program in the Anambas Islands MPA can be said to be good with the availability of human resources owned by LKKPN Pekanbaru and a regular annual budget from the Government and support from various related parties through their respective roles. Although there are a few obstacles related to inadequate infrastructure belonging to LKKPN Pekanbaru, they can be minimized with the support of the Regional Government which helps the smooth implementation of this program.

3. Process Evaluation

Process evaluation is carried out to evaluate from preparation to program implementation. This is done to determine the extent to which the plans that have been made and determined are in line with the objectives to be achieved. The process components include preparation, implementation, and inhibiting factors for program implementation [22, 23].

Table 6. Process evaluation

No.	Process Evaluation Aspects	Evaluation Data Results
1	Preparation	Preparation and determination of technical guidelines for the distribution of conservation assistance by the Directorae General Marine Spatial Management; LKKPN Pekanbaru letters to DP3 KKA regarding the information on conservation; assistance programs; DP3 KKA informs to community groups that are active in conservation activities about program.
2	Implementation	KOMPAK submitted a proposal for conservation assistance to LKKPN Pekanbaru; LKKPN Pekanbaru conducts proposal verification and field verification and then ranks which KOMPAK is eligible to receive assistance; Verification results are submitted to the Director of KKHL for approval and then determined by the Head of LKKPN Pekanbaru; Procurement of aid items up to handover to KOMPAK recipients of conservation assistance; The implementation of the program has been carried out by technical instructions and is very transparent. Community groups do not incur any costs from submitting proposals to handing over assistance; LKKPN Pekanbaru routinely aids and guidance to KOMPAK while monitoring the utilization of the aid items that have been provided.
3	Obstacles	The procurement process experienced delays because they had to wait for the TKDN recommendation from the KKP TKDN Supervisory Team if the requested assistance was imported goods; The process of sending aid goods was delayed due to bad weather;

In the preparatory stage, the Directorate General of Marine Spatial Management has prepared and determined the technical guidelines for the conservation assistance program. Then LKKPN Pekanbaru coordinated and wrote to DP3 KKA regarding the conservation assistance program to inform community groups that are active in conservation activities to submit conservation assistance proposals.

After the proposals from community groups were received, LKKPN Pekanbaru conducted a verification of the proposals and field verification. If many proposals pass verification, then scoring is done on which group is eligible to receive assistance. Furthermore, the verification results are submitted to the Director of Conservation Areas and Marine Biodiversity (KKHL) for approval. After obtaining approval from the Director of KKHL, the Head of LKKPN Pekanbaru determines the KOMPAK beneficiary, and then the process of procuring relief goods is carried out by the LKKPN Pekanbaru Goods and Services Procurement Officer.

Regarding process evaluation, based on the data obtained (Table 6), the implementation of the conservation assistance program has been running very transparently and by the established Technical Guidelines. According to Chairman of KOMPAK Anggoli, they were not charged a penny in implementing the conservation assistance program, starting from proposal submission, verification, and determination to the handover of the aid goods.

However, several obstacles were still encountered in the process of procuring relief goods, including the President's appeal regarding the use of the Domestic Component Level (TKDN), which resulted in the process of procuring aid goods being a little late because they had to wait for a recommendation from the MMAF's TKDN Supervisory Team if the relief goods to be purchased were goods import. In addition, there were also obstacles due to delays in the delivery of relief goods caused by bad weather that often occurred in the Anambas Islands Regency.

Table 7. Evaluation of output

No.	Output Evaluation Aspects	Evaluation Data Results
1	Program Output/Results	The number of beneficiaries is by the target in the Main Performance Indicators of Organization; The relief goods are by KOMPAK's proposals.
2	Program Outcome/Impact	KOMPAK's involvement in the management of the Anambas Islands MPA is increasing; Most of the relief items have been used to support KOMPAK's conservation activities; A small number of KOMPAK have felt the impact of the program in the form of increased income/economy compared to before; Several KOMPAKs have not felt the economic impact due to the COVID-19 pandemic which has resulted in no tourist visits to Anambas so relief goods cannot be rented out.
3	Program Sustainability	Stakeholders agreed that this program should be continued because it is very beneficial for the community (increased income) and managers of the Anambas Islands MPA (increased involvement and effectiveness of area management). It should be improved by multiplying and expanding its reach, considering that the area of the Anambas Islands MPA is very large.

4. Output Evaluation (Table 7)

This evaluation is directed at the results and impacts obtained from the existence of a conservation assistance program in the Anambas Islands MPA. In terms of output, the number of KOMPAK targeted in the Main Performance Indicators of organisation for the conservation assistance program has been achieved and the relief goods are by KOMPAK's recommendations in proposal. However, in terms of outcomes, the conservation assistance program in the Anambas Islands MPA is still not optimal.

Referring to the data obtained by the author, KOMPAK received assistance in the form of goods to support activities in conservation efforts such as diving equipment, boats, gazebos, cameras, laptops, and others. KOMPAKs have utilized most of the aid items received for conservation activities around the Anambas Islands MPA so that they are more or less involved in helping LKKPN Pekanbaru in managing the Anambas Islands MPA. There are KOMPAKs whose economic income have increased since receiving conservation assistance. KOMPAK Penyu Jemaja Lestari and KOMPAK Anggoli conveyed information that since they received conservation assistance from LKKPN Pekanbaru their income had increased from before.

However, there are still KOMPAK who have not been able to optimize the aid due to several obstacles such as the COVID-19 pandemic. The head of KOMPAK "Shark Dive" explained that they had not been able to make optimal use of the relief goods. They only used the relief goods for conservation education activities for the surrounding community. They have not been able to utilize the relief goods for rent in the context of tourism activities because there are no tourists visiting the Anambas Islands during the COVID-19 pandemic. So, they have not felt the economic impact oft the relief goods yet.

Regarding the sustainability of the program, all informants such as the Head of DP3 KKA, Head of KOMPAK and the Village Head strongly expect this program to be continued and even multiplied and expanded considering that this program is very beneficial for the communities around the conservation area and can also increase the effectiveness of the management of the Anambas Islands conservation area by LKKPN Pekanbaru.

Marine conservation program evaluation aims to measure the effectiveness, sustainability and impact of the program on the environment and local communities. Some of the goals of marine conservation program evaluation include:

1. Success in Achieving Objectives

Fish Population Increase: Was the program successful in increasing the population of a particular fish or restoring the sustainability of a threatened fish resource? Habitat Protection: To what extent was the program able to protect and improve habitat conditions for coral reefs, mangrove forests, or other areas important for marine sustainability? Ecosystem Balance: Does the program contribute to ecosystem balance and aquatic biodiversity?

2. Participation and Social Impacts

Community Involvement: What is the extent of community participation and support in this conservation program? Are communities actively involved in program activities? Impact on Livelihoods: How does the program affect the livelihoods of fishermen or coastal communities economically and socially?

3. Impact on Policies and Regulations

Influence on Public Policy: To what extent does the program influence policies and regulations related to marine conservation at the local or national level? Conformance with Regulations: Does the program operate in accordance with existing regulations and policies?

4. Efficiency and Sustainability

Program Sustainability: Is the program sustainable in terms of financial, organizational, and community participation? Resource Use Efficiency: How efficiently does the program utilize available resources?

5. Awareness and Education

Public Awareness Raising: Was the program successful in raising public awareness of the importance of marine conservation and environmental responsibility? A good evaluation will provide a better understanding of the extent to which the marine conservation program is successful in achieving its stated objectives. This allows for making necessary improvements, adjusting strategies, and making better decisions in planning future conservation activities.

5. Conclusion

Overall, based on the evaluation using the CIPP model, the authors conclude that the conservation assistance program in the Anambas Islands MPA carried out by LKKPN Pekanbaru as the management authority for the Anambas Islands MPA has been running well is appropriate and quite effective and feasible to continue and even expand its reach. This is because this conservation assistance program shows that its implementation has been in line with expectations and goals and has provided beneficial results for area managers and community groups such as increased community involvement in conservation area management and increased income/economy of community groups receiving assistance. Some of evaluation from marine conservation programs based on society are:

Impacts on Fishermen and Coastal Communities: Communities directly involved in fishing activities and dependent on marine resources may have specific views on conservation programs, depending on how they affect their livelihoods.
Participatory Approach: If the conservation program involves active participation from local communities in planning and implementation, their response may be more positive as they feel involved and have a role in safeguarding their environment.
Perception of Benefits: Communities will also evaluate conservation programs based on the concrete benefits they see or feel. If the program provides tangible benefits, such as increased fish populations or a healthier marine environment, communities may be more supportive of the program.
Communication and Outreach Patterns: The effectiveness of conveying information about conservation programs to communities can influence their perceptions. If communication is open and clear, communities are more likely to understand the purpose and benefits of the program.

Several factors became the obstacles in the implementation of the conservation assistance program in the Anambas Islands MPA such as the process of procuring aid goods which took too long due to having to wait for domestic component level (TKDN) recommendation, delays in sending aid goods due to weather, and the COVID-19 pandemic outbreak. To overcome this, LKKPN Pekanbaru needs to make a more precise strategy to minimize the existing constraints and the obstacles so that in the future it will not happen again.

Acknowledgment

The authors gratefully acknowledge Universitas Islam Riau for all their support and resources.

References

[1] Abdussamad, Z. (2021). Metode Penelitian Kualitatif. Makassar: CV. Syakir Media Press.

[2] Akbar, M.F., Mohi, W.K. (2018). Studi Evaluasi Kebijakan (Evaluasi Beberapa Kebijakan di Indonesia). Gorontalo: Ideas Publishing.

[3] Ambiyar, Muharika, D. (2019). Metodologi Penelitian Evaluasi Program. Bandung: Penerbit Alfabeta.

[4] Arikunto, Suharsimi dan Abdul Jabar. (2018). Evaluasi Program Pendidikan. Edisi Kedua. Jakarta: PT Bumi Aksara.

[5] Bogdan, R., Taylor, S.J. (1992). Pengantar Metode Penelitian Kualitatif, Terjemahan oleh Arief Rurchan. Usaha Nasional.

[6] Daryanto, H. (2010). Evaluasi Pendidikan Cetakan II. Jakarta: Penerbit Rineka Cipta.

[7] Dunn, W.N. (2003). Analisis Kebijakan Publik. Yogyakarta: Gadjah Mada University Press.

[8] Islamy, I. (2010). Prinsip-Prinsip Perumusan Kebijakan Negara. Jakarta: Bumi Aksara.

[9] Kadir, A. (2020). Fenomena Kebijakan Publik Dalam Perspektif Administrasi Publik di Indonesia. Dhamasraya: CV. Dharma Persada.

[10] Karding, A.K. (2008). Evaluasi Pelaksanaan Program Bantuan Operasional Sekolah (BOS) SMP Negeri di Kota Semarang. Doctoral dissertation, program Pascasarjana Universitas Diponegoro.

[11] LKKPN Pekanbaru. (2022). Laporan Kegiatan Pemberian Bantuan Konservasi Tahun 2022.

[12] LKKPN Pekanbaru. (2022). Laporan Pemanfaatan Barang Bantuan Pemerintah Pada KOMPAK Penerima Tahun 2021.

[13] Massiri, S.D. (2022). Strategi Pemberdayaan Masyarakat Pemberdayaan pada Kawasan Konservasi. Bandung Barat: Smart Publishing.

[14] Mukhlis, S., Siam, N.U. (2021). Evaluasi program bantuan stimulan perumahan swadaya (BSPS) pada kelurahan tanjung unggat. Jurnal Ilmu Sosial dan Ilmu Politik, 2(2): 445-460. https://doi.org/10.56552/jisipol.v2i2.43

[15] Mutrofin. (2014). Evaluasi Program - Teks Pilihan Untuk Pemula. Yogyakarta: Laksbang Pressindo.

[16] Nawawi, H. (2015). Metode Penelitian Bidang Sosial. Yogyakarta: Gadjah Mada University Press.

[17] Priyono, M.V. (2021). Evaluasi program pemberian bantuan pengembangan unit pengolah pupuk organik (uppo) dari kementerian pertanian di kabupaten simalungun sumatera utara. GEMA PUBLICA: Jurnal Manajemen dan Kebijakan Publik, 6(1): 58-75. https://doi.org/10.14710/gp.6.1.2021.58-75

[18] Rahmawati, I., Wahyuni, N.P., Gouvany, A.L., Fitriya, A.N. (2022). Evaluasi Program Pemberdayaan Masyarakat dalam Pembinaan Industri Rumah Tangga Oleh Dinas DP3AKB di Kota Cilegon. Jurnal Ilmiah Wahana Pendidikan, 8(24): 138-149. https://doi.org/10.5281/zenodo.7476839

[19] Subarsono. (2011). Analisis Kebijakan Publik (konsep, teori dan aplikasi). Yogyakarta: Pustaka Pelajar.

[20] Sugiyono. (2013). Metode Penelitian Kombinasi (Mixed Methods). Bandung: Alphabeta.

[21] Sumardjo. (2003). Transformasi Model Penyuluh Pertanian Menuju Pengembangan Kemandirian Petani. Kasus di Provinsi Jawa Barat. Institut Pertanian Bogor.

[22] Thoha, M. (2012). Dimensi-dimensi Prima Ilmu Admnistrasi Negara. Jakarta: Raja Grafindo Persada.

[23] Yusuf, F. (2008). Evaluasi Program dan Instrumen Evaluasi Untuk Program Pendidikan dan Penelitian. Jakarta: PT. Rinek Cipta.

IJHT
MMEP
ACSM
EJEE
ISI
I2M
JESA
RCMA
RIA
TS
IJSDP
IJSSE
IJDNE
JNMES
IJES
EESRJ
RCES
AMA_A
AMA_B
AMA_C
AMA_D
MMC_A
MMC_B
MMC_C
MMC_D

Username
Password
Remember me

Search form

Evaluating Conservation Assistance Programs in the Anambas Islands Marine Protected Area Using the CIPP Model

tu_pian_1.png