© 2023 IIETA. This article is published by IIETA and is licensed under the CC BY 4.0 license (http://creativecommons.org/licenses/by/4.0/).
OPEN ACCESS
This study attempts to explore the measurement model of public policy assessment of North Sumatra province, Indonesia. The research method employed in this study is a mixed-method of qualitative and quantitative approaches. The sample of this study is totaling to 100 participants. In data collection, questionnaires containing closed and semi-closed questions were used. Meanwhile, for qualitative data, interview was done to support quantitative data. From the analysis, it can be concluded that the purpose of evaluating the results of regional development plans is to ensure that regional development achievements are in line with established performance indicators. The regional apparatus planning agency of North Sumatra Province has only used budget realization as a metric for evaluating development planning thus far. Due to a lack of supporting data and qualified human resources in each regional apparatus organization, researchers discovered that regional apparatus organizations need help determining program and activity performance indicators. Several indicators, such as effectivity, adequacy, equity, responsivity, and accuracy must be developed in order to evaluate the success of a policy. In general, the inhabitants of North Sumatra believe that the development planning performance targets in North Sumatra are still low and have had little impact on the community welfare.
model, regional development, organization, North Sumatra
Regional autonomy can be defined as the desire to create a more self-sufficient regional administration, both politically and financially. The award of this authority is designed to boost local governments’ capacity to improve regional development and foster a competitive spirit with other areas in the context of regional development. The existence of a good agency or work unit is a crucial factor in the success of regional development planning. A Regional Development Planning Agency was established to ensure that the development planning process ran smoothly. According to Sukartawi [1], the importance of planning factors associated to development may be divided into two categories: (1) planning as a development tool; and (2) planning as a benchmark for the development success or failure.
Targeted development based on development planning documents will have a bigger impact on efforts to meet development goals and targets for bettering community welfare and regional advancement. Law Number 22 of 1999 concerning Regional Government, which has been perfected by Law Number 32 of 2004 and Law Number 23 of 2014, then operational regulations related to technical implementation of regional development planning, such as Government Regulation Number 8 of 2008 and Minister of Home Affairs Regulation Number 54 of 2010.
Regional development must be evaluated in order to determine whether it has met the planned goals/targets and whether the community has benefited from it. The evaluation will also give crucial data that can be used as a tool to help development stakeholders and policymakers understand, manage, and improve what has already been done.
The process of creating, implementing, and evaluating development planning papers is still in need of improvement. Government Regulation Number 8 of 2008 concerning Stages, Procedures for Preparation, Control, and Evaluation of the Implementation of Regional Development Plans regulates local governments’ responsibility to control and analyze regional development plans. The Regent/Mayor is required to examine regional development planning within the regency/scope, city’s including: (1) regional development planning policies; (2) regional development plan execution; and (3) regional development plan results [2].
A strategy is defined as a method for achieving long-term objectives. Geographic expansion, diversification, acquisition, product development, market penetration, employee rationalization, divestment, liquidation, and joint ventures are all examples of business strategy [3]. The relevance of development planning may be seen in the uneven development of the archipelago’s areas. This, of course, causes public envy, leading to the so-called “back wash effect,” in which the rise in labor and capital is not dispersed equitably [4]. Marginal areas will become increasingly backward (the poor will become poorer, and the wealthy will become wealthier), necessitating the implementation of a “speed effect,” in this instance rising and extending activities, i.e. “even distribution of development.”
The description of development planning goals and objectives should be explored as a tool for establishing a clear path for constructive cooperation between the government and its citizens. As a result, as previously said, the purpose and objective of development planning is to examine systematically arranging activities to be carried out in order to attain a mutually desired goal.
The goal of most evaluations is to determine how responsible government policies are to their constituents. The degree to which the objectives are met, as well as the extent to which expectations differ from reality. In general, policy evaluation, according to Winarno [5], can be defined as an activity that involves the estimating or assessment of policies, including their substance, execution, and impact.
According to Winarno [5], policy evaluation can be divided into two different duties. The first duty is to describe the impact of a policy in order to establish the implications. The second duty is to decide if a policy is successful or unsuccessful using predetermined standards or criteria. Policy assessment is the process of determining the measures that can be made in the future by evaluating and reviewing both the policy implementation stage and the outcome or impact of the operation of a policy or program.
Winarno [5] divides policy evaluation into three types; each type of evaluation introduced is based on the evaluators’ understanding of evaluation, as follows:
According to Samudra et al. [7], public policy evaluation serves four purposes:
The availability of a criterion to measure the success of a program or public policy is required when evaluating it. According to Willian N. Dunn, various indicators must be devised to assess the performance of a policy, including effectivity, adequacy, equity, responsivity, and accuracy [8, 9].
There are several planning documents according to hierarchies and stages of the year in regional development planning; at the regional level, there is a Regional Long-Term Development Plan for 20 years, a Regional Medium-Term Development Plan for 5 years, and a Regional Development Work Plan for 1 year; and at the regional government organizational unit level, there is a Strategic Plan for Regional Apparatus Work Units for 5 years and a Regional Work Units Strategic Plan for 5 years.
It is vital to measure the success of governmental policies and initiatives in order to evaluate them (effectiveness, efficiency, adequacy, equity, responsiveness, and accuracy). In the meanwhile, measuring the success of the Equity indicator is challenging due to the fact that the budget for programs and activities is not the same. The innovations offered in this study are North Sumatra Province Development Priorities such as (a) improving the quality and fulfillment of access to education; (b) improving the degree of public health; (c) increasing employment and business opportunities through provision jobs; (d) Increased competitiveness through the agricultural sector; (e) increasing competitiveness through the tourism sector; (f) improving the quality of bureaucratic reform; (g) social and sports improvement; and (h) good and environmentally sound infrastructure development. So, this study attempts to explore the measurement model of the development of North Sumatra province, Indonesia.
The research method employed in this study is a mixed-method of qualitative and quantitative, using a dominant-less dominant design paradigm, as explained below. The qualitative approach analysis occurs concurrently with the data collection process and includes steps such as data reduction, data presentation, and conclusion drawing [10]. While the quantitative approach is used to analyze variables expressed by the distribution of frequencies, both in absolute numbers and the distribution of frequencies and percentages, where the processed data will be observed to find the tendency and then analyzed according to scientific knowledge and facts in the field [11]. North Sumatra Province was the location of this study.
In data collection, questionnaires containing closed and semi-closed questions were used. This is used to collect data from the community. From the number of research samples, namely 100 people, the researchers divided the clusters based on the geographical conditions of the east coast, west coast and mountainous areas. Meanwhile, for qualitative data, interview was done to support quantitative data.
The practice of assessing the performance of local government administration is known as regional development performance evaluation. Performance information will be provided as a result of the performance evaluation of development implementation, which may be utilized as input for the planning and budgeting process, aided by the availability of more precise information and data. As a result, the development program becomes more efficient and effective, and its implementation is held to a higher standard. At all levels of development implementers, the success of reaching targets will be monitored using performance indicators that have been properly set in advance. According to William N. Dunn, a program or public policy must have a criterion that can be used to assess its performance. Several indicators, such as effectiveness, adequacy, equity, responsiveness, and accuracy, must be devised to assess the success of a policy [8, 12].
3.1 Dimensions of effectivity in the regional apparatus work plan of North Sumatra Province 2019
According to Winarno [5], the term “effectivity” comes from the word “effective,” which denotes “success” in achieving objectives that have been assigned. Usability is another term for effectiveness. The link between expected and actual results is always a factor in determining effectiveness. According to the previous viewpoint, the more the goals of the organization are achieved, the more effective the organization will be. As a result of this understanding, it may be concluded that the higher the organization aims, the greater the results to be obtained from these goals. If the impact of public policy activities is not able to solve the problems that the community is facing, then the policy action is considered to have failed. However, sometimes the consequences of public policy are not instantly effective in the short term, but only after going through a particular process.
Table 1. The realization of the advanced, safe, and dignified Vision of North Sumatra
Details |
Frequency |
Percentage |
Very Good |
12 |
12,00% |
Good |
24 |
24,00% |
Normal |
32 |
32,00% |
Bad |
22 |
22,00% |
Very Bad |
10 |
10,00% |
Total |
100 |
100% |
Table 2. Completing mission 1: Creating a dignified North Sumatran society in life
Details |
Frequency |
Percentage |
Very Good |
8 |
8,00% |
Good |
24 |
24,00% |
Normal |
32 |
32,00% |
Bad |
24 |
24,00% |
Very Bad |
12 |
12,00% |
Total |
100 |
100% |
The larger the contribution of the output to the attainment of goals, the more effective the organization, program, or activity is. When it comes to determining the effectiveness of a company, it can be defined as the amount to which it is able to meet its objectives on time in carrying out primary activities, such as product quality and development. The ability of messages to persuade or the strength of messages to affect is referred to as effectivity. In relation to the foregoing, the measure of effectivity is a standard that will be met in terms of the aims and objectives to be met. Furthermore, it demonstrates how well the organization, program, or activity performs its functions [13]. It can be seen from the response of the community to the effectiveness of development planning in North Sumatra may be observed in the achievement of numerous targets/targets based on the result of questionnaires as presented in Table 1, Table 2, Table 3, and Table 4.
Table 3. Completing mission 2: Creating a dignified North Sumatran society in politics
Details |
Frequency |
Percentage |
Very Good |
9 |
9,00% |
Good |
26 |
25, 00% |
Normal |
30 |
30,00% |
Bad |
23 |
23,00% |
Very Bad |
12 |
12,00% |
Total |
100 |
100% |
Table 4. Completing mission 3: Creating a dignified North Sumatran Society in education
Details |
Frequency |
Percentage |
Very Good |
7 |
7,00% |
Good |
21 |
21,00% |
Normal |
34 |
34, 00% |
Bad |
23 |
23,00% |
Very Bad |
12 |
12,00% |
Total |
100 |
100% |
3.2 Dimensions of efficiency in the regional apparatus work plan of North Sumatra Province 2019
Winarno [5] defines efficiency as the amount of work required to achieve a specific degree of effectiveness. Efficiency, which is a synonym for economic rationality, is the relationship between efficacy and effort, which is typically quantified in monetary terms. The unit cost of a product or service is typically used to measure efficiency. Efficient policies are those that achieve the most efficacy at the lowest expense. If the goals of a public policy are straightforward, but the expenses of implementing it are excessively high in comparison to the results obtained, policy efforts have been wasteful and are not possible to implement [14]. The public’s assessment of the efficiency of development planning in North Sumatra can be seen in Table 5, and Table 6.
Table 5. Efficiency of the regional revenues and expenditures budget preparation
Details |
Frequency |
Percentage |
Very Good |
7 |
7,00% |
Good |
20 |
20,00% |
Normal |
35 |
35,00% |
Bad |
24 |
24,00% |
Very Bad |
11 |
11,00% |
Total |
100 |
100% |
Table 6. Efficiency of the regional revenues and expenditures budget use
Details |
Frequency |
Percentage |
Very Good |
8 |
8,00% |
Good |
23 |
23,00% |
Normal |
33 |
33,00% |
Bad |
21 |
21,00% |
Very Bad |
13 |
13,00% |
Total |
100 |
100% |
3.3 Dimensions of adequacy in the regional apparatus work plan of North Sumatra Province 2019
According to Winarno [5], adequacy in public policy means that the goals attained have been deemed adequate in various ways. The degree to which a level of effectiveness satisfies a need, value, or opportunity that causes a problem is referred to as adequacy. Adequacy is still linked to effectiveness since it measures or predicts how well existing alternatives can meet needs, values, or opportunities in the context of resolving problems. These numerous problems are problems that arise as a result of a policy, allowing the problem to be classified into one of these categories. This means that before a policy product is ratified and implemented, an assessment of the method compatibility for achieving the goal, whether the method is correct or violates the rules, and whether the method is technically correct must be conducted. The result of the questionnaire is presented in Table 7.
Table 7. The fulfilment of community needs in development planning in North Sumatra
Details |
Frequency |
Percentage |
Very Good |
8 |
8,00 % |
Good |
23 |
23,00 % |
Normal |
33 |
33,00 % |
Bad |
21 |
21,00 % |
Very Bad |
13 |
13,00 % |
Total |
100 |
100% |
3.4 Dimensions of equity in the regional apparatus work plan of North Sumatra Province 2019
According to Winarno [5], equity in public policy has meaning when justice is served and the goals of public policy are met. The equity criteria are strongly tied to legal and social rationality, and it refers to how outcomes and efforts are distributed among different groups in society. An equalization-oriented policy is a policy in which the outcomes or effort are divided equitably. If the expenses and benefits are distributed equitably, a program may be successful, efficient, and sufficient. According to Winarno [5], there are numerous techniques to determine how far a policy may maximize social welfare, including:
The result of the questionnaire for this category is presented in Table 8.
Table 8. Equity aspects in the regional apparatus work plan of North Sumatra province
Details |
Frequency |
Percentage |
Very Good |
8 |
8,00 % |
Good |
24 |
24,00 % |
Normal |
32 |
32,00 % |
Bad |
24 |
24,00 % |
Very Bad |
12 |
12,00 % |
Total |
100 |
100% |
3.5 Dimensions of responsiveness in the regional apparatus work plan of North Sumatra Province 2019
Winarno [5] defines responsiveness in public policy as a reaction to an activity. This refers to how public policy targets react to a policy execution. The degree to which a policy can satisfy the needs, preferences, or values of specific community groups is referred to as responsiveness. The public response to the policy execution after first predicting the impact that will occur if the policy is executed, as well as the community response after the policy impact has begun to be felt in the form of support/refusal, can both be seen as indicators of the success of a policy.
The responsivity criterion is significant because even if an analysis meets all other criteria (effectivity, efficiency, adequacy, and equity), it will still fail if it does not address the actual needs of the groups who should benefit from the policy. As a result, the responsivity criteria are a true portrayal of particular group needs, preferences, and values in comparison to the effectivity, efficiency, adequacy, and equity criteria. The result can be seen Table 9.
Table 9. Responsiveness in the regional apparatus work plan of North Sumatra province
Details |
Frequency |
Percentage |
Very Good |
8 |
8,00 % |
Good |
24 |
24,00 % |
Normal |
30 |
30,00 % |
Bad |
24 |
24,00 % |
Very Bad |
12 |
12,00 % |
Total |
100 |
100% |
3.6 Dimensions of accuracy in the regional apparatus work plan of North Sumatra Province 2019
According to Winarno [5], accuracy refers to the worth or cost of the program objectives as well as the strength of the assumptions that underpin them. The criteria used to pick a number of alternatives to be utilized as recommendations by determining if the recommended alternative results are a feasible goal choice. Because eligibility criteria are concerned with the substance of the aim rather than the means or instruments to achieve that goal, they are related to substantive rationality. Based on the definition above, evaluation of the impact of the policy referred to in this study refers to an assessment of the implementation of policies that have been implemented by the organization or government, by evaluating aspects of the impact of policies such as effectiveness, efficiency, adequacy, equity, responsiveness, and the accuracy of the policy implementation from the perspective of the community as the target of the policy. The following factors can be used to gauge public opinion about the accuracy of development planning in North Sumatra as seen in Table 10, and Table 11.
Table 10. Accuracy in the regional apparatus work plan towards the development target of North Sumatra province
Details |
Frequency |
Percentage |
Very Good |
8 |
8,00 % |
Good |
23 |
23,00 % |
Normal |
31 |
31,00 % |
Bad |
26 |
26,00 % |
Very Bad |
10 |
10,00 % |
Total |
100 |
100% |
Table 11. The benefits of the development to the community in North Sumatra
Details |
Frequency |
Percentage |
Very Good |
8 |
8,00 % |
Good |
24 |
24,00 % |
Normal |
32 |
32,00 % |
Bad |
24 |
24,00 % |
Very Bad |
12 |
12,00 % |
Total |
100 |
100% |
3.7 Development planning evaluation model in North Sumatra
The goal of evaluating the outcomes of regional development plans is to ensure that they are in line with stated performance indicators. The performance indicators in question are those calculated at the national, provincial, and district/city levels. The results of this evaluation will then be used as feedback for the formulation of Governor/Regent/Mayor policies in realizing consistency between policies and implementation and results of regional development plans in the Provinces, regencies/municipalities; Consistency between the Regency/Municipal Government Work Plans and the Provincial and Regency/Municipal Medium-Term Development Plans; and Conformity between regional development achievements and performance indicators that have been determined at the national, provincial, and district/city levels [15].
The gradation of the value (intensity scale) of the performance of an indicator in the performance assessment through the evaluation of the planning results can be interpreted into several results, including; first, Very Good and Good results, where this gradation indicates that the achievement/realization of the performance achievement has met the target and is above the minimum requirement for passing the performance appraisal. Second, Average result, in which the grading is adequate to demonstrate achievement/realization of the performance that meets the minimum requirements. Third, there are Bad and Very Bad results, which indicate that the achievement/realization of performance has not met/is still falling short of the minimum standards for reaching the desired performance.
Based on the regulation of the Minister of Home Affairs of the Republic of Indonesia Number 86 of 2017 concerning Planning Procedures, Regional Development Control and Evaluation, Procedure for Evaluation of Draft Regional Regulations on Regional Long-Term Development Plans and Regional Medium-Term Development Plans, as well as Procedures for Amending Regional Long Term Development Plans, Regional Medium Term Development Plans, and Regional Government Work Plans. Article 262 paragraph (1) states that the Head of the Provincial Government Planning Agency shall evaluate the results of the Provincial Government Work Plan; paragraph (3) states that the results of the evaluation of the provincial government’s work plan are used as material for the preparation of the provincial government’s work plan for the following year; Paragraph (4) states that the Head of the Provincial Development Planning Agency reports the evaluation of the results of the Provincial Government Work Plan to the Governor. Furthermore, in paragraph (5) it is stated that the Governor submits the report as referred to in paragraph (3) to the Minister.
3.8 Legal basis for implementation of local government work plan evaluation
The following are the provisions relating to the obligation to conduct development evaluations on the North Sumatra Provincial Government Work Plan implementation:
- Article 262 paragraph (1) states that the Head of the Provincial Development Planning Agency conducts an evaluation of the results of the Provincial Regional Development Work Plan; paragraph (3) it is stated that the results of the evaluation of the provincial Regional Development Work Plan are used as material for the preparation of the provincial Regional Development Work Plan for the following year; Paragraph (4) states that the Head of the Provincial Development Planning Agency reports the evaluation of the results of the Provincial Regional Development Work Plan to the Governor. Furthermore, in paragraph (5) it is stated that the Governor submits the report as referred to in paragraph (3) to the Minister.
3.9 The evaluation objectives of development planning in North Sumatra
The purpose of evaluating development planning in North Sumatra is mapping the conditions of development achievement as reflected in the achievement of the annual development targets of the North Sumatra Province, assessing the achievement of development indicators and targets in each Regional Apparatus Organization of North Sumatra Province, evaluating the Implementation of the North Sumatra Province Annual Development Planning to assess the achievement of targets and the realization of the development performance of the Province of North Sumatra through priority programs/activities set out in the 2019 North Sumatra Province Regional Development Work Plan, strengthening the role of evaluation as a reference material for carrying out regional annual development planning in the next period, as well as providing strategic direction for all Regional Apparatus Organizations of North Sumatra Province in achieving the vision and mission of the Regional Head of North Sumatra Province.
Based on the data, it can be concluded that the purpose of evaluating the results of regional development plans is to ensure that regional development achievements are in line with established performance indicators. The performance indicators in question are those set at the national, provincial, and district/city levels. The regional apparatus planning agency of North Sumatra Province has only used budget realization as a metric for evaluating development planning thus far. Due to a lack of supporting data and qualified human resources in each regional apparatus organization, researchers discovered that regional apparatus organizations have trouble determining program and activity performance indicators. Several indicators, such as effectivity, adequacy, equity, responsivity, and accuracy must be developed in order to evaluate the success of a policy. In general, the inhabitants of North Sumatra believe that the development planning performance targets in their province are still low and have had little impact on the community welfare.
In today's society, "public management" is the most crucial element. An advanced society with sustainable science and technology has successfully handled social life as a whole. Likewise, community-based governance and policy. Because the public is increasingly aware of the technology developed, which automatically influences citizen engagement and influences local and national decision-making, government authorities will need to be more transparent in today's society. It will be more efficient and convenient for them to use the tax rights they pay to the government if the public is involved in the control and evaluation of government policy programs, such as the regional government work plan in North Sumatra province. Hence, material that has been digitalized and made widely accessible to the general population will bring open government.
Based on the result, it is suggested for further research to explore how to increasing the State Civil Apparatus Resources in a sustainable manner to support the success of implemented programs/activities in North Sumatra.
We would like to thank to Universitas Sumatera Utara for the research grant to conduct this research.
[1] Sukartawi. (1990). Teori ekonomi produksi dengan pokok bahasan analisis fungsi Cobb-Douglas. Rajawali.
[2] Muluk, K. (2009). Desentralisasi Pemerintah dan Daerah. Malang: Bayumedia Publishing.
[3] David, F.R. (2004). Manajemen Strategis :Konsep-Konsep. 9th ed. Jakarta: PT Indeks.
[4] Fujita, N. (2007). Myrdal’s theory of cumulative causation. Evolutionary and Institutional Economics Review, 3: 275-284. https://doi.org/10.14441/eier.3.275
[5] Winarno, B. (2002). Kebijakan Publik. Teori, Proses dan Studi Kasus. Yogyakarta: CAPS.
[6] Suharto, E. (2005). Membangun masyarakat memberdayakan rakyat. Bandung: Refika Aditama.
[7] Nugroho, R. (2003). Kebijakan publik formulasi, implementasi, evaluasi. Jakarta: PT. Elex Media Komputindo Kelompok Gramedia.
[8] Subarsono, A. (2003). Analisis Kebijakan Publik. Yogyakarta: MAP-UGM.
[9] Dye, T.R. (1992). Understanding Public Policy. USA: Prentice-Hall, INC., Englewood Cliffs, NJ.
[10] Moleong, L.J. (2009). Metode Penelitian Kualitatif. Bandung: PT. Remaja Rosdakarya.
[11] Sevilla, C.G., Ochave, J.A., Punsalan, T.G., Regala, B.P., Uriarte, G.G. (2007). Research Methods. Manila: Rex Printing Company. Quezon City.
[12] Dwijowijoto, R.N. (2003). Kebijakan Publik Formulasi, Implementasi dan Evaluasi. Jakarta: PT. Elex Media Komputindo.
[13] Wambeke, A.V., Forbes, T.R. (1986). Guidelines for Using ‘Soil Taxonomy’ in The Names of Soil Map Units. Soil Conserv. Serv. USDA, 10.
[14] Todaro, M.P. (1983). Pembangunan Ekonomi di Dunia Ketiga, terjemahan Drs. Mursid, Penerbit Balai Aksara Jakarta.
[15] Tjokrowinoto. (1996). Manajemen Kepegawaian. Jakarta: Ghalia Indonesia.