Addressing Multilevel Program Complexity by Evaluation Design

Sager, Fritz; Mavrot, Céline; Hadorn, Susanne (2015). Addressing Multilevel Program Complexity by Evaluation Design. European Policy Analysis, 1(2), pp. 90-110. Policy Studies Organization 10.18278/epa.1.2.5

[img]
Preview
Text
Sager Mavrot Hadorn european-policy-analysis-volume-1-number-2-fall-2015 pp90-110.pdf - Published Version
Available under License Publisher holds Copyright.

Download (210kB) | Preview

In this paper, we present the evaluation design for a complex multilevel program recently introduced in Switzerland. The evaluation embraces the federal level, the cantonal program level, and the project level where target groups are directly addressed. We employ Pawson and Tilley’s realist evaluation approach, in order to do justice to the varying context factors that impact the cantonal programs leading to varying effectiveness of the implemented activities. The application of the model to the canton of Uri shows that the numerous vertical and horizontal relations play a crucial role for the program’s effectiveness. As a general learning for the evaluation of complex programs, we state that there is a need to consider all affected levels of a program and that no monocausal effects can be singled out in programs where multiple interventions address the same problem. Moreover, considering all affected levels of a program can mean going beyond the borders of the actual program organization and including factors that do not directly interfere with the policy delivery as such. In particular, we found that the relationship between the cantonal and the federal level was a crucial organizational factor influencing the effectiveness of the cantonal program.

Item Type:

Journal Article (Original Article)

Division/Institute:

11 Centers of Competence > Center of Comptetence for Public Management (KPM)

UniBE Contributor:

Sager, Fritz; Mavrot, Céline and Hadorn, Susanne

Subjects:

300 Social sciences, sociology & anthropology > 320 Political science
300 Social sciences, sociology & anthropology > 350 Public administration & military science

ISSN:

2380-6567

Publisher:

Policy Studies Organization

Language:

English

Submitter:

Céline Mavrot

Date Deposited:

02 Nov 2015 10:50

Last Modified:

09 Sep 2017 07:13

Publisher DOI:

10.18278/epa.1.2.5

BORIS DOI:

10.7892/boris.72422

URI:

https://boris.unibe.ch/id/eprint/72422

Actions (login required)

Edit item Edit item
Provide Feedback