Addressing Multilevel Program Complexity by Evaluation Design

Sager, Fritz; Mavrot, Céline; Hadorn, Susanne (2015). Addressing Multilevel Program Complexity by Evaluation Design. European Policy Analysis, 1(2), pp. 90-110. Policy Studies Organization 10.18278/epa.1.2.5

Preview

Text Sager Mavrot Hadorn european-policy-analysis-volume-1-number-2-fall-2015 pp90-110.pdf - Published Version Available under License Publisher holds Copyright. Download (210kB) | Preview

In this paper, we present the evaluation design for a complex multilevel program recently introduced in Switzerland. The evaluation embraces the federal level, the cantonal program level, and the project level where target groups are directly addressed. We employ Pawson and Tilley’s realist evaluation approach, in order to do justice to the varying context factors that impact the cantonal programs leading to varying effectiveness of the implemented activities. The application of the model to the canton of Uri shows that the numerous vertical and horizontal relations play a crucial role for the program’s effectiveness. As a general learning for the evaluation of complex programs, we state that there is a need to consider all affected levels of a program and that no monocausal effects can be singled out in programs where multiple interventions address the same problem. Moreover, considering all affected levels of a program can mean going beyond the borders of the actual program organization and including factors that do not directly interfere with the policy delivery as such. In particular, we found that the relationship between the cantonal and the federal level was a crucial organizational factor influencing the effectiveness of the cantonal program.

Interest & Impact

Downloads

633 since deposited on 02 Nov 2015
190 in the past 12 months

Citations

5 Citations in Web of Science ®
6 Citations in Scopus

Search

in Google Scholar™

Services

Actions (login required)

Edit item

Actions (login required)

Edit item