How To Measure Program Implementation

Abstract: A major task of the program evaluator is to describe how a program looks in operation and whether implementation in practice matches what was planned. Few evaluation reports describe sufficiently those program processes which allow participants to achieve objectives. Skills for describing program implementation and designing measurement instruments for support of such descriptions are presented in this 4th volume of a series on program evaluation. Components of the detailed implementation report include the context and characteristics of the program (setting and participants) and program materials and activities. Data collection methods measuring program implementation involve the use of existing measures or the construction of new ones. Hints on sampling strategies, data summary and analysis, record-keeping, observation systems, and self-reports are given. A final chapter discusses the reliability and validity of implementation measures, factors indicative of their quality.