Personal Information

Academic Vitae

Research Activities

Professional Activities

The Canadian Research Working Group on Evidence-based Practice in Career Development (CRWG) was formed in response to a challenge by Canadian policy makers to "show us the evidence." The basic argument was that policy makers believed the claims put forward by researchers and practitioners that career development services were successful, however, in order to provide the type of funding that was being requested, policy makers required evidence of the effectiveness of career services. One of the initial tasks of the CRWG was to develop a framework for evaluating career services that would provide a link between the changes that clients experienced and the services they received. The framework had to be comprehensive enough to cover all of the important factors and also simple enough that practitioners could use it. The initial framework was developed in 2006 and is summarized in:

Over the years, the framework has been updated to incorporate feedback from the field. A feedback loop was inserted to make explicit the formative evaluation (or Total quality services) function of the framework. Thus, if outcomes were not as expected, then the processes would be examined to make sure they had been followed as intended and if necessary the processes would be modified to make them form effective. Also, the resource base (Inputs) would be examined to see if additional resources were needed to facilitate the implementation of the processes designed to produce the desired outcomes. Then the graphic was redesigned to make it more explicit that the framework was not linear. Click here to see the resulting graphic (png file, 16 KB).

Feedback from the field indicated that many practitioners were having difficulty visualizing how intervention planning fit into the evaluation framework. To make this connection more explicit, the graphic was again redesigned to indicate the interface between intervention and evaluation. Click here to see the resulting graphic (jpg file, 712 KB).

Further feedback from government funders and agency managers suggested that important service delivery factors were not included in the evaluation framework. Even though such service delivery factors such as client flow and practitioner time use do not speak directly to client change, in many circles they are important variables to track. Therefore the graphic was again redesigned to make those factors explicit. Click here to see this version of the graphic showing the role of service delivery factors (jpg file, 984 KB).

Finally, the most recent version of the framework graphic makes more explicit how the nature of both intervention and evaluation are client centred. Click here for the most recent graphic (pdf file, 840 KB) or for editable format click here (MS Word file, 36 KB)