Chapters 6 & 7

Summary: In Chapter 6 of Chuck Hodell's book he discusses the implementation phase of the ISD process. Hodel says that the evaluation of the implementation processs must include an evaluation of the learner's impressions of the training and the validation of objectives being met by learners. He discussed Kirkpatrick's four levels of evaluation: Level 1, reaction; Level 2, learning; Level 3, behavior; and Level 4, results. Hodell says that the most accurate level 1 evaluation comes immediately after training. He added that the performance agreement goes a long way toward ensuring that objectives are correctly evaluated. He discussed the key elements of the performance agreement: behavior, condition, and degree.

Application: After reading this chapter, I realize that I should be doing more evaluations of my lessons and asking for student input immediately after each lesson.

Summary: In Chapter 7 of Chuck Hodell's book he discusses evaluation techniques for all five elements of the ADDIE model. Hodell recommends identifying each component of an objective. He also said that the designer should consider how difficult the objectives will be for the learner to meet and that usually you would begin with the easy objectives and work toward the more difficult. The author defined the performance agreement as the relationship between behavior and condition elements in objectives and evaluation tasks. Hodell said that posttraining evaluation is a level 3, behavior evaluation, and the most important question is -- did the training stick? Did the training transfer or did the behavior move to the workplace? He said that surveys and observation are ways to evaluate at this level. Hodell says that level 4 evaluation is about results. Did the training pay off? Were results accomplished?

Application: I was very interested in the level 3, behavior evaluation component. In my school we have conducted surveys to determine whether or not the training has transferred and students are actually using what they have learned in their subsequent classes. It is something that I think is very important and will continue to monitor.