Planning

Lesson: Planning a Validation Study

Learning Objective: At the end of the lesson, you will be able to plan a validation study by providing key milestones and a scheme of manoeuvres.

Learner Directions: The learner is required to complete the following:

  1. You need to read through the material below and you should read CFITES Volume 8 – Validation of Instructional Programs (p. 6-10).
  2. After you have completed the readings, you will post a blog with your completed Validation Plan and reflection.

Materials Required:

  1. CFITES Volume 8 – Validation of Instructional Programs
  2. Course Website
  3. WordPress Blog Site
  4. Validation Plan Template

References: 

  1. CFITES Volume 8 – Validation of Instructional Programs

————————————————————————————————-

The Lesson: Planning a Validation Study

Planning a validation is something that should be taken seriously. The better the plan, the better the end result. When planning a validation, all aspects of the validation need to be considered.

A key resource in the planning of a validation is the stakeholder. Early in the process, you want to establish a relationship with the stakeholder. Stakeholder buy-in is a requirement for a successful Validation. When you are planning a validation, the first step will be to conduct your Stakeholder(s). The relationship with a stakeholder could be difficult to establish. A successful relationship and liaison will be a benefit to the validation process.

Deciding on the Type of Validation

The scope of each validation should be determined through prioritization. Within a phased assessment approach, the scope is largely determined by selecting one of the following types of validation for each program.

Routine check. This type of validation serves as a dashboard gauge which permits ongoing monitoring of an instructional program. In order to achieve simplicity and rapid response time, a routine check reviews only major elements of the course or job, using information or statistical data which is relatively easy to obtain. The possible outcomes of a routine check are:

  1. Moderate assurance that the program is generally effective and efficient; or
  2. Identification of problems and recommendations for solutions where there is sufficient data; or
  3. Identification of problems and recommendation for more extensive review where data is inconclusive.

Comprehensive review. A thorough, in-depth assessment, the comprehensive review examines all important course-job links, sampling extensively from multiple sources. This type of validation requires substantially more time and effort than a routine check. A comprehensive review should be conducted periodically for all IT&E programs, or when a routine check indicates problems which cannot be resolved immediately. This type of validation results in:

  1. Confirmation of the effectiveness and efficiency of the program; or
  2. Identification of deficiencies and recommendations for improvements.

Focused review. This type of validation is a purpose-built study which concentrates on specific aspects of an instructional program. It is used when a routine check indicates that there may be problems but yields insufficient data to define and resolve them. The time and effort required for a focused review will depend on the number and type of factors to be assessed. Like the comprehensive review, the focused review samples extensively and obtains feedback from several sources. However, it targets specific factors such as selected objectives or job tasks.

Each Validation Plan will be different as each study will have some unique elements to it. It is important to spend the time preparing a strong plan as it will ensure a better end product.

Activity: Read CFITES Volume 8 (p. 6-10). You will be required to develop a blog post about the planning of a validation study.

Use the following guided questions to assist in your post:

  1. Why should you take a strategic approach when planning a validation study?
  2. Why is the relationship with the stakeholder an important element of a validation plan?
  3. When would you use each type of study? Explain why.

Assessment (formative): Planning a validation is an important element to the success of a validation study. You will be required to choose a training program to use for the planning of a validation (ex. The Driver Wheel program). Use the following template to create your plan. Post your plan to your blog and explain the successes and challenges of the planning process.

  1. Validation Plan Template