Lesson: Interpreting Survey Data

Learning Objective: At the end of the lesson, you will interpret validation study data by providing a thorough analysis of the findings and developing interpretations.

Learner Directions: The learner is required to complete the following:

1. You need to read through the material below and you should read CFITES Volume 8 – Validation of Instructional Programs (p. 15-22).
2. After you have completed the readings, you will post a blog with your completed Findings, Interpretations, and Recommendations Chart.

Materials Required:

1. CFITES Volume 8 – Validation of Instructional Programs
2. Course Website
3. WordPress Blog Site
4. Findings, Interpretations, and Recommendations Chart
5. Findings, Interpretations, and Recommendations Chart Example
6. Scenario Survey Data

References: 

1. CFITES Volume 8 – Validation of Instructional Programs

————————————————————————————————-

The Lesson: Interpreting Survey Data

Data analysis can be a time-consuming activity. The analysis of data should be organized in order to assist in defining the findings, interpretations. When you have completed those two steps, you can thing develop recommendations based on your interpretation of the data.

To help identify trends in attitudes or opinions, similar qualitative responses to open-ended questions can often be grouped into trends and similar answer groups.

Data Quality

Before data can be analyzed, consideration must be given to accuracy. Validation data is largely based on the respondent’s opinions. The quality of data must be evaluated in term of its credibility.

Analyze Data

There are two basic approaches to analyzing data that we referred to earlier; Qualitative and Quantitative. The qualitative approach is used when you are dealing with the results of open-ended questions. The quantitative approach is used when you are dealing with data that has a numerical value, i.e. can be measured as a “quantity”.

Identifying Issues

When problems are identified, you must then determine possible causes before recommending solutions.

Issue Causes

Any number of causes may contribute to unsatisfactory validation findings. Once the potential causes of problems have been identified, stakeholders should be contacted to confirm the interpretation.

Developing Recommendations

The last step in the analysis of validation data is creating recommendations to issues that have been identified that will improve the effectiveness and efficiency of the instructional program.

If issues and their causes have been clearly defined, it should be relatively easy to develop solutions. All recommendations should be completed with the consultation of the stakeholder. If the stakeholder is included in the recommendation process, it is more likely that the recommendations will be implemented.

About the Findings, Interpretations, and Recommendations (FIR) Chart

The Purpose of the FIR Document is to capture the Findings of a Validation Study, determine the Interpretations of a Validation Study and to develop the Recommendations.

 This FIR document shall capture:

1. Findings– Statements of fact derived from the data that has been collected during the validation study. These findings shall be determined by the Validation Study Team and shared with the stakeholders to seek their interpretation and recommendations.
2. Interpretation– From those findings, an identification of any area of excellence and/or area for improvement. An area for improvement shall identify the specific problem area, its cause(s) and solution(s).
3. Recommendations– Solutions from the Interpretation framed such that they emphasize necessary changes to a Training programme that will impact major improvements in operational effectiveness, resource savings or safety. Recommendations should be supported with a brief description of the expected impact. Consideration must be given to the effort to implement the recommendations. The potential benefits of the changes must outweigh the cost of making them. A recommendation may simply be for a further comprehensive or focused study.

INSTRUCTIONS FOR USE

Follow the steps below when complete the FIR Chart

1. Complete the findings section of the FIR document.
2. Share the findings with the Stakeholders.
3. Consult with the Stakeholders to complete the interpretation section of the FIR Document.
4. Consult with the Stakeholder to complete the recommendations section of the FIR Document.

Activity: Read CFITES Volume 8 (p. 15-22). You will be required to develop a blog post about interpreting survey data.

Use the following guided questions to assist in your post:

1. What are some challenges you expect to encounter when analyzing data? Explain
2. What are some additional resources you can contact to assist in the interpretation and recommendation stages? Explain

Assessment (formative): Analyzing data is a difficult task. Organizing data by using the Findings, Interpretations, and Recommendations Chart allows for like data to be grouped. The use of the chart can assist in the development of trends too.

You will be required to develop a completed Findings, Interpretations, and Recommendations Chart using a set of scenario survey data (your stakeholder will be another student from the course – you will be paired up by the instructor). Post your chart to your blog and explain the successes and challenges.

1. Findings, Interpretations, and Recommendations Chart
2. Findings, Interpretations, and Recommendations Chart Example
3. Scenario Survey Data