Week+6+Application

From the week 6 application assignment, we have to do the following: For this week’s Application, you will conduct two unstructured interviews as part of a program evaluation and then write a short report of your findings. The program being considered is this graduate program in Instructional Design and Technology (IDT). You are required to interview two fellow students separately.

The objective of the interviews is to get their explanation for what they consider to be the most appropriate and effective data collection strategies for evaluating this IDT program. Following are questions you might include in your interview: Use the following codes by clicking on the T (with the color palette) to change colors (feel free to change the color selections to your liking; this is done to get us started): Sanjay S. - Blue Terri W. - Purple Terri T. - Red Nanett S. - Green The purposes of the program evaluation for the IDT program are to determine the quality level of the program and impact of the program in terms of the ability of students to apply said knowledge in the real-world. According to the Sloan Consortium Quality Framework and the Five Pillars (Moore, 2009), five areas that can lead to a better quality program for higher education are: learning effectiveness, cost effectiveness and institutional commitment, access, faculty (employee) satisfaction, student (customer) satisfaction. There should also be some type of demonstration/project that students have to produce based on their knowledge learned in class and whether those projects meet the expectations of adopted standards.
 * If you have more questions, feel free to type it in using your color code. To answer, use your color code.
 * What should the purpose(s) of a program evaluation of this IDT program be? Explain the choice of focus. What might be some of the corresponding evaluation questions?

Resources Moore J.C. (2009). The Sloan Consortium quality framework and the five pillars. The Sloan Consortium. Retrieved from [].

Most effective data collection: from students: an end of class survey to gauge student satisfaction. A compilation of student projects that has been evaluated to meet or exceed adopted standards. from faculty: face-to-face survey to determine strengths and weaknesses of the class being offered and recommendations to change/improve.
 * Based on that, what would be the most effective data collection design, sampling strategy, sources, and methods?

Stakeholders and their interests
 * Who do they consider to be the stakeholders in this program evaluation, and what would their interests be?
 * students || to learn applicable skills to be competitive in a job environment. Receiving a master's degree to improve their hiring ability. Increase in pay. ||
 * faculty || a good program would lead to tenure of teachers. ||
 * dean || A quality program would produce a greater ROI and cause more students to join the program. ||
 * community ||  ||
 * business employing IDT graduates || prepared students would require less training to function as an IDT that will ultimately reduce job costs. ||

Write a 1- to 2-page report that includes the following sections: > I. Summary of Interview Findings: Summarize the data you collected from the interviewsII. Reflection on the Interview Process: Describe your thoughts on the process of carrying out the interviews:
 * How did the experience of conducting each interview differ?
 * What did you learn about the process of conducting an interview?

1. Who do you consider to be the primary stakeholders in the ITD Program? What are the interests of these stakeholders? 2. Do you feel there are any minor stakeholders in the ITD Program? If so what are their interest in the program. 3. What would be your main purpose for conducting an evaluation of this program? 4. Based on the purpose of your evaluation what evaluation method would you use? 5. Provide at least 3 questions you would use in the evaluation. 6. What sources would you use for the evaluation? 7. What would be your sampling strategy? 8. What do you consider the most effective and appropriate way to collect your data?
 * Students- guaranteed and viable curriculum, real world tasks, feel prepared for an ID position, degree from an accredited institution
 * Faculty- ability to offer quality education, interaction with students
 * School Personal- continue to have successful grads, meet student needs, improve the reputation of the school
 * Student family members- their family member getting a proper education so they can reap the benefits of the job the grad gets after completing the program
 * Businesses hiring IDT Grads- knowing that grads will be qualified and knowledgeable in the ID process and theories
 * Quality of the education
 * Are students able to obtain a position after graduation
 * Student and faculty satisfaction
 * Theories Based Evaluation / Participant Oriented
 * Do you feel the course assignment prepared you for real world ID tasks? Where there any you feel were not relevant to an ID position? (could be reworded to work as a question to faculty as well)
 * Are the course resources helpful and up to date? Have there been any issues with errors?
 * Do you feel the course delivery format allows for enough interaction between students and professors?
 * Faculty / Staff
 * Students: current and former
 * Student Data
 * ID companies
 * Student / Faculty / Staff: random
 * ID Companies: research which have hired Walden grads and choose random companies to participate
 * Surveys
 * Face-to-face interviews
 * Student data: graduation rates, GPA, jobs secured after graduation
 * Research which companies would hire a Walden grad over a grad from other schools


 * 1) Who do you consider to be the primary stakeholders in the ITD Program? What are the interests of these stakeholders?

Students– being provided a quality education that enables them to be a successful member of society

Faculty – contributing to the success of their students and providing appropriate and timely interaction with their students

College of Education – provide a quality master program that enables students to obtain a job in their field of study.

2. Do you feel there are any minor stakeholders in the ITD Program? If so what are their interest in the program.

Walden University – providing students with a quality college of education

3. What would be your main purpose for conducting an evaluation of this program?

To ensure the program is meeting the objectives outlined in the program and that the students believe it to be a beneficial program that promotes an understanding of the program.

4. Based on the purpose of your evaluation what evaluation method would you use?

If I were conducting this evaluation I would use a mixed method of evaluation consisting of the Objectives and Participant Method. In an objectives based evaluation the activities are specified and the evaluation focuses on the events to which those purposes or job objectives are achieved. An Objectives based approach is simple and easy to use because you are looking at objectives of the program. So it is easy to determine success or failure. This type of evaluation also provides a good foundation to build a program on. The Participant method of evaluation uses stakeholders to assist in conducting the evaluation.

5. What sources would you use for the evaluation?

Students - I would use a variety of online surveys to collect data. First I would survey the students before starting the course to see what the expectations of the classes are, then after each class I would do a survey to see if the course met the student expectations. Then I would end with an exit survey to get an understanding of the entire program.

Faculty – online survey that covers all aspects of the class from curriculum to technical aspects.

6, What would be your sampling strategy?

I would have some fixed surveys and some random survey.

7. What do you consider the most effective and appropriate way to collect your data?

Mixture of online and face-to-face. The online provides privacy for some questions and face-to-face provides the evaluator the opportunity to see the facial expressions during the questions.

Terri Williams

I would consider the chair of the department, the Dean, the professors, student, and student body all to be the primary stakeholders What are the interests of these stakeholders? As a stakeholder I would be interest in how the program is structured what the program offers, how long does it take to complete the program, as a student. As a professor I would be interesting in knowing what I need to teach to prepare the students for companies and organizations so they, the students will have the knowledge, skills, and ability if not the experience to be able to go out and apply for a job with what they take away from this program.
 * 1. Who do you consider to be the primary stakeholders in the ITD Program? **

If so what are their interest in the program. I think all stakeholders in this program are major – in different ways. Maybe the student advisor could be a minor stakeholder -- give the students advice if the students have questions about the program. Maybe the financial aid office also and that person could advise the student what could happen if the course is dropped, failing, or audited. I think that anyone who has knowledge about the program is a stakeholder or anyone who is interested in the program is a stakeholder.
 * 2. Do you feel there are any minor stakeholders in the ITD Program? **

I would want to know what or if there are any issues. What improvements need to be made? Checking to see if the same issues are coming in each semester. Are the professors doing their job based on the comments from the students? Are there any problems with any of the services that are offered (ex. Writing center, library, IT, etc.). I would like to know if this program is comparable with other universities/colleges, is it transferable.
 * 3. What would be your main purpose for conducting an evaluation of this program? **

There are a number of evaluation methods that could be used but for me I would use the Consumer-oriented approach and the objectives-oriented evaluation approach. If I'm not getting the results I am looking for I would later use Mixed methods and Triangulation would be a method I would consider using.
 * 4. Based on the purpose of your evaluation what evaluation method would you use? **

Would you recommend this program? Was the professor knowledgeable about the course and the course materials? Did this program help you to advance in your career?
 * 5. Provide at least 3 questions you would use in the evaluation. **

Online questionnaire, electronic survey, unstructured observations, and maybe telephone survey or interview
 * 6. What sources would you use for the evaluation? **

Stakeholders, including students and professors. The professors would be randomly selected and it wouldn’t be every semester and the questions would change.
 * 7. What would be your sampling strategy? **

Observation, online evaluation using the numbering scale from 1-10 1 being negative and 10 being positive.
 * 8. What do you consider the most effective and appropriate way to collect your data? **