class: left, bottom, title-slide .title[ # Module 5: Work Analysis ] .subtitle[ ## EME5601: Introduction to Instructional Systems ] .author[ ### Dr. Bret Staudt Willet ] .date[ ### October 16, 2024 ] --- class: inverse, center, middle #
**View the slides:** [bretsw.com/eme5601-fs24-module5](https://bretsw.com/eme5601-fs24-module5) --- class: inverse, center, middle #
<br><br> Module 4 <br> Recap --- #
Needs Assessment Needs assessment is the **first step** in an iterative design cycle: <img src="img/Rothwell-fig2-1.png" width="480px" style="display: block; margin: auto;" /> <div class="caption"> Figure 2.1 from Rothwell et al. (2016, p. 20) <br><br> </div> --- class: inverse, center, middle #
<br><br> Gap = <br><br> [What is] - [What should be] --- #
Needs Assessment <img src="img/across-time.jpg" width="100%" style="display: block; margin: auto;" /> -- - Direct + Indirect Costs -- - Timeline + Labor --- #
Needs Assessment <img src="img/blooms-verbs.png" width="720px" style="display: block; margin: auto;" /> ### Writing Objectives - Use Bloom's Taxonomy action verbs ([worksheet](https://www.utica.edu/academic/Assessment/new/Blooms%20Taxonomy%20-%20Best.pdf)) --- #
Needs Assessment <img src="img/sample-size.png" width="400px" style="display: block; margin: auto;" /> ### Calculating Sample Size - Use a sample size [calculator](https://www.qualtrics.com/blog/calculating-sample-size/) --- class: inverse, center, middle #
<br><br> Module 5 <br> Work Analysis --- #
Work Analysis <img src="img/5-chef-work.png" width="720px" style="display: block; margin: auto;" /> ### What is the work of a chef? --- #
Work Analysis <img src="img/chef.jpg" width="720px" style="display: block; margin: auto;" /> ### What is the work of a chef? (I thought I wanted to be a chef.) --- #
Work Analysis <iframe width="100%" height="480" src="https://www.youtube.com/embed/AzQ3Xso7sLA?si=_E54zVnuzktJo5KP" title="YouTube video player" frameborder="0" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share" allowfullscreen></iframe> See: https://www.indeed.com/career-advice/career-development/task-analysis --- class: inverse, center, middle #
<br><br> Performing Work Analysis Rothwell & Kazanas, 2008 (Ch. 7) --- #
Work Analysis <img src="img/Rothwell+Kazanas-fig7-1.png" width="480px" style="display: block; margin: auto;" /> <div class="caption"> Figure 7.1from Rothwell & Kazanas (2008, p. 131) <br><br> </div> --- #
Work Analysis <img src="img/Rothwell+Kazanas-table7-2.png" width="640px" style="display: block; margin: auto;" /> <div class="caption"> Table 7.2 from Rothwell & Kazanas (2008, p. 149) <br><br> </div> -- <hr> ###
Discuss in groups... --- #
Work Analysis <img src="img/5-chef-work.png" width="600px" style="display: block; margin: auto;" /> -- - **Job Analysis:** systematic examination of what people do, how they do it, and what results they achieve by doing it -- - Clarifies work titles, responsibilities, activities, and entry qualifications --- #
Work Analysis <img src="img/5-chef-work.png" width="600px" style="display: block; margin: auto;" /> - **Task Analysis:** intensive examination of how people perform work activities -- - Clarifies competent performance; which activities might be simplified or improved; what workers must know, do, or feel to learn a specific activity, conditions needed for competent performance; minimum expectations (i.e., standards) --- #
Work Analysis <img src="img/5-chef-work.png" width="600px" style="display: block; margin: auto;" /> - **Content Analysis:** examination of knowledge, skills, and attitudes to identify instructionally useful units (subject matter analysis) -- - Clarifies which topics or ideas should be included or excluded in instruction as well as how to sequence topics in instruction --- #
Why Work Analysis? <img src="img/Rothwell+Kazanas-fig7-2.png" width="100%" style="display: block; margin: auto;" /> <div class="caption"> Figure 7.2 from Rothwell & Kazanas (2008, p. 152) <br><br> </div> -- - Create or update position descriptions -- - Develop relevant and useful training -- - Develop competency models --- class: inverse, center, middle #
<br><br> Job-Task Analysis: Which Way? Hahn et al., 1995 --- #
Job-Task Analysis <img src="img/chef-avant.png" width="420px" style="display: block; margin: auto;" /> -- **Traditional JTA** -- - Create task list -- - Interview those performing the work or their supervisors -- - Create questionnaire -- - Administer survey to all subject matter experts (both workers and supervisors) -- - Analyze frequency, difficulty, importance, and consequences of the task --- #
Job-Task Analysis <img src="img/chef-avant.png" width="420px" style="display: block; margin: auto;" /> **Tabletop (TTA)** -- - Facilitator guides a small team of experts during round-robin (i.e., tabletop) discussions to obtain information about a particular job -- - No prior task list -- - The team brainstorms and selects tasks for training using a qualitative approach -- - Sort into training categories based on frequency, difficulty, importance, and consequences --- #
Job-Task Analysis <img src="img/chef-avant.png" width="420px" style="display: block; margin: auto;" /> **Hybrid JTA** -- - Develop task list based on work-related materials -- - Workers and supervisors review and modify the task list during a facilitated roundtable discussion -- - Participants come to consensus decisions on task ratings -- - If time permits, iterate the process: participants review the task list independently after the group consensus, potentially soliciting the opinion of other experts --- #
Job-Task Analysis <img src="img/Hahn+et+al-fig1.png" width="100%" style="display: block; margin: auto;" /> <div class="caption"> Figure 1 from Hahn et al. (1995, p. 24) <br><br> </div> --- #
Job-Task Analysis <img src="img/Hahn+et+al-table1.png" width="100%" style="display: block; margin: auto;" /> <div class="caption"> Table 1 from Hahn et al. (1995, p. 27) <br><br> </div> --- class: inverse, center, middle #
<br><br> Review of Methods <br> to Identify the Critical Job-Tasks <br> Undertaken by <br> the Emergency Services Nevola et al., 2019 --- #
Identify Critical Job-Tasks <img src="img/ambulance.jpg" width="240px" style="display: block; margin: auto;" /> -- **Process of Job-Task Analysis:** -- - Stage 1: Establish the critical job-tasks (i.e. job- analysis) -- - Stage2: Determine the method of best practice for undertaking the critical job-tasks -- - Stage 3: Agree the criteria-for, and acceptable minimum level of, job-task performance -- - Stage 4: Determine the physical demands of the critical job-tasks -- - Stage 5: Determine a reasonable maximum permissible relative workload -- - Stage 6: Production of a valid minimum occupational fitness standard --- #
Identify Critical Job-Tasks <img src="img/ambulance.jpg" width="240px" style="display: block; margin: auto;" /> **Insights from the Job-Task Analysis for Emergency Services:** -- - Maintain robust and **accessible information** with which to describe their critical job-tasks -- - Adopt a consistent approach (i.e. international standardization) to the development of **performance standards** which accurately reflect the combination of competencies required to safely and successfully conduct critical job-tasks -- - Implement **employment standards** which incorporate the requirements of job-tasks that have been assessed to be critical to both present and likely future operational scenarios (e.g. informed by techniques such as wargaming). --- class: inverse, center, middle #
<br><br> Practice --- #
Job Analysis Practice <img src="img/painter.jpg" width="720px" style="display: block; margin: auto;" /> ###
Discuss in groups... **Describe your first job.** --- #
Task Analysis Practice <img src="img/peeling.jpg" width="600px" style="display: block; margin: auto;" /> ###
Discuss in groups... **Describe a task in the Innovation Hub.** --- #
Work Analysis Practice <img src="img/chef.jpg" width="520px" style="display: block; margin: auto;" /> ###
What do you think your professors do? - Job analysis - Task analysis - Content analysis --- class: inverse, center, middle #
<br><br> Expanding the <br> ISD Analysis Toolbox --- #
ISD Analysis Toolbox <img src="img/toolbench.jpg" width="360px" style="display: block; margin: auto;" /> - Systems Analysis - Performance Analysis - Needs Assessment / Needs Analysis - Training Requirements Analysis - Root Cause Analysis - Competency Assessment - Learner Assessment - Setting Analysis - Developmental Setting Assessment - **Job Analysis** - **Task Analysis** - **Content (Subject Matter) Analysis** --- class: inverse, center, middle #
<br><br> Looking ahead --- #
Semester Schedule <img src="img/across-time.jpg" width="480px" style="display: block; margin: auto;" /> - **Module 1:** Introduction to Instructional Systems Design - **Module 2:** Systems Analysis - **Module 3:** ISD & HPT - **Module 4:** Needs Assessment - **Module 5: Work Analysis** - **Module 6:** Design & Development - **Module 7:** Evaluation --- #
Major Assignments <img src="img/build.jpg" width="320px" style="display: block; margin: auto;" /> - **Assignments** (70%) - Module 2 Assignment: Systems Analysis paper (150 points) - Module 3 Assignment: Annotated Bibliography 1 (50 points) - Module 4 Assignment: Needs Assessment paper (150 points) - **Module 5 Assignment: Annotated Bibliography 2 (50 points)** - Module 6 Assignment: Work Analysis paper (150 points) - Module 7 Assignment: ISD Process Model paper (150 points) --- #
Major Assignments <img src="img/build.jpg" width="320px" style="display: block; margin: auto;" />
**Invitation:** Approach the *Module 5 Assignment: Annotated Bibliography 2* a bit differently --
Start with an article that is a bit over your head to read, such as [Frank et al. (2023)](https://doi.org/10.1016/j.ssresearch.2022.102815) --
Use a little GenAI magic from Google's [NotebookLM](https://notebooklm.google.com/) --
Listen to the recording at [konfound-it.org](https://konfound-it.org/) --
Write your annotated bibliography as a reflection on what you found interesting from the NotebookLM summary. --- class: inverse, center, middle #
<br><br> Questions <hr> **What questions can I answer for you now?** **How can I support you this week?** <hr>
[bret.staudtwillet@fsu.edu](mailto:bret.staudtwillet@fsu.edu) |
[bretsw.com](https://bretsw.com) |
[GitHub](https://github.com/bretsw/)