Third-Year Review

Following the example of my friend Josh Rosenberg, here I am sharing the narrative I wrote for my third-year review this month. The third-year review is basically a check-in at the halfway point to make sure an Assistant Professor is on the right track and right pace to be promoted to Associate Professor and receive tenure, which is typically evaluated in year six. It’s a weird process to write about oneself, essentially to argue, in so many words, “I’m awesome at my job and you should keep me around.” It’s a different type of writing than I’m used to. I’m not saying that I’m any good at this style of writing, because I haven’t gotten official feedback yet. Still, I benefited tremendously from reading Josh’s examples from his tenure-and-promotion materials, so I am offering another example. Go read Josh’s stuff, feel free to keep reading here, and good luck in your own journey!


Major Accomplishments

I received my Ph.D. in Educational Psychology & Educational Technology from Michigan State in May 2021 and started as an Assistant Professor of Instructional Systems & Learning Technologies at Florida State University in August 2021. In my time at FSU, I have pursued my scholarly interests in self-directed learning through my research, teaching, and service; I summarize major accomplishments in each area in the following paragraphs.

Research

I have had a high quantity of research output: eight peer-reviewed journal articles, two invited book chapters, two peer-reviewed book chapters, 19 refereed conference papers/presentations, eight invited guest lectures, one invited plenary presentation, and one invited discussant presentation. I have received $296,278 in grant funding, with three major grants applications currently pending (totaling more than $2 million).

The quality of these efforts is evidenced by receiving two Best Paper Awards (AECT, AERA), a Qualitative Inquiry Award (AECT), and an Early Career Scholar Award (AERA). My work has gained some interest, receiving more than 1,000 citations (h-index of 16).

Teaching

I have taught 11 classes at FSU (five preps)—three on campus and eight online. My teaching has included core courses for the ISLT M.S. program (e.g., Introduction to Instructional Systems), Ed.D. program (e.g., Applied Research Methods in Learning Design & Performance Technology), and Ph.D. program (e.g., Synthesis, Analysis, and Argumentation in Instructional Systems Research), as well as two electives. I guided two courses through the rigorous Quality Matters (QM) “High Quality” certification process—the top QM credential for online courses. My course evaluation scores have been consistently above department, college, and university averages, and I have been nominated for my college’s Graduate Teaching Award each year I have been eligible. I have advised 10 doctoral students (three graduates) and served on 21 doctoral committees (seven graduates). In addition, I gather a weekly research group focused on collaboration and mentorship with 10 doctoral students regularly in attendance, and I have supported two of my advisees in publishing their first peer-reviewed journal articles. Finally, I have also served as the Academic Director for the ISLT Ph.D. program for two years, revamping our program’s recruitment, admissions, orientation, and examination processes—with a focus on recruiting and supporting large incoming classes of Ph.D. students.

Service

I have served at the program, department, and college levels. I have contributed to the profession through leadership roles in the Research & Theory Division of the Association for Educational Communications & Technology (AECT): Communications Officer, President-Elect, Conference Planner, and President. In addition, I served as Co-Guest Editor for the journal Information & Learning Sciences, writing a call for proposals for a special issue that promoted my research area of self-directed learning and social media—this has opened new professional networks among the international scholars who authored and reviewed articles for the special issue. I have also completed 58 ad hoc reviews for 16 journals, and I joined the editorial board for the SSCI-indexed Journal of Research on Technology in Education. I won the Outstanding Service Award from AECT’s Research & Theory Division in 2021.

Recognition

My effectiveness in teaching, service, and research has been recognized through multiple measures. Locally, I was invited to introduce our ISLT academic programs to local business leaders through the Leadership Tallahassee program. Nationally, I have been invited to consult on large federal grant projects funded through IES and NSF, to be a guest speaker at Manhattanville College (NY) and Columbia University (NY), to present on ChatGPT to the Michigan State University College of Education soon after the tool’s release, and to serve as discussant for a five-paper session at AERA. Internationally, I have delivered invited lectures at the University of Tübingen (Germany) and the University of Sevilla (Spain).


Discussion of Research, Teaching, and Service

Introduction

I received my Ph.D. in Educational Psychology & Educational Technology from Michigan State in May 2021 and started as an Assistant Professor of Instructional Systems & Learning Technologies at Florida State University in August 2021. My load has typically fluctuated between 45–50% research, 45–50% teaching, and 5% service. In my time at FSU, I have pursued my scholarly interests in self-directed learning through my research, teaching, and service as outlined in the following sections. My body of work represents national—and, increasingly, international—standing. In the following paragraphs, I detail my efforts and growth trajectory in each area.

Research

Research Focus

My research focuses on self-directed learning, a half-century-old adult learning theory from Knowles (1975) that is more relevant today than ever. The continued relevance of self-directed learning is tied to changes in how people can facilitate, guide, and support their own learning journeys in recent years with the advent of new technologies like online resource libraries, YouTube DIY videos, social media support groups, serious games, and generative AI tools—among many other options. I am fascinated by how people figure things out on their own, and I am most interested in what happens when students, learners, and trainees finish formal instruction, preparation, and training. I approach this work with both qualitative methods like interviews and diary studies as well as the computational tools of educational data science, such as learning analytics, social network analysis, discourse analysis, natural language processing, and educational data mining.

Self-Directed Learning for K-12 Teachers

My work has examined how and why several different types of learners have self-directed their learning, including K-12 teachers, higher education professionals, earlier career scholars, and instructional designers. For K-12 teachers, starting broadly, I contributed to a refereed book chapter where we reported on the variety of ways educators use social media for learning (Greenhow et al., 2023a). In an empirical study, I interviewed early career teachers to understand how they self-direct their professional development efforts through social media (Staudt Willet, 2023). Focusing on a single social media platform, Twitter, I collected nearly three million tweets to compare how two broad educational conversations among teachers—in the United Kingdom and in the United States—took shape before and during the COVID-19 pandemic (Greenhow et al., 2023b). Shifting attention to how self-directed learning occurred on another social media platform, I explored how Reddit’s themed discussion forums hosted different types of spaces for teachers, with one forum similar to a virtual teachers lounge and another more akin to a debate hall (Carpenter & Staudt Willet, 2021). In a subsequent Reddit study, I mentored a doctoral student in looking at how early career teachers use and benefit from a discussion forum designated for them (Na & Staudt Willet, 2022).

Self-Directed Learning in Higher Education

Shifting focus to a different population of educators, I supported another doctoral student in looking at how higher education professionals (e.g., professors, administrators, staff) self-direct learning through two Reddit discussion forums (Muljana et al., 2022).

I have also co-designed, with my colleague Dr. Josh Rosenberg at the University of Tennessee, workshops to support early career scholars’ development of educational data science skills, especially using the statistical and programming software R. Based on our experiences facilitating these workshops, we wrote guidelines for formative design of instruction that include situated and self-directed approaches to learning (Staudt Willet & Rosenberg, 2023). I also contributed to a refereed book chapter outlining recommendations for social media research, which would be a useful resource for early career scholars self-directing their methodological learning (Greenhalgh et al., 2021).

Finally, I worked with a doctoral student to develop a new model for instructional designers to reflect on the higher education systems in which they work and how their own cultures and biases shape their design decisions—all to better support and sustain learners by affirming and centering their home communities and cultures (Smith & Staudt Willet, 2023). We wrote the five principles of the new culturally sustaining instructional design model as a guide for designers to adjust their professional practice through self-directed learning.

Quantity, Quality, and Impact of Research

I have been highly productive in research, having published 22 refereed journal articles in my career (eight while at FSU), two refereed book chapters while at FSU, six invited book chapters (two at FSU), and one invited book review while at FSU. I have delivered 62 refereed conference papers/ presentations (19 at FSU), 13 invited guest lectures (eight at FSU), one invited plenary presentation, and one invited discussant presentation while at FSU. I have received $296,278 in grant funding while at FSU, with three grant applications under review. My work has been cited more than 1,000 times, and I have an h-index of 16. My body of work reflects my expertise with various methodologies (e.g., qualitative interviews, quantitative data mining), flexibility in studying different populations (e.g., K-12 teachers, early career scholars), and ability to work productively with various collaborators (e.g., colleagues at different institutions, doctoral students).

My research has been published in high-quality, SSCI-indexed journals such as Learning, Media and Technology (Journal Impact Factor [JIF] 6.9 in 2022), Teaching and Teacher Education (JIF 3.3 in 2020), Journal of Research on Technology in Education (JIF 3.3 in 2021), and Professional Development in Education (JIF 2.1 in 2022). The quality of my research has also been acknowledged through two Best Paper Awards (AECT, AERA), a Qualitative Inquiry Award (AECT), and an Early Career Scholar Award (AERA). In addition, the impact of my research and my standing as an expert in self-directed learning are evident through invitations to speak domestically as a discussant for a five-paper session at AERA, as well as serve as an expert panelist for a session on Generative AI for the whole College of Education at my alma mater, Michigan State University. I have also been invited to deliver lectures internationally at University of Sevilla (Spain) and University of Tübingen (Germany).

External Funding for My Research

These research experiences and focus on self-directed learning continue to move forward and evolve. The future trajectory of my research is best represented by my current and pending grant activity. I am currently a co-PI for a $249,978 grant through the Sloan Foundation to investigate the alignment of computing graduate programs at minority-serving institutions with jobs in the computing industry (Wofford et al., 2023)—navigating differences in computing terminology is an impetus for self-directed learning.

I currently have three pending grant applications. First, I submitted as PI a solo proposal for the NSF CAREER award for $870,598 (Staudt Willet, pending), in which I propose co-designing a mobile game to support culturally affirming self-teaching—that is, the convergence of self-directed learning and culturally sustaining pedagogy, inspired by my work to develop the culturally sustaining instructional design model (Smith & Staudt Willet, 2023). Second, I am co-PI on a proposal to the U.S. Department of Education for $320,584 (Myers et al., pending), in which our team would investigate the development of data literacy related to data visualizations—much of which would involve self-directed learning. Third, I am co-PI on a proposal to the Institute of Education Sciences for $898,397 (Frank et al., pending) that would further develop advanced statistical techniques for showing causal relationship through sensitivity analysis—my role would be to make the approach more readily understood by applying self-directed learning principles.

In sum, these future directions for research draw from my past success and continue my current trajectory of increasing my national and international standing as an expert in self-directed learning. This line of research will be continually significant as learners in many contexts (e.g., education, technology, healthcare) will need to self-direct their learning in response to contextual change (e.g., policy, regulation, public health crises) and proliferation of emerging tools (e.g., virtual reality, generative AI). I will continue my exploration of the possibilities and perils of self-directed learning in response to whatever may come.

Teaching

I have been highly productive in teaching, having taught 11 classes at FSU (five preps)—three on campus and eight online. I conducted a major redesign of two preps and minor redesign of two preps. I have also advised 10 doctoral students (three graduates) and served on 21 doctoral committees (seven graduates). I have served as the Academic Director for the ISLT Ph.D. program for two years, and I gather a weekly research group focused on collaboration and mentorship with 10 doctoral students regularly in attendance.

Impact of My Teaching and Mentoring

The primary evidence for the results and effectiveness of my teaching is how students see themselves at the end of the course or at the end of a research project. My goal is that students would identify as being someone who can do research, educational data science, instructional systems, etc. Drawing from my interest in self-directed learning, I am most interested in what students are able to go and do after the course, project, or graduation. That is, I measure success not by the work students do on any individual course assessment or even the final project, but their level of thinking and practice months later. This can be hard to measure precisely, but I am in the fortunate position of teaching most of my students—M.S., Ed.D., and Ph.D.—in more than one course, and I serve as advisor or dissertation committee member for many ISLT doctoral students as well.

My most explicit evidence of student success is in the journey of Ed.D. students. The ISLT Ed.D. program is set up as a cohort where students take all courses together, usually as the only students in those courses. I teach the Ed.D. students in their first term in a foundational research seminar, Applied Research Methods in Learning Design & Performance Technology. A year later, in their fourth term, I teach them more specific and advanced research methods in the Learning & Web Analytics course. I also teach them how to write the front half of their dissertation prospectus during their fifth term, in a course called Synthesis, Analysis, and Argumentation in Instructional Systems Research. Starting in their seventh term in the program, I support them as advisor or committee member through the dissertation journey. This sequence has allowed me to see how my instruction at earlier stages has been effective. Or, as I have witnessed how students have struggled writing synthesized literature reviews and data analysis sections in their prospectuses, the multiple opportunities to observe student learning has led me to revise my approach in the earlier stages.

Furthermore, my role as Ph.D. Program Coordinator has also given me insight into the journey of Ph.D. students through the courses I teach and continued through the program milestones (e.g., Qualifying Exam, Preliminary Exam) that I administer. Once again, seeing students regularly throughout their whole journey has prompted reflection on the effectiveness of my teaching and mentoring as well as impetus for updating my approach.

My Philosophy of Teaching

The impact of my teaching and mentoring is rooted in my teaching philosophy. Simply put, I believe that every student enters the ISLT program or a specific course with a variety of knowledge, skills, and experience—as well as the potential to self-direct their learning to reach their goals. Regardless of their starting point, I will support them on that journey. I am most interested in students’ growth and learning, and I assess students based on how far they go, not from where they started. This doesn’t mean that different standards apply to different students. On the contrary, I hold each student to a very high standard of academic and professional excellence. I expect students to push their limits—whatever those limits are—and to contribute their own unique learning experiences and perspectives to the learning community represented in the course. I expect students to ask good questions in order to extend their own thinking as well as the thinking of their peers, colleagues, and instructor. I expect students to offer thoughtful, constructive suggestions that sharpen the collective understanding and focus of the class. I expect students to seek out answers by leveraging all of the resources at their disposal, while also adhering to professional standards of academic integrity.

Teaching philosophies must now account for emergent technologies like ChatGPT. Although generative AI tools like ChatGPT can easily and instantaneously create essays and computer code, I choose to place emphasis on the purpose of academic labor: I remind students that creating original work—although it often requires struggle and iteration—is essential for learning. When it comes to learning, slow and inefficient processes can actually be good things. Thus, although generative AI tools can produce decent results with little effort—indeed, I teach students how to do so—I prohibit using these tools for assignments unless I explicitly state otherwise, because shortcuts on effort will also cut short students’ depth of understanding and development of skill.

My Research and Teaching Inform One Another

My teaching philosophy has been developed and refined these through course instruction and mentoring doctoral students, but my research has significantly influenced how I teach as well. As one example, over the years I have designed and facilitated five brief workshops introducing educational data science to educational researchers. I surveyed participants in some of these workshops and published the findings. Specifically, in a 2023 article in the Journal of Formative Design for Learning, I wrote five guidelines for the formative design of instruction: (a) tailoring instruction to participants’ backgrounds, (b) using familiar data sources from education rather than generic ones, (c) emphasizing the relevance of content to learners’ research or work, (d) emphasizing support and encouragement, and (e) balancing the introduction of new ideas with opportunities to practice (Staudt Willet & Rosenberg, 2023). These five guidelines undergird my teaching philosophy and have helped me continue to improve my teaching.

Learning is Situated

Approaching learning as situated is particularly important because many graduate students are participating in the ISLT program while also situated within professional contexts, whether work contexts for M.S. and Ed.D. students or scholarly contexts for Ph.D. students. Therefore, I emphasize the importance of connecting class discussions and assignments to their professional interests. Each semester, I tell students that if an assignment does not matter to their professional situation or professional goals, they should let me know, and we will determine an alternative assignment that would be meaningful as they tackle real problems and opportunities in their professional roles. I set the stage for learning opportunities and potential directions, and then I support students’ self-directed learning—getting them started on their journeys—through class activities, coursework, and feedback.

To help students experience learning as situated in a community of practice, I guide students—individually and collectively as a class—reimagine themselves as people who do instructional systems, educational data science, etc. I help them develop an identity as the kind of person who participates in such professional practices (Gee, 2004). I foster this identity development in both small and large ways. On the small—but still quite important—side, I seek to acknowledge the lives that graduate students lead outside of school by organizing all course content into two-week modules so that assignments are only due every other week. This setup provides some flexibility for when students can complete their work. I use the first week of a module to introduce new topics and allow students to complete readings. In addition, I provide optional resources that students can explore to the degree to which they are interested. These supplemental resources include podcasts, public datasets and code, websites, interactive web apps, and videos. Then, in the second week of a module, students co-create the agenda by choosing where we will dig deeper into topics through discussions.

As a specific example of this situated approach to learning, in my Learning & Web Analytics class, I create on-ramps to new topics by sharing “data stories,” or current events from the news or social media that are immediately applicable to course objectives. In most cases, these data stories lead into conversations of ethical considerations raised by big data in education. I also give demonstrations of computer programming in R for collecting real educational data from social media or learning management systems and analyzing these data with methods such as social network analysis and natural language processing. To support this, I created space on my website that I call the Analytics Sandbox, which contains a series of modules that students can choose to follow if they are interested in self-directed their learning to go beyond course requirements to develop proficiency in R. Finally, the whole class collectively documents various technologies and resources useful for data analytics on a shared Padlet.

Giving and Receiving Feedback is Key

I provide students low-stakes opportunities to practice new skills, demonstrate learning through formative assessments with opportunities to revise, and feedback that is timely, thorough, and kind. In addition, I facilitate multidirectional feedback in the form of self-reflection and peer review. I offer students the opportunity to revise any assignment based on feedback, and I adjust their grades accordingly. I emphasize that this process is not linear, but iterative and responsive: students complete work and can then revisit and improve. Throughout this process, I affirm and strengthen students’ agency by inviting them to self-direct and co-create their learning experiences, such as by collectively setting agendas for course meetings and having students supplement assigned course readings with their own suggestions and those from their peers.

I also remain open to receiving feedback as an essential part of continually improving my teaching. For instance, in addition to the longitudinal opportunities for reflection afforded by working with students across multiple terms, each semester I also seek feedback within courses through a mid-semester student survey, which allows me to adjust my teaching immediately as a result. More informally, I model self-reflection and iteration—which I hope students will practice in their own learning—by talking openly and regularly in class about decisions I have made in designing the course and asking for students to react and reflect on the efficacy of those choices and what could be further adapted. Furthermore, in 2022, I sought out the extensive external feedback on course design offered by Quality Matters (QM). I went through training and received two certifications, one in Online Quality Review and one in Applying the Quality Matters Rubric. With these certifications, I redesigned two courses so they would achieve QM—High Quality ratings through external review from three QM expert faculty members outside FSU. This process of QM training, course redesign, and extensive external feedback from reviewers was a significant professional development opportunity and enhanced my teaching.

Service

Similar to my teaching and research record, my service trajectory demonstrates an increasing national standing, mutually benefitting both my teaching and research. The focus of my service is on giving people the tools of self-directed learning to meet the challenges of today, especially as society and technology continue to change. For instance, my service to the profession has grown through my involvement with my discipline’s foremost organization, the Association for Educational Communications & Technology (AECT). My first service position in AECT was as the Graduate Student Representative for the Research & Theory Division (RTD) while a Ph.D. student. Since then, I have served as Secretary, Communications Officer, President-Elect, and, currently, President of RTD. During the 2022–2023 year, as RTD President-Elect, I represented the division on the organization’s conference planning team. In this role, I coordinated 313 reviews of 104 proposals to the division. I also organized RTD’s Theory Spotlight Competition, an opportunity for division members to highlight and promote theoretical frameworks deserving more attention from the field. In these ways, I had the opportunity to shape the conference experience for our entire division and much of the organization. When I started in the role of RTD President in October 2023, I urged division members to embrace our role in helping the field think about research methods and theoretical frameworks in our present moment—to be at the forefront of applying emerging generative AI tools and situating them within a historical context, as well recognizing our current societal challenges and promote more culturally sustaining approaches to research and theory. As President, I convene monthly meetings of the division board and support the board members leading RTD’s initiatives around ongoing professional development through webinars, early career mentoring, and planning the next annual conference.

My service to the profession is also growing through contributing to academic journals, where I have been steadily reviewing articles and shaping what is being published (58 reviews during the time under review). In 2023, I was invited to join the editorial board for the Journal of Research on Technology in Education and co-guest-edited a special issue for the journal Information and Learning Sciences.

At FSU, I am continuing to expand my influence through service, having served as Academic Director of the ISLT Ph.D. program for two years, as well as on the EPLS department’s Annual Evaluation Committee to review and rate faculty members’ annual efforts, the department’s DEI Committee, and most recently, the college’s Faculty Advisory Committee.


References

Carpenter, J. P., & Staudt Willet, K. B. (2021). The teachers’ lounge and the debate hall: Anonymous self-directed learning in two teaching-related subreddits. Teaching and Teacher Education, 104, 103371. doi:10.1016/j.tate.2021.103371

Frank, K., Maroulis, S., Xu, R., Rosenberg, J. M., Saw, G., Lin, Q., & Staudt Willet, K. B. (pending). IES: Sensitivity Analysis for Statistical Advances that Inform Evidence Use and Knowledge Mobilization. Submitted to Institute for Education Sciences.

Gee, J. P. (2004). Situated language and learning: A critique of traditional schooling. Routledge.

Greenhalgh, S. P., Koehler, M. J., Rosenberg, J. M., & Staudt Willet, K. B. (2021). Considerations for using social media data in learning design and technology research. In Enilda Romero-Hall (Ed.), Research methods in learning design & technology (pp. 64-77). Routledge.

Greenhow, C. M., Galvin, S. M., Staudt Willet, K. B., & Chapman, A. L. (2023a). Social media and learning. In R. J. Tierney, F. Rizvi, & K. Ercikan (Eds.), International encyclopaedia of education (4th ed.) (pp. 431-442). Elsevier. Retrieved from https:// doi.org/10.1016/B978-0-12-818630-5.14040-0

Greenhow, C., Lewin, C., & Staudt Willet, K. B. (2023b). Teachers without borders: Professional learning spanning social media, place, and time. Learning, Media and Technology, 48(4), 666-684. doi:10.1080/17439884.2023.2209326

Knowles, M. S. (1975). Self-directed learning: A guide for learners and teachers. Pearson Learning.

Krutka, D. G., Caines, A., Heath, M. K., & Staudt Willet, K. B. (2021). Black Mirror pedagogy: Dystopian stories for technoskeptical imaginations. Journal of Interactive Pedagogy and Technology, 20. https://cuny.manifoldapp.org/read/black-mirror-pedagogy-dystopian-stories-for-technoskeptical-imaginations-5df256c8-ca16-45e1-9d1a-e68593443990/section/962a7c17-50d0-4e7a-aafe-483d077ed4bb

Krutka, D. G., Heath, M. K., & Staudt Willet, K. B. (2019). Foregrounding technoethics: Toward critical perspectives in technology and teacher education. Journal of Technology and Teacher Education, 27(4), 555-574. http://learntechlib.org/p/208235/

Muljana, P. S., Staudt Willet, K. B., & Luo, T. (2022). Adjusting sails for changing winds: Exploring Reddit use for professional purposes in higher education. Journal of Computing in Higher Education, 34, 679-707. doi:10.1007/s12528-022-09317-2

Myers, J., Ecton, W. G., Fendler, R., Grace, C., & Staudt Willet, K. B. (pending). Project EVIDENT: Evaluating Visual Information and Data to Enhance oNline Thinking. Submitted to USDOEd American History and Civics-National Activities grant.

Na, H., & Staudt Willet, K. B. (2022). Affinity and anonymity benefitting early career teachers in the r/teachers subreddit. Journal of Research on Technology in Education. doi:10.1080/15391523.2022.2150727

Smith, C., & Staudt Willet, K. B. (2023). A model for culturally sustaining instructional design. Journal of Applied Instructional Design, 12(2). doi:10.59668/722.13027

Staudt Willet, K. B. (pending). NSF CAREER: Developing STEM Teachers’ Culturally Affirming Self-Teaching (CAST) Through a Mobile Game. Submitted to National Science Foundation.

Staudt Willet, K. B. (2023). Early career teachers’ expansion of professional learning networks with social media. Professional Development in Education. doi:10.1080/19415257.2023.2178481

Staudt Willet, K. B., & Rosenberg, J. M. (2023). The design and effects of data science workshops for early career researchers. Journal of Formative Design in Learning, 7, 83-97. doi:10.1007/s41686-023-00083-7

Wofford, A., Perez-Felkner, L., & Staudt Willet, K. B. (Jan 2023–Jun 2025). Sloan: Aligning Graduate Education and Workforce Opportunities: A Robust, Equity-Focused Landscape Scan of Computing Terminology. Funded by Alfred P. Sloan Foundation.