Years in Review: ADDIE 2023 – 2025 (Issue 39)

car rear view and side mirror with "future" and "past"

Author and Editor: Dr. Denise Lowe

Since its inception in 2017, the Ask ADDIE column has been an integral part of the TOPkit Digest as a function of topkit.org, providing recommendations and strategies to questions asked by the readers – faculty members, instructional designers, and management alike. The last review of Ask ADDIE articles and trends was provided in 2022. Since 2025 is soon coming to an end, a current review of Ask ADDIE through the intervening years of 2023 – 2025 may provide some insight into trends and practices encountered in the instructional design field – and where we go from here.

Ask ADDIE originally emerged as a space where online developers and instructors could share strategies for challenges and difficulties in the online environment and receive guidance and resources. While Ask ADDIE continues to be a collaborative resource for these purposes, it has also evolved into a space discussing hypothetical scenarios, project and program-based strategies, and forward-looking ideas into the evolutionary processes and trends of online higher education. Some of these trends may be advances in technology, emerging technologies, and teaching strategies that provide students with the skills necessary to navigate turbulent workplace and cultural waters within the context of their chosen disciplines.

While all of the columns written for Ask ADDIE are worthwhile reading since all address real challenges provided by our readers or specific programmatic strategies, some of them have been particularly timely and delivered in concert with issues higher education has faced over the years.

Take, for example, the issue titled, Implementation of AI in Online Teaching and Learning (Issue 29), that was a response to the overwhelming rise and use of artificial intelligence (AI) within online courses through chatbots and video generators, for example (ChatGPT, Otter.ai, Dall-E2, etc.) This article, written by Dr. Jann Sutton from the University of North Florida, explored how artificial intelligence has been in use in the educational setting for decades. Dr. Sutton detailed strategies for how to use various new AI tools in course activities and assignments that would assist students to harness the power of AI rather than falling victim to its errors and limitations.

Or, what about Considerations of Generative AI for Content Creation (Issue 32), which brought readers back to the need for AI prompts to follow design and learning theory models for content creation. In the rising prevalence of AI tools, Anastasia Bojanowski reminds readers that learning theory provides a basis for constructing prompts or activities that include Gagne`’s (1985) events of instruction. Using a learning theory model helps to scaffold learning activities in meaningful ways. Ms. Bojanowski is an instructional specialist in the Faculty Center for Teaching and Learning (FCTL) at the University of Central Florida (UCF).

ADDIE discusses challenging scenarios, project & program strategies, and future trends in online higher education.

In Navigating the Fast Lane: Essential Strategies for Accelerated Course Design (Issue 36), Dr. Denise Lowe provided strategies that had recently been developed by the Center for Distributed Learning (CDL) at UCF in developing resource materials for several different types of accelerated course formats. By providing strategies for instructors, readers were reminded that, although challenging, accelerated course formats should focus on identifying essential concepts for course mastery. Student resources identified options for their educational journey and success strategies for accelerated courses. Resources provided included infographics, web pages for faculty and students, interactive decision trees, course maps, and the use of chatbots to realign content within specific formats for conversion processes. Dr. Lowe is a Senior Instructional Designer and adjunct faculty member at UCF.

Looking back at some of the articles focusing on course design and LMS functionality specifically, some topics dealt with quiz analytics, multi-modal course offerings, grading schemes and weights, and strategies for dealing with large online courses. Each of these topics represented a specific challenge for instructors and instructional designers that often create confusion and frustration. Written by different authors, the resources provided helped to lessen this frustration and create more productive communication pathways to assist faculty in managing their online courses.

Ask ADDIE also dealt with topics that were more personal in nature which could have negative impacts upon online teaching and learning. From transitioning from a K-12 environment into the instructional design field, mitigating student anxiety, to cyberbullying of faculty – these articles, also written by various authors, provided meaningful strategies to consider for all levels of higher education from students to institutional leadership.

Moving forward, Ask ADDIE may find a continued focus on the increasing development and use of AI tools that build and expand upon the strategies already mentioned in previous articles. This may be a similar situation for the use of open educational resources as a way to mitigate educational cost while continuing to provide a quality education experience for students, building upon Demystifying OER and Open Pedagogy: A Practical Guide (Issue 37), in which Dr. Denise Lowe and Joe Fauvel – both of UCF – provide a graphic to identify the differences between the two constructs.  

Ongoing articles such as these provide relevant information, tips, and suggestions for all of us working in course design or online teaching. The benefits of such collective learning cannot be overstated since many of us deal with similar challenges within our own institutions. There is much wisdom among us – we all improve when it is shared!

What other ideas do you have that could improve the Ask ADDIE approach to inviting questions or article ideas? Please share your thoughts with our TOPkit community on LinkedIn!

Ask ADDIE Editor:

Dr. Denise Lowe, Senior Instructional Designer, Division of Digital Learning, UCF, July 2018 – current

Ask ADDIE Authors 2023 – 2025:

Lowe, D. (2025, November). Ask ADDIE: Years in Review: 2023 – 2025 (Issue 39). Retrieved from TOPkit website: https://topkit.org/2025/11/07/years-in-review-addie-2023-2025-issue-39/

Otto, M., and Staton, J. (2025, August). Ask ADDIE: Too many tabs, not enough time: Strategies for large online courses (Issue 38).  (D. Lowe., Ed.). Retrieved from TOPkit website: https://topkit.org/2025/08/18/too-many-tabs-not-enough-time-strategies-for-large-online-courses-issue-38/

Lowe, D. (2025, May). Ask ADDIE: Demystifying OER and Open Pedagogy: A Practical Guide (Issue 37). Retrieved from TOPkit website: https://topkit.org/2025/05/20/demystifying-oer-and-open-pedagogy-a-practical-guide-issue-37/

Lowe, D. (2025, March). Ask ADDIE: Navigating the fast lane: Essential strategies for accelerated course design (Issue 36). Retrieved from TOPkit website: https://topkit.org/2025/03/05/navigating-the-fast-lane-essential-strategies-for- accelerated-course-design-issue-36/

Lowe, D., Jowallah, R., McNulty, R., Swenson, N., & Williams, T. (2025, March). Accelerated course design for educators. University of Central Florida, Division of Digital Learning. https://cdl.ucf.edu/teach/strategies/accelerated-course-design/  

Lowe, D., Jowallah, R., McNulty, R., Swenson, N., & Williams, T. (2025, March). Are accelerated courses right for you? University of Central Florida, Division of Digital Learning. https://cdl.ucf.edu/support/student/accelerated-courses/  

Smith, J. A. (2024, November). Ask ADDIE: Unlocking the power of quiz analytics for smarter assessments (Issue 35). (D. Lowe., Ed.). Retrieved from TOPkit website: https://topkit.org/2024/11/13/unlocking-the-power-of-quiz-analytics-for-smarter-assessments-issue-35/

Jones-Roberts, C. (2024, May). Ask ADDIE: Multimodal Learning (Issue 33). (D. Lowe., Ed.).Retrieved from TOPkit website: https://topkit.org/2024/05/30/multimodal-learning-issue-33/

Bojanowski, A. (2024, February). Ask ADDIE: Considerations of Generative AI for Content Creation (Issue 32). (D. Lowe., Ed.). Retrieved from TOPkit website: https://topkit.org/2024/02/06/considerations-of-generative-ai-for-content-creation-issue-32/

Jones-Roberts, C. (2023, November). Ask ADDIE: Strategies to Mitigate Student Anxiety (Issue 31). (D Lowe., Ed.).. Retrieved from TOPkit.org website: https://topkit.org/2023/11/15/strategies-for-mitigating-student-anxiety-issue-31/

Lowe, D. (2023, August). Ask ADDIE: A “Weighty” Issue: Course Design and Grading Schemes (Issue 30). Retrieved from TOPkit.org website: https://topkit.org/2023/08/17/a-weighty-issue-grading-schemes-and-course-design-issue-30/

Sutton, J. (2023, May). Ask ADDIE: Implementation of AI in Online Teaching and Learning (Issue 29). (D. Lowe., Ed.). Retrieved from TOPkit website: https://topkit.org/2023/05/22/implementation-of-ai-in-online-teaching-andlearning-issue-29/

Lowe, D. (2023, February). Ask ADDIE: Cyberbullying: A guide for supporting faculty under attack (Issue 28). Retrieved from TOPkit website: https://topkit.org/2023/02/08/cyberbullying-a-guide-for-supporting-faculty-under-attack-issue-28/

Lowe, D. (2022, October). Ask ADDIE: E-Learning: The key to online teaching success (Issue 27). Retrieved from TOPkit website: https://topkit.org/2022/10/12/e-readiness-the-key-to-online-teaching-success-issue-27/

Unlocking the Power of Quiz Analytics for Smarter Assessments (Issue 35)

Computer screens displaying various data analytics graphs

Author:Dr. Jo Ann Smith, University of Central Florida 

Editor: Dr. Denise Lowe, University of Central Florida

Dear ADDIE, 

I’ve been using quizzes in my online course to assess student learning, but I’m not sure how to make the most of the data provided by the LMS quiz analytics tools. I want to ensure my quizzes are effective and truly reflective of student understanding. What should I look for in the data, and how can I use this information to improve my quizzes? 

Signed,

Quizzer in Quandary 

The goal of data analytics is to enhance the quality of quiz items and support an overall assessment strategy.

Dear Quizzer, 

What a great and relevant question in today’s data-driven landscape! Learning Management Systems (LMS) like Canvas, Blackboard, and Moodle offer quiz analytics tools based provide you with useful information about student learning and engagement. By understanding the types of analytics available and how to interpret them, you can enhance the effectiveness of your quizzes and ensure assessments are providing you with meaningful information about your students’ learning (Brown & Race, 2012; Deetjen-Ruiz et al. 2023; Kumar, et al 2021; Gamage, et al, 2019). Let’s break down the key types of analytics commonly provided by LMS quiz tools and discuss how you can leverage these insights for quiz improvement. 

Using Quiz Analytics to Refine Assessments 

When analyzing quiz data, there are several key statistics that can guide your decision-making and provide valuable insights into student performance and question effectiveness. The goal is to use this data to enhance both the quality of your quiz items and support the overall assessment strategy. Below is a table outlining five common types of analytics provided by LMS quiz tools and how to use these insights to improve your quiz items. Each data type is paired with an example to illustrate how it can inform specific actions for you to take to refine assessments. 

Data Type Applications table with item analysis, description, improvement applications, and examples provided.

By analyzing these types of data, you can refine your quizzes to ensure that each question is clear, fair, and aligned with your student learning objectives. This iterative process of reviewing and revising assessments based on data helps create more effective learning experiences and ensures that quizzes serve as meaningful tools for both learning and evaluation. 

You could also experiment with adaptive tests that adjusts question difficulty based on student performance. Heat map quiz analytics are also a good visual to quickly identify question items where rows represent a question, and each column represents a student. A specific question might show mostly green colors except for a few patches of red, suggesting that while most students answered quickly and correctly, a few took longer and answered incorrectly. This visual clue could prompt a review of that question to determine if it was unclear or too difficult for those students. 

I also like to use data from open-ended responses to understand the depth of student understanding beyond what multiple-choice questions can provide. Additionally, you could explore the impact of quiz timing (e.g., open-book vs. closed-book quizzes) and provide immediate feedback to further enhance student learning and engagement. 

We’d love to hear your thoughts on innovative uses of LMS quiz tools to enhance learning outcomes. What other ideas or plans for the use of data analytics have you applied or are exploring at your higher education institution? Please share your thoughts with our TOPkit community on LinkedIn!

References 

Brown, S., & Race, P. (2012). Using Effective Assessment to Drive Student Learning. Higher Education Academy. 

Deetjen-Ruiz, R., Esponda-Pérez, J. A., Haris, I., García, D. S., Osorio, J. L. Q., & Tsarev, R. (2023). Evaluating the Reliability of Tests Used in LMS Moodle for E-Learning. In Proceedings of the Computational Methods in Systems and Software (pp. 1-8). Cham: Springer Nature Switzerland. 

Kumar, D., Jaipurkar, R., Shekhar, A., Sikri, G., & Srinivas, V. (2021). Item analysis of multiple choice questions: A quality assurance test for an assessment tool. Medical Journal Armed Forces India, 77, S85-S89. 

Gamage, S.H.P.W., Ayres, J.R., Behrend, M.B. et al. (2019). Optimising Moodle quizzes for online assessments. IJ STEM Ed 6, 27 

Considerations of Generative AI for Content Creation (Issue 32)

Robot working on a laptop computer

Author: Anastasia Bojanowski, University of Central Florida

Editor: Dr. Denise Lowe, University of Central Florida

Dear ADDIE,

Some of my colleagues are leveraging Generative AI for content creation.  I have content that needs to be updated and would like to use AI platforms. However, I soon became overwhelmed when I searched for options. Further, I have reservations regarding the accuracy and reliability of AI platforms.  Any suggestions?

Lost in the Matrix

Dear Lost in the Matrix,

I can sympathize with feeling overwhelmed when considering AI platforms for content creation. The options are plentiful.  You are also wise to question the accuracy and reliability of content creation. Indeed, the rate of Generative AI to hallucinate or invent information is estimated to be between 3-27% (Metz, 2023).  Further, the output can contain biases and misinformation (Zewe, 2023).  However, with a healthy level of pragmatism, Generative AI has a place in content creation if users follow the ASSURE and ADDIE models and include design and learning theory in prompts.

When updating content, consider using the design features of platforms and applications.  For example, older PowerPoints can be refreshed with a newer theme, stock images, and the “Designer” feature native to the program.  Additionally, presentations can be uploaded into free versions of Google’s Gamma, Adobe Express (webpage), and Canva.

Generative AI prompts should follow design and learning theory models for content creation.

Another option is to use platforms such as Microsoft’s Copilot or Open AI’s ChatGPT to generate an initial draft of anything from lesson plans to grading rubrics.  Consider experimenting with each by using the same prompt and vetting results. Regardless of the selection of the platform, the prompt should be composed to include instructional design and learning theory. Christie (2024) recommends constructing prompts that include Gagné’s (1985) events of instruction:  

  • Gaining attention
  • Informing the learner of the objective
  • Stimulating recall of prerequisite learning
  • Presenting the stimulus material
  • Providing learning guidance
  • Eliciting the performance
  • Providing feedback
  • Assessing the performance
  • Enhancing retention and transfer
Prompt using Gangé’s Events of Instruction: You are an expert in creating an exercise supporting experiential and active learning.  The activity requires peer collaboration for an asynchronous online course and is based on the creation and review of a digital portfolio for professional purposes.  Students will be sorted into groups of 3 for peer review.  Upon completion of the activity, students will create a digital portfolio that includes a skills-based resume, statement of philosophy, projects, and community service.  Afterward, students will be asked to provide feedback on design and content. The activity is a 3-week activity. Please create a brief yet compelling description of the activity that can be posted in Canvas as an introduction.  Create step-by-step directions to create a digital portfolio that includes content pages for the following: skill-based resume, personal statement, projects, and community service, and contact. Include any resources that can help create a college student digital portfolio.  Create a peer review worksheet that students can use to evaluate design and content. Make sure that the worksheet can be filled out online. Generate a grading rubric that evaluates design, skills-based resume, alignment of skills-based resume with projects, and peer review. Consider each part of the instructions given and generate the most engaging lesson.

Keep in mind that the generated lesson may require several iterations to achieve the desired output.  Further, the output is an initial draft that requires vetting for accuracy and integrity and adding legitimate resources. Output requires careful review to support universal design principles, protect privacy, and avoid bias. 

The one platform that lists sources used to generate output is Microsoft’s Copilot. A follow-up prompt that asks for specific sites or resources to be included has mixed results.  Consequently, the problem with legitimacy and accuracy persists.

Moving forward, content creators should require Generative AI platforms to safeguard privacy and provide robust bias reviews—even with free versions of their platforms.  Just as textbook companies were forced to ensure universal design to accommodate learners with disabilities to remain competitive, Generative AI platforms should protect privacy and minimize bias to be a viable candidate for content creation.

What other ideas or plans for the inclusion of AI have you applied or are exploring at your higher education institution? Please share your thoughts with our TOPkit community on LinkedIn!

References

Christie, B [Alchemy]. (2024, January 17). AI for the new year: Integrating AI into academic work [Video]. YouTube. https://www.youtube.com/watch?v=Lx0gGJ18MlI

Gagné, R. M. (1985). The conditions of learning and theory of instruction (4th ed.). Holt, Rinehart & Winston.

Metz, C. (2023, November 16).  Chatbots may ‘hallucinate’ more often than many realize.  The New York Times. https://www.nytimes.com/2023/11/06/technology/chatbots-hallucination-rates.html

Zewe, A. (2023, November 9). Explained: Generative AI: How do powerful generative AI systems like ChatGPT work, and what makes them different from other types of artificial intelligence? MIT News. https://news.mit.edu/2023/explained-generative-ai-1109

The Road to Instructional Designer Credibility (Issue 19)

Credibility road sign

Author(s): Dr. Rohan Jowallah

Editor: Dr. Denise Lowe

Dear ADDIE,

I am new to the instructional design profession. I got this job–which I love–because I taught online, used flipped classroom strategies, and redesigned my course several times—not because I have any training or education in this field. I also did not have the support I needed with my first supervisor (who has since left). I’m looking to re-image myself because my faculty see me and automatically think “Oh you just want me to teach online!” OR “You demanded I take a survey. Who are you to tell ME what to do?”

What do you suggest? I really want to help my faculty move toward the 21st Century in higher education.

Signed,

Reformation in Progress

Dear Reformation,

Thanks for your question! First of all, I hope you are keeping yourself safe. Even in the best of times, the scenario you present is challenging – yet quite commonly encountered. During the additional challenges posed by the COVID-19 situation, it can be even more difficult to engage faculty in quality online instruction. If ever there was a time to consider yourself as a central figure in your institution, it is now. Instructional designers have been called upon to assist and play a vital role in supporting faculty in teaching remotely. There are a few strategies that can be used to navigate various organizational cultures.

More than ever, instructional designers are central figures for institutional teaching and learning goals.

#1 Ensure that you locate a faculty member who is an advocate for online teaching and learning. Once you do so, make every effort to build a healthy relationship. This will create a way for you to provide needed instructional guidance. Once you find this online champion, you will have access to others who may be interested. Remember, any cultural shift will take time.

#2 I would also recommend that you use the online Faculty Development Decision Guide (FDDG) to assess your organizational needs. Doing so will also provide you with a pathway for developing initiatives for supporting faculty.

#3 Since you have also taught online and have developed various courses, it will be necessary to model/show faculty members the endless possibilities of online teaching and learning. The most significant way to show your skills will be to demonstrate them in practice.

#4 Finally, I would also recommend that you start a series of communication with your faculty members. Your conversation could focus on current practices and research in online teaching and learning, tools, and technologies used in online learning and teaching, and your research. Importantly, I recommend that you consider hosting some informal sessions. These sessions could take the form of one-to-one meetings or group meetings. Your ultimate aim is to build rapport with faculty. Doing so will require time, understanding, support, engagement, and effective communication.

I’m sure there are many more tips that others in the community have found useful. What strategies do you use for effectively engaging faculty in the online course design process – especially during such challenging times as we are currently facing? Please share your thoughts with our TOPkit community on LinkedIn!