Checklists & Rubrics

Overview

This section covers checklists, rubrics, and guidelines for evaluating online programs and course quality. The Selection/Application/Implementation Guide and Resources/Examples may be used to create a customized program and course evaluation process for an institution’s specific needs. These artifacts may be used in a variety of contexts such as self-assessment, instructional designer review, peer review, institutional online program effectiveness, and accreditation standards.

Note:  If you are interested in more information on program evaluation and effectiveness, visit the Evaluation page where you will find more detailed information, tips and resources.

Objectives

  • Identify fundamental, critical, and essential elements for your institution’s online courses, programs, and institutional initiatives.
  • Use samples and resources to identify factors and elements related to the importance of your evaluation for high quality online course development and delivery.
  • List, categorize, and prioritize developed guidelines into personalized checklists, rubrics, or guidelines for your institutional needs, requirements, and implementation.

Selection/Application/Implementation Guide

This section presents recommendations that may be utilized when analyzing, selecting, and applying criteria to the institution’s assessment method for effective online programs, course requirements, and sometimes to meet accreditation standards. How will “quality” and “success” in online learning be defined at your organization?

The first recommendation is to start at a higher level of prioritizing needs. What national or institutional needs must be met for your institution? This could include matters such as copyright, Family Educational Rights and Privacy Act (FERPA), and online accessibility protocols.

Along with institutional criteria, departments and programs may also have specific criteria for online course content. Program criteria is a much more specialized area to develop and although some patterns may emerge, particular criteria may be highlighted and applied to specific courses and programs.

The overall process of analyzing and selecting criteria for online course/course program development can be narrowed down to the determination of specific course and content requirements. All courses will generally include a syllabus and content for delivery. Elements deemed critical for these areas should also be listed and implanted in the evaluation piece.

Once the above levels of criterion have been considered and listed, it is recommended that the criteria be categorized and prioritized for your application. Although all of the listed criterion are important and should be highlighted, prioritizing can assist faculty in their process for online content development.

Once there is a comprehensive list of institution criteria, it is time to develop the rubrics, checklists, or guidelines. Consider how and when the criteria will be used. It is very probable that more than one of these rubrics, checklists, or guidelines will be created to meet your development needs.

Ask yourself the following for context and usage:

  • Will these rubrics, checklists, and guidelines be used to assess courses during the delivery of your professional development course?
  • Will they be used for self-assessment, an instructional designer review, a peer review activity, or all of the above?
  • Will you develop the rubrics, checklists, and guidelines as formal assessments that will prohibit or enhance an instructor’s ability to teach online?
  • Will they be used more informally as self-assessment or peer review activities?
  • Will elements be included to assess the course’s effectiveness after the delivery of the course online?

Although this section may seem an overwhelming list of considerations, all are important in the development of your criterion for online course effectiveness. It is critical/imperative to decide what is important at your institution and how it will be clarified to instructors in your professional development course.

Resources/Examples

This section provides high quality examples of rubrics, checklists, and guidelines used to assess online programs and course evaluation/delivery standards. These resources were developed and utilized by other institutions. It is suggested that you reference these items, as appropriate, while you develop your own list of standards. They may also be considered “as-is” for adoption at your institution.

Program Evaluation Methods

Course Evaluation Methods

Discuss this Topic

Please join ongoing discussions related to this topic with colleagues in the TOPkit community of practice. This is a great opportunity to ask questions, seek feedback, or share effective practices with an active, global professional community.

Readings

Beyond the above list of resources and examples, listed below are addition readings that may assist in the development of your campus resources.

Thompson, K. (2016). EDUCAUSE BlendKit: Quality Assurance in Blended Learning, Second Edition. Accessed July 11, 2016 from https://blended.online.ucf.edu/blendkit-course-blendkit-reader-chapter-5/

Lee, C., Dickerson, J., Winslow, J. (Spring 2012). An Analysis of Organizational Approaches to Online Course Structures. Online Journal of Distance Learning Administration, Volume 15, n1. Retrieved from http://eric.ed.gov/?id=EJ973021

McGahan, S., Jackson, C., Premer, K. (December 2015). Online Course Quality Assurance: Development of a Quality Checklist. InSight: A Journal of Scholarly Teaching, Volume 1, p126-140. Retrieved from https://eric.ed.gov/?q=Online+Course+Quality+Assurance+Development+of+a+Quality+Checklist&id=EJ1074062

Office of Educational Technology. (November 2014). Online Professional Learning Quality Checklist. Retrieved from http://tech.ed.gov/wp-content/uploads/2014/11/Section-5-Online-Professional-Learning-Quality-Checklist-FINAL.pdf

Shelton, K. (2010). A Quality Scorecard for the Administration of Online Education Programs: A Delphi Study. Journal of Asynchronous Learning Networks, Volume 14: Issue 4, p 36-62. Retrieved from http://files.eric.ed.gov/fulltext/EJ909912.pdf

The Institute of Higher Education Policy. (April 2000). Quality On the Line: Benchmarks for Success in Internet-Based Distance Education. Retrieved from http://www.americanbar.org/content/dam/aba/migrated/legaled/distanceeducation/QualityOnTheLine.authcheckdam.pdf

References

Bauer, S. & Sugar, A. (2012 April). Professional Development for Preparing Online Faculty. Conference Presenter at USDLA 2012 NATIONAL CONFERENCE, Hilton St. Louis, St. Louis, MO. Retrieved from https://sites.google.com/site/idl6543redesign/

Michigan Virtual University (2012). Planning Guide for Online and Blended Learning. Retrieved from https://micourses.org/resources/pdf/toolkit/MVU_RPT_PlanningGuide.pdf

Sample Course

The TOPkit sample course has additional information regarding the_______.