What I Ask During a Course Review
I just released the first draft of a new WBT course and as usual I have a slew of people reviewing the course. This includes Subject Matter Experts (SMEs) among others. In the past I have provided a general list of what aspects of the course should be reviewed (e. g. grammar, accuracy of content, navigation, technology, etc.). This time around I compiled a far more detailed list of concerns reviewers should be attentive to during their review. It is meant more as guide to what they should be looking for, but can also be used as a questionnaire.
Here is what I included:
Grammar
- Check spelling, grammar, and consistency of language.
Objectives/Learning needs
- Does the course answer your questions/concerns about the subject?
- Do you feel prepared to begin applying the new knowledge/skills learned?
- Does the course meet the objectives presented at the beginning of the course?
- Do you feel you now have a better understanding of the subject at hand?
Navigation
- Were there any links or buttons that did not work?
- Were all navigational elements marked appropriately?
- Were you able to navigate through the course with ease?
Graphics
- Do you find the graphics helpful?
- Do the graphics appear properly?
- Was text in the graphics clear and visible?
Animation
- Does the animation appear properly?
- Was text in the animation clear and visible?
- Do you find the animation helpful?
Simulations/Interactivity
- Are the soft skill simulations reflective of realistic scenarios?
- Do the simulations, interactive exercises and/or pop-ups function properly?
- Are the software simulations/demonstrations realistic and appear to reflect the actual “live” system?
Assessment
- Do the questions measure your understanding of the content presented?
- Are there questions that address content not presented in the course?
- Are the questions/answers accurate and pose no potential exceptions that could make an answer incorrect?
- Is the feedback provided helpful?
- Does the assessment provide correct scoring results?
Misc. technology
- Does the audio function properly?
- Do the videos function properly and appear professional?
I am sure as time goes on questions will be added and some will be eliminated. What would you include, eliminate or change on this list? Any input would be great.
Given this post, readers will be able to describe my perspective on course objectives to 100% accuracy
If you write clear objectives, make sure your course’s content allows participants to meet those objectives and your assessment measures whether the objectives were met, then you are doing a great job. If not, please give me a minute of your time.
Objectives have a purpose. They are NOT just to tell participants what they will learn at the beginning of a course. I think of them as a contract. It is an agreement between the content and the audience. And the assessment measures whether the contract was fulfilled.
- When writing objects be very clear and thorough of what will be learned. I prefer the ABCD format (Audience, Behavior, Condition, Degree).
- The content must provide all that is needed for the learner to meet the objectives.
- The assessment must measure whether the objectives were met. If the assessment is not tied to the objectives, then you and the learners will not be able to demonstrate if the objectives were met.
If you are writing assessment questions or content that is not “tied” to the objectives, then you must revisit the course’s objectives and determine what additional objective(s) you must add or why you are bothering the learners with irrelevant content and questions.
To be honest, I really get burnt up when there is no thought or concern when writing objectives and especially when assessments do not measure if objectives were met or if learning occurred. This is why I am ranting about it.
Objectives are your best friend when designing a course. Treat them as such.
Thank you.
