All about Q – using a novel course evaluation to drive course evolution
Jul 11, 2024
10:00AM to 12:00PM
Date/Time
Date(s) - 11/07/2024
10:00 am - 12:00 pm
Led by Bruce Wainman, Noori Akhtar-Danesh, & Danielle Brewer-Deluce
McMaster University
Have your course evaluations left you wondering how the information will better your course? Course evaluations should be a productive venture, but in practice, they seldom lead to improvement. In reality, the quantitative ratings offered by Likert-scale questions are vague, and often subject to a ceiling effect, while written qualitative feedback, when present, is difficult to interpret and often represents the opinions of an invested few. Ultimately, this leaves few actionable refinements to pursue.
Fortunately, there is another way – Q-methodology. Through asking students to rank-order a series of evaluative statements (as opposed to rating them on a scale) and explain their answers, Q-methodology quantitatively identifies clusters of shared preferences, values and opinions which broadly reflect the sample and qualitatively justifies their meaning (1-3). Together, areas of course strength/improvement are identified, and meaningful evidence-based course reform can be initiated.
In this workshop we will use a hybrid of didactic and participatory learning to offer background information alongside opportunities for practical application and reflection. Specifically, we will break down the three components of Q-methodology studies (survey/tool development, data collection, analysis and interpretation) via short segments of lecture-style content, and then use small-group activities to apply these concepts to real, and collaboratively generated data. We’ll then transition into a case-study outlining our successful use of Q-methodology to revise courses (1-3), and then close with individualized reflection allowing attendees to contextualize the workshop within their educational context.
In all, by participating in this workshop, attendees will be able to:
- outline how a Q-methodology study is conducted,
- compare/contrast Q-methodology findings with traditional Likert results outlining a practical potential for course evaluation to lead to course evolution.
- participate in the creation, application and interpretation of a Q-methodology study, and
- develop strategies for employing Q-methodology in their own educational context.
Drs. Bruce Wainman, Noori Akhtar-Danesh and Danielle Brewer-Deluce are a research team from the Education Program in Anatomy and School of Nursing at McMaster University. Together, they pursue course-reform related questions via Q-methodology studies to help unlock the potential for evidence-based advances within the classroom. Combined, they boast nearly 50 years of experience in Q-methodology with expertise hailing from statistical design (including Q-methodology specific programming! – NAD), anatomical sciences and education pedagogy (DBD & BW). Currently, Bruce is a professor in Pathology and Molecular Medicine within and the Director of the Education Program in Anatomy and Surgical Skills Program, Noori is an associate professor of Nursing as well as the Health Research Methods, Evidence and Impact Program and Danielle is an assistant professor in Pathology and Molecular medicine working within the Education Program in Anatomy. With a shared interest in evidence-based improvements, pedagogy and course design, they’re delighted to bring you this course furthering workshop.