Podcasts: Don’t You Forget about Me

by Kashelle Lockman, Pharm.D., PGY1 Pharmacy Practice Resident, University of Maryland Medical Center

I stumbled upon the joys of podcasts when I was trying to make the DC and Baltimore traffic more bearable. Now I say, “Traffic is backed up for 10 miles due to a car crash? Whatever - I will just sit here and enjoy my podcast.” Of course, I started with podcasts for fun, such as This American Life, Car Talk, Writer’s Almanac, and Wait, Wait Don’t Tell Me. Then, as a fourth year student, I realized I could listen to medically oriented podcasts as a way to keep up with new studies and guidelines. This became especially useful as a PGY-1 resident. I recently found myself short on time to prepare for a topic discussion on JNC8 (the new hypertension guidelines). Well, there’s a podcast for that! After listening to it on my way home, I was able to more quickly review the guideline document and prepare my notes for the discussion. Since I love learning from podcasts so much, I suspect other learners might find them useful too.

A recent study in the Proceedings of the National Academy of Science found that STEM students who sat through traditional lectures were 1.5 times more likely to fail than students who were taught by professors that incorporated active learning techniques.¹ However, incorporating active learning can be a challenge given the large volume of material educators must cover in a pharmacy curriculum. While perhaps not as flashy as video podcasts (aka vodcasts or vidcasts) with their dual audio and visual components, we shouldn’t forget that podcasts are a useful tool to free up time for active learning and flip the classroom. Podcasts are easier to create than vodcasts, take up less computer / device memory, and allow the listener to multitask, to a certain extent. Commuting, dishwashing, and laundry folding can be turned into productive, intellectually stimulating time with a great podcast on your mobile device! Don’t get too carried away with trying to multi-task though, lest you interfere with your ability to process and learn new information! (See The Multi-tasking Myth: Technology Use andInstruction Outcomes by Brent Reed, Pharm.D., BCPS for more information.)

When podcasts were first introduced as a teaching tool in higher education, they were largely viewed as an add-on learning tool to a traditional lecture.  Many studies demonstrated their utility when used by students to review material.² In one recent study, dental students who received supplemental podcast instruction were shown to have statistically significant improvement in scores on a multiple-choice test with 91.3% of the students reporting the podcasts were useful.  However, 63% thought a podcast would be inferior to having audio and video.³ The effectiveness of podcasts versus vodcasts has not been evaluated but a study where lectures were offered through Mediasite (video) and as podcasts, more students accessed Mediasite recordings than listened to podcasts.  Thus, students appear to prefer video to audio only formats. But educational outcomes were not measured in this study.⁴

Some educators have evaluated the use of podcasts as a replacement for traditional lectures. In 2013, a small study (n=35) found that undergraduate nursing students who listened to a 51 minute pharmacology podcast broken into 3 separate segments scored higher on a multiple-choice and case-based assessment than did students who received the same material via a traditional face-to-face lecture or a continuous, non-segmented podcast. The difference in scores did not meet statistical significance (due to the small sample size) but there was a clear trend. It should be noted that the study did not include a student group taught using a series of short, segmented face-to-face lectures – but, lets face it, that’s probably not practical in terms of room scheduling.²

Podcasts are not just used for formal education in degree programs; many professional societies and journals deliver new research and guidelines through podcasts. The Society for Critical Care Medicine (SCCM) was the first to produce a podcast for a national medical society; its podcast iCritical Care features interviews with leaders in the field of critical care medicine. Both the New England Journal of Medicine and the Journal of the American Medical Association offer weekly podcasts summarizing their latest issues. The American Journal of Health-System Pharmacy produces a podcast that features studies it publishes. Other pharmacy news sources with podcasts include Pharmacy Times and Pharmacy Practice News. Assigning students a podcast versus a reading would introduce them to this technology as a potential method for engaging in continuing professional development after graduation. These podcasts can be found in the iTunes store.

If you want to make your own podcast to supplement or replace a classroom activity, it’s both easy and affordable. Audacity is free software that allows the creation and editing of audio files. It’s available for numerous operating systems, including Mac, Windows, and Linux. If you have a Mac, you have built in audio creation and editing software — Garage Band comes on all Macs and can be used to create and export podcasts. If ambient noise interferes with your recording, you can use a USB headset with a microphone.

Podcasts can be delivered through a secure Learning Management System, such as Blackboard, or they can be made freely available on the web. The latter option allows use of Really Simple Syndication (RSS), so students can subscribe and receive updates as new podcasts are uploaded. Rosalind Franklin University College of Pharmacy shares its podcast, Helixtalk, using the latter option. In either case, it is important to review how to access and download podcasts with students as knowing how to use the technology can be a barrier for some students.⁵ It might also be helpful to highlight that podcasts can be downloaded to mobile devices. In a study of nursing students, 70% of students who listened to podcasts played them on a computer, even though 73% of the students had mobile devices capable of MP3 playback.⁶ This indicates students may not know or appreciate the advantage of mobility offered by a podcast.

While podcasts don’t provide visual information like vodcasts, they can be used to augment live classroom activities, video, and readings. Rosalind Franklin College of Pharmacy’s podcasts focus on information relating to the Top 200 drugs and provide students with an additional way to review material. Similarly, short podcasts could be used to highlight essential material from a course, clinical controversies, or provide clarification on those muddier points that baffled students during lecture. By introducing podcasts as an educational resource in the classroom, educators can expose students to a technology they can use to stay abreast of new knowledge for the rest of their careers. I look forward to including podcasts among my learning assignments as I embark on my career in pharmacy education.

References

1. Freeman S, Eddy SL, McDonough M, Smith MK, Okoroafor N, Jordt H, Wenderoth MP. Active learning increases student performance in science, engineering, and mathematics. Proc Natl Acad Sci U S A. 2014;111(23):8410-5. 
2. Abate K. The effect of podcast lectures on nursing students' knowledge retention and application. Nurs Educ Perspect. 2013;34(3):182-5.
3. Kalludi SN, Punja D, Pai KM, Dhar M. Efficacy and perceived utility of podcasts as a supplementary teaching aid among first-year dental students. Australas Med J. 2013;6(9):450-7.
4. Pilarski PD, Johnstone DA, Pettepher CC, Osheroff N. From music to macromolecules: Using rich media/podcast lecture recordings to enhance the preclinical educational experience. Med Teach. 2008;30(6):630-2.
5. Meade O, Bowskill D, Lymn JS. Pharmacology podcasts: A qualitative study of non-medical prescribing students' use, perceptions and impact on learning. BMC Med Educ. 2011;11:2.
6. Mostyn A, Jenkinson CM, McCormick D, Meade O, Lymn JS. An exploration of student experiences of using biology podcasts in nursing training. BMC Med Educ. 2013;13:12.

Finding Success in Productive Failure

by Thao K. Huynh,  PGY2 Oncology Pharmacy Practice Resident, University of Maryland School of Pharmacy

Learning is an activity that requires our undivided attention. Learning a novel or unfamiliar concept often involves struggle, which is a necessary component to critical thinking. A teaching method that causes a greater amount of struggle will lead to more learning as exemplified by productive failure.

According to Manu Kapur, productive failure engages students in differentiating prior knowledge from features of the new concept.¹ In using productive failure as a teaching strategy, there are two phases. The first phase requires students to generate and explore, while the second phase encourages them (with the help of the teacher) to consolidate and assemble new knowledge. In the first phase, teachers must discern what students know about a novel concept that hasn’t yet been formally taught. During this phase, a complex problem is presented collaboratively amongst students. During the second phase, the novel concept must be consolidated and presented with direct instruction in a structured way.²

In order to test this method, Kapur conducted a classroom-based research experiment comparing direct instruction with productive failure. In an all-boys school in Singapore, seventy four ninth grade students were taught about the mathematical concept variance in two different ways. Students were tested prior to the intervention to evaluate their pre-existing knowledge and it was similar at baseline in both groups. In one classroom students were provided direct instruction (DI).  In the other classroom, students in the productive failure (PF) group were provided no instruction or guidance. The two classes differed in that the DI class of 35 students participated in four 55 minute periods of instruction where the teacher explained the concept of variance, modeled the application of the concept by working through problems with the class, and highlighted pitfalls and misconceptions. Students in this class were able to work through problems in triads followed by a discussion of the solutions by the teacher. DI students were assigned homework after each class to reinforce the topic. In contrast, the PF class was not provided direct instruction during the first two periods. Instead, students worked in triads to solve one of the problems on their own. In periods three and four, PF students were provided the same direct instruction but the teacher also compared and contrasted student solutions and explained the solution in a manner similar to the DI class.  The PF class were given and solved fewer problems than did students in the DI class.   Moreover, students in the PF class were not given homework. Following this period of instruction, both groups of students took the same exam.  All students performed similarly overall – however, students in the PF group outperformed students in the DI group on the conceptual insight and data analysis portions of the exam.¹

Although, it can be argued that students in the productive failure group outperformed the direct instruction group due to a greater amount of time devoted to to studying the concepts; their performance is likely related to the amount of time and energy put forth into delving critically into the topic.

Productive failure can be used in the pharmacy curriculum and clinical pharmacy practice to help enhance learning experiences.  Incorporating productive failure may work in a group setting such as Abilities or Practice Lab, case discussions, and problem-based learning courses.  Students in these small learning groups naturally (without direct instruction) have some prior knowledge on the topic.  Productive failure will facilitate development of their critical thinking skills.  Allowing student to struggle is critical to the process.  This sets the stage for the instructor to introduce new concepts to students. This environment, according to Collins, leads “metacognitive scaffolding, contrasting cases, peer-interaction scripts, mixed-ability groups, and perhaps representational scaffolding in the intervention phase will enhance student learning in the [direct] instruction phase.”³ Furthermore, a lack of struggle can lead to detrimental outcomes.  For example, in a study that observed nurses on a patient care unit, when problems arose, instead of analyzing the situation, they opted for quick (but less than optimal) solutions.⁴

I believe productive failure is most useful when there is sufficient time to explore different solutions to a complex problem. If time is critical, productive failure may be detrimental. In addition, for productive failure to have the greatest benefit, learners should have some baseline knowledge on the topic.  In other words, the new concepts must be related in someway to the students prior knowledge.  If the new concepts are too foreign, students might not be able see the connections between their prior knowledge and the new knowledge.  I’ve encountered a recent situation where productive failure would not have worked well. An oncologist wanted to use equine thymoglobulin for a critically ill patient with steroid refractory acute graft-versus-host disease post stem cell transplant.  The drug needed to be administered as soon as possible. Not being an expert in this topic and having never seen horse thymoglobulin used before, I needed to clarify this with my preceptor. I found a review article on the topic but my preceptor needed to provide guidance. In this situation, using productive failure as a strategy to learn a novel concept without any instruction would have caused further delay in patient care as well as the potential for patient harm. On the other hand, productive failure worked with two students I asked to lead a topic discussion. The topic was acute myeloid leukemia, which neither student had any previous knowledge. I began with few patient cases for the students to read and discuss with one another.  After the students had an opportunity to struggled through the patient cases, I provided a formal one-hour interactive presentation. I measured the success of how well the students applied the information to direct patient care situations.  I saw a dramatic increase in knowledge from both students and they were able to provide appropriate recommendations to the patient care team.

Looking for ways to improve the way you teach?  Embracing the productive failure method will facilitate learning by encouraging learners to differentiate new concepts from prior knowledge and to be analytical in applying these new concepts.

References

1. Kapur M. Productive failure. Cognition and Instruction. 2008 Jul;26(3):379-424.
2. Kapur M, Toh PLL. Educational design research – Part B: Illustrative cases. Enschede, the Netherlands: T. Plomp, & N. Nieveen (Eds.); c2013. Chapter 17, Productive failure: From an experimental effect to a learning design; p. 341-355.
3. Collins A. What is the most effective way to teach problem solving? A commentary on productive failure as a method of teaching. Instr Sci 2012;40:731-735.
4. Edmondson AC. Learning from failure in health care: frequent opportunities, pervasive barriers. Qual Saf Health Care 2004;13(Suppl II):ii3-ii9.

Bullet-proof: Rethinking PowerPoint Presentations

by Sharon Martin, PharmD, PGY-1 Pharmacy Practice Resident, University of Maryland Medical Center

Learners of my generation have seen the transformation from a classroom full of students focused on the chalkboard/whiteboard to one full of laptop computers with all eyes on the instructor’s PowerPoint slideshow. As a recent graduate, I witnessed this transition and found slideshow lectures often “death by PowerPoint.” PowerPoint-based lectures were the norm in most of my pharmacy school courses.  Students expected every bit of information they needed to know to be written directly on the slides.  But many educators feel that learners lose the big picture when focusing on these small details.  PowerPoint presentations can be impersonal and discourage active student participation.¹ Thus, the effectiveness of this teaching method has been questioned by a number of educators.^1,2 Studies have shown that active learning improves student performance.²  Traditional lecturing (similar to many PowerPoint presentations of today) results in higher student failure rates, particularly in science, technology, engineering, and mathematic courses.²

One element of PowerPoint slide decks that has received particular attention is the use of bullet points. In his discussion on PowerPoint design, David Farkas outlines the major arguments against bullet points, but rejects the idea that bullet points are inherently detrimental to instruction.  Bullet points tend to over-simplify the ideas of the presenter.  The hierarchy in which the presenter organizes the bullet points potentially confuse the audience.  And slides with lots of bullet points encourage the audience to read the slides instead of listening to what the presenter has to say.³  Given that these potential problems, how could one use PowerPoint in a more constructive way and avoid bullet points? A recent presentation moved me to reflect on how revamping presentations can turn PowerPoint slideshows from a method for passive information transmission to an engaging and active method of instruction.

Get the picture? - Key principles

Dr. Penciner offers up an antidote to the “death by PowerPoint” approach to teaching. In his discussion of instructional design, he provides simple suggestions for developing more effective presentations. His approach is designed around three key principles: tell a story, keep it simple, and manage your flow.^4,5

Tell a story

Storytelling has long been an educational tool, but the art of storytelling has been lost today. Storytelling allows professionals to imagine real life scenarios and to better understand their role in practice.⁶ Modern instruction can employ new technology to enable “digital storytelling” where multimedia (video, music, etc.) is used to tell stories.^6,7 Penciner encourages educators to use PowerPoint to augment the narration of a story by using slides of images that represent the actions or subjects of the story.^4,5 In educating health professionals, storytelling using PowerPoint might consist of an image of a patient (fictional or with the patient’s permission!) with the presenter discussing the patient’s “story” or medical history with the class.

Keep it simple

The principle “keep it simple” will help make your presentations “bullet proof.” As Farkas points out, presentations have historically lent themselves to the bullet point format as presenters have a number of key points they hope to get across to the audience.³ Penciner suggests that these key points can be more effectively portrayed using images. Using images rather than words encourages the audience to focus on what the presenter is saying rather than reading the slides.  In turn this allows the audience to more effectively remember the message of the presentation.^4,5  In practice, how do you keep it simple? Re-format each slide with three (or more) bullet points and separate each “point” onto its own slide (for a total of 3 slides).  Find an image that represents that point.  Then cut the wording down to one to three words that clearly state the central message.

Manage your flow

In order to manage the flow of your presentation and use simple slides as described, there are two additional documents you should have available. The first is a set of presenter’s notes which outline the information you want to discuss with each slide. This document serves two purposes: 1) to keep you on track during your presentation (although ideally you should have practiced enough to not need these notes in the middle of presenting) and 2) to reference if asked to present the same material in the future.⁴  The second document is a handout to be shared with the audience.  This is a general outline of the material you will discuss during the lecture, provides space for note taking, and may include additional words to support your audience.  This document should be used by students to study the material at a later point.⁴

Armed with these principles, let’s change those bullet points into images.  Let’s use PowerPoint as it was intended – a tool for effective presentations and audience engagement.

References

1. Reynolds G. Presentation Zen: How to design & deliver presentations like a pro. (accessed June 06, 2014).
2. Freeman S, Eddy SL, McDonough M, et al. Active learning increases student performance in science, engineering, and mathematics. Proc Nat Acad Sci 2014 Early Edition (doi: 10/1073/pnas)
3. Farkas D. A heuristic for reasoning about PowerPoint deck design. (accessed June 06, 2014).
4. Penciner R. Does Powerpoint enhance learning? CEJM 2013;15(2):109-112.
5. Penciner R. Nine words you need to know for a more effective presentation. (accessed June 06, 2014)
6. Matthews J. Voices from the heart: the use of digital story telling in education. Community Pract 2014;87(1):28-30.
7. Bernard R. What is digital storytelling? Educational Uses of Digital Storytelling.  University of Houston, College of Education. (accessed June 08, 2014)

Soft Skills Are Important Too

by Chelsea McSwain, Pharm.D., PGY1 Pharmacy Practice Resident, Holy Cross Hospital

Soft skills vs. hard skills…what is the difference?  Soft skills are those personal qualities and interpersonal abilities that are needed to relate to other people and work in groups.¹ In contrast, “hard skills” are those skills that are essential to job function and can more easily be quantified.  For pharmacists hard skills include filling and checking the accuracy of prescriptions, calculating doses, and recalling information about drug therapy.  The pharmacist’s soft skills would include communicating effectively, critical thinking, problem solving, teamwork, time management, conflict management, cultural awareness, responsibility, leadership, and work ethic (to name but a few!).  These skills, although often under-appreciated, are essential to a successful career in pharmacy.  Unfortunately, these important skills are frequently overlooked and have been historically de-emphasized in pharmacy curricula.

A recent editorial by Dr. Cynthia Boyle in the American Journal of Pharmaceutical Education (AJPE) titled “Leadership is Not a Soft Skill” discusses the importance of emphasizing leadership in pharmacy education.² She argues that leadership development is a lifelong process – the time and dedication required to master self-efficacy, self-assessment, reflection, entrepreneurship, and advocacy does not happen overnight.  The importance of leadership, rooted in the social and administrative sciences, has diminished in recent years and was placed on the “back burner” relative to the other two core areas of pharmacy education – clinical and pharmaceutical sciences.  Boyle argues that there needs to be more emphasis on the affective domain as we design and develop pharmacy curricula and courses.³

The Center for the Advancement of Pharmacy Education (CAPE) released its revised educational outcomes in 2013.  The new CAPE outcomes document addresses feedback that called for the “inclusion of an affective domain that would address personal and professional skills, attitudes, and attributes required for the delivery of patient-centered care.”⁵ The educational outcomes are centered around four domains, including 1) foundational knowledge, 2) essentials for pharmacy practice and patient-centered care, 3) effective approaches to pharmacy practice and care, and 4) the ability to develop personally and professionally. The document cites self-awareness, leadership, innovation, entrepreneurship, and professionalism as key outcomes in this fourth domain.⁵ These outcomes have been included in the 2016 American Council for Pharmacy Education (ACPE) Draft Accreditation Standards, and if accepted, it will be a requirement for all pharmacy schools and pharmacy educators to ensure that graduates of Doctor of Pharmacy curricula have achieved them.⁶ At the American Society of Health-System Pharmacists (ASHP) Midyear Clinical Meeting 2013, the proposed revised PGY1 Pharmacy Residency Accreditation Standards were discussed at a town hall session.  In the draft standards, a new competency domain was articulated: Professionalism, Leadership, and Practice Management.⁷ As a participant in the town meeting, I noted that many speakers advocated for increased emphasis on these competencies.  It makes sense that all three major bodies in pharmacy education have proposed changes. 

With revised standards on the horizon with a renewed emphasis on “soft skills”, educators should be aware of the impact that this may have on instructional design and curriculum development.  Boyle notes that with the addition of these new expectations, we will be exposing a “hidden curriculum” – skills for which students have not been held directly accountable will now become major components of the formal curriculum. Students will need to develop their knowledge and skill through need guided learning opportunities and teachers will need to develop learning materials.  This poses significant challenges — how does one teach soft skills like leadership, professionalism, and advocacy? Perhaps it is not the act of teaching such skills that is the challenge, but a lack of effective evaluation and assessment tools that pose a problem.  Sorenson et al. piloted an elective course at the University of Minnesota that taught leadership skills to students.⁸ They utilized an end-of-course evaluation and focus groups to evaluate instructional design and student reactions to the learning experiences.  This may be the key to “evaluating” pharmacy leadership.  While it is difficult to objectively assess another person’s leadership skills, encouraging students to self-assess and reflect on the core components of leadership may well prove to be a key element of leadership education.  

With the evolution of new standards and a focus on the affective domain, graduates will (hopefully) possess not only the knowledge and clinical skills needed to care for patients but also the soft skills to lead and advocate for change. 

References

1. Schulz B. The importance of soft skills: education beyond academic knowledge. NAWA Journal of Language and Communication 2008;146-154. 
2. Boyle CR, Robinson ET.  Leadership is Not a Soft Skill. Am J Pharm Educ. 2013;77(10):Article 209. 
3. Clark DR. Bloom’s Taxonomy of Learning Domains. Accessed February 17, 2014.
4. Bradley-Baker LR, Murphy NL. Leadership Development of Student Pharmacists. Am J Pharm Educ. 2013;77(10):Article 219
5. Medina MS, Plaza CM, Stowe CD, et al. Center for the Advancement of Pharmacy Education (CAPE) Educational Outcomes 2013. Am J Pharm Educ. 2013;77(8):Article 162. 
6. Accreditation Standards and Key Elements for the Professional Program in Pharmacy Leading to the Doctor of Pharmacy Degree [draft]. American Council for Pharmacy Education. 2016; in progress. 
7. Annotated PGY1 Pharmacy Residency Accreditation Standards Revision Drafts, For Comment and Feedback. American Society of Health System Pharmacists. Dec 2013. Accessed May 10, 2014.
8. Sorenson TD, Traynor AP, Janke KK. Instructional Design and Assessment: A Pharmacy Course on Leadership and Leading Change. Am J Pharm Educ. 2009;73(2):Article 23.