October 11, 2014

You Can Get All A’s and Still Flunk Life

by Christine Puschak, PharmD, PGY2 Cardiology Pharmacy Practice Resident, University of Maryland School of Pharmacy
        
Take a moment to think about what is required to lead a “successful” life. Is it knowledge, luck, hard work? How about self-awareness and relationships?1  Success in life often requires all these.  It is our job, as educators, to help students achieve success: in the classroom, in the program, and in their lives. Many of us focus on teaching content-specific material to increase students’ factual knowledge and problem solving skills. However, have you ever thought about increasing students’ self-awareness and relationship management skills?




Emotional Intelligence1,2

Daniel Goleman describes emotional intelligence (EI) as a flexible, intangible concept.2 EI is comprised of four major cornerstones: self-awareness, self-management, social awareness, and relationship management (see Table 1). The four cornerstones allow us to work through a situation by evaluating ourselves and effectively interacting with those around us. These skills focus on recognition and regulation of emotions. EI helps build stronger relationships and success at work by empowering others and leading change. It is a skill required by health care workers as they need to effectively communicate with patients and create a plan that meets a patient’s goals. Healthcare providers must be attuned to the emotions and motivations of their patients and co-workers as they address complex issues. Empathy helps providers understand their patients in a way that improves decision-making.

TABLE 1 – The Cornerstones of Emotional Intelligence


Self
Social
Recognition
Self-Awareness
·  Emotional self-awareness
·  Accurate self-assessment
·  Self-confidence
Social-Awareness
·  Empathy
·  Organizational awareness
·  Service orientation
Regulation
Self-Management
·  Self-control
·  Transparency
·  Adaptability
·  Achievement drive
·  Initiative
Relationship Management
·  Inspirational leadership
·  Developing others
·  Influence
·  Change catalyst
·  Conflict management
·  Building bonds
·  Teamwork & collaboration

Most of us acquire these skills through experience and practice, but how do we teach learners to be emotionally intelligent?  Can it even be taught?

Measurement1

Before we can teach EI, we have to determine if there is a way to measure these skills. Drs. Bradberry and Greaves developed the EI Appraisal questionnaire  — a survey to quickly and accurately assess one’s emotional intelligence quotient (EQ).1 This assessment tool is based on the four major cornerstones of EI. It has shown strong reliability through validation studies. In addition to this test, there are currently nine other assessment tools to determine a person’s EQ, all varying in complexity and utility. The details of each assessment can be found at http://www.eiconsortium.org.

Can I Improve my EQ?1

While our intelligence quotient (IQ) is considered to be rigid and remains relatively unchanged throughout life, EQ often increases with age and experience. Improving your EQ is something that you work on regularly. A change can often be seen within a few months with a measurable difference in EQ score often occurring in three to six months. The key to successful developing your EQ is to start small and work on it incrementally. A person should choose one of the four cornerstones and work to improve that area before moving to another. It is beneficial to first identify which cornerstone requires the most development. The EI surveys and assessments can help one identifying these areas. To increase EQ, it requires self-management and a specific action plans. Ultimately, the responsibility is the learner’s.  Personal growth requires a conscious effort and constant practice.

How Do I Teach EI?

To help learners improve their EQ, a teacher must be aware and cognizant of the skills required for emotional intelligence. If teachers are not aware of or do not understand EI, they can not effectively nurture the development of EI skills in their learners. EI can be built through self-reflection and relationships with others. Thus, teachers must first build their own EQ! Once mastered, there are numerous ways of incorporating the skills into your instruction. Activities to raise awareness of the cornerstones of EI are available in print and electronic media.4

EI skill development exercises increase EQ scores.  In one study, third year medical students were assigned to a seven month EI training program which included individual reflections and group activities.5  A second group of medical students who participate in the study did NOT participate in the EI training program.  The group assigned to the EI program had a substantial increase in mean EQ over time while the comparator group actually had a slight decrease. Although an increase in EQ was observed, the benefits remain unclear. The study reported only changes in the EQ score, which is merely a surrogate marker, and did not follow-up with participant over time.   It would useful to know if the EI program participants did better during their 4th year practice experiences, more likely to match with the first preference for residency training, and if their patients and co-workers believed their were more competent (when compared to those who did not complete the EI program). Clearly we need more data to document the impact of EI training on outcomes.

Theoretically, all health professions, including pharmacists, would benefit from EI skill development and a higher EQ.  Health professional interact with patients and these interactions require trust and effective communication.  I believe that EI skills are best taught through communication-type labs. By making the students aware of their EQ score prior to lab, learners can improve their EI skills by developing self-awareness and working through various patient case scenarios and healthcare situations. Reflective exercises related to uncomfortable interactions — such as an angry patient or a competitive classmate  — may also help learners develop their EQ.  These exercises are intended to help them to acknowledge their thoughts, control their emotions, and think about others. These exercises may help to decrease school-related stress as they learn to assess and adjust their emotions.  EI exercise can also help learners work more effectively with others in the classroom and beyond.

EI is not a skill that can be developed overnight. With the encouragement of emotionally intelligent teachers, students can hone their skills and improve their own EQ, which may enhance their chances of success, both personally and professionally.

References:
  1. Bradberry T and Greaves J. The emotional intelligencequick book: everything you need to know to put your EQ to work. New York: Fireside; 2005.
  2. Goleman D. Emotional intelligence: why it can matter morethan IQ. New York: Bantam Books; 1997.
  3. Daniel Goleman’s five components of emotional intelligence [Internet]. 2009 Feb 9. [cited 2014 Sept 22].
  4. Lynn AB. The emotional intelligence activity book: 50activities for promoting EQ at work. New York: Amacom; 2002.
  5. Fletcher I, Leadbetter P, Curran, et al. A pilot study assessing emotional intelligence training and communication skills with third year medical students. Patient Education and Counseling. 2009;76:376-9.

October 4, 2014

Mobile Devices in the Classroom: What’s Your Policy?

by Benjamin Laliberte, Pharm.D., PGY-1 Pharmacy Practice Resident, University of Maryland Medical Center

Ten years ago, the Boston Globe reported that less than 5% of colleges across the United States required students to purchase personal computers.1  In 2014, things have changed dramatically — 67% of students have two to four mobile devices connected to their campus wireless network.2 In the classroom, 94% of students are now utilizing some sort of mobile technology!

From one perspective, the push to use wireless technology in the classroom is due, in part, to the increasing use of computers and technology in our everyday lives, coupled with the need to provide students the skills to succeed in a “technology-dependent” world.1,2 Moreover, teachers are simply responding to changes in social norms. When companies like Apple, HP, and Samsung roll out new gadgets, everyone seems to jump in line to purchase the latest invention! The integration of classwork with technology can produce interactive, hands-on learning that increases student engagement.  And it provides opportunities for educators to introduce innovative teaching techniques.1-3 On the other hand, it may just be an easier way to deliver content and go (or not to go) to class.

Numerous studies have evaluated the benefits of laptop use in the classroom. One study was conducted at the United States Military Academy in West Point with 527 college freshmen enrolled in ten general psychology classes.3  Six classes served as a control group that did not use laptops and four classes incorporated laptops into classroom activities.  Students used laptops to prepared presentations and share information using a first generation Dropbox. After seven exams, students in the laptop classes had significantly higher scores when compared to the no laptop group (86.8% vs. 83.5%; p<0 .05)

Similarly, a recent study at the University of Michigan, involving nearly 600 students, examined the benefits of a homegrown, web-based software called LectureTools.  Half of the students were given access to LectureTools on their laptops and half were not.4 This interactive program allowed students to ask questions during lectures, take notes, draw on PowerPoint slides, quickly rate the professor’s slides, and review the lecture again after class. At the conclusion of the semester-long study, survey results demonstrated that students in the LectureTools group had self-reported increases in attentiveness (37% vs. 25%), engagement (60% vs. 39%), and learning (53% vs. 40%) when compared to the students who did not have this tool available to them.

Despite these promising results and the increased use of classroom-based technology, it is common for students to become distracted and wander into cyberspace.1-4  In the University of Michigan study, 75% of students in both groups used their laptops for non-course-related tasks, including 35% for social networking and email.4 A survey of law students at three institutions located at geographical diverse areas of the country found that 96% of respondents used their laptops for note taking, but 71% were simultaneously surfing the internet during class.5 While many students take advantage of the available internet access to supplement classroom material, others are abusing the privilege, which can be distracting to those around them.4,5

A 2006 study observed 137 college students in one college general psychology class that permitted laptop use.6  Sixty four percent of the students used their laptop during at least one class period. During class, 81% of the students admitted to checking their email, 43% browsed the Internet, and 25% reported playing games on their computer.  Not surprisingly, there was a negative association between student performance in the class and laptop use (p=0.024). Not only were the students who reported using their laptop in class performing poorer on exams, there was a self-reported decreased attention to lectures (p<0 .01)

Pharmacists and other health care providers often pride themselves in being effective multitaskers. But did you know self-proclaimed multitaskers may actually be worse at multitasking?7,8  One study found that self-proclaimed multitaskers, such those students who actively using laptops during class, performed worse on cognitive memory tasks than students who preferred to focus on a single assignment.6  According to a paper on work-memory capabilities, human ability to multitask and “juggle facts” is limited to seven units. There appears to be a “switching time cost” that occurs when changing your attention, say, back and forth between facebook and a professor giving a lecture.7 Whereas it would normally take two seconds to repeat a single task, balancing two such tasks at the same time may actually take upwards of twenty seconds! Remember that all-nighter in college? Fatigue, in addition to anxiety and other emotional disturbances lessen our ability to multitask and process information efficiently.

Technology is here to stay. It has been shown that laptops can have a positive effect on attention and learning, if used appropriately.1,3,4,9  Our job as instructors is to ensure laptops and other mobile computing devices are not a barrier to our students’ learning.1 Successful teachers will be able to merge effective teaching methods with technology and social media to enhance student learning and comprehension. How? Well, here are a few tips:8
  • Develop a technology use policy. This is a syllabus “must have” so students know your classroom etiquette rules. Are students with laptops and tablet devices allowed to sit in the front two rows?  Or do you have a “laptop/tablet free” zone?
  • Develop in-class activities for students to accomplish using their laptops, tablets, and smartphones. Small group activities, such as patient cases or database research are great ways to engage students.
  • Transforming technology into “audience response systems.” This may include tools like LectureTools or social media such as Twitter for students to ask in-class questions and share articles.  In doing so, you have a better shot at limiting technology use to course-related tasks.


References:
  1. Russell J. Laptops required at 3 state colleges. The Boston Globe. 30 Aug. 2004.
  2. Weldon D. BYOD now a fact of life for majority of college students. FierceMobileIT. 8 May 2014.
  3. Efaw J, Hampton S, Martinez S, Smith S. Miracle or Menace: Teaching and Learning with Laptop Computers in the Classroom. Educause Quarterly. 2004;3:10-18.
  4. Zhu E, Kaplan M, Dershimer RC, Bergom I. Use of Laptops in the Classroom: Research and Best Practices. CRLT Occasional Paper. 2011;30:1-6.
  5. Mazzie LA. Is a Laptop-Free Zone the Answer to the Laptop Debate? Marquette University Law School Faculty Blog. 27 Oct. 2008.
  6. Fried CB. In-class laptop use and its effects on student learning. Computers & education. 2008;50(3):906-914.
  7. Glenn, D. Divided Attention. The Chronicle of Higher Education. 28 Feb. 2010.
  8. Research on In-Class Use of Laptops and Other Devices: Effects on Students’ Learning and Attention. The Teaching Center Journal. 23 Apr. 2013.
  9. Penuel WR. Implementation and Effects Of One-to-One Computing Initiatives: A Research Synthesis. Journal of Research on Technology in Education. 2006;38(3):329-348.

VARK – Know Your Style

By Vicky Shah, Pharm.D., PGY-1 Pharmacy Practice Resident, Suburban Hospital

Developing good study habits as a student is extremely important in order to obtain the knowledge required in school as well as life. To be an effective student, it is imperative that students understand how they learn. The VARK questionnaire is a sixteen-question survey that can assist students do exactly that.1 Whether the questionnaire truly assesses a student’s best method for learning or simply reflects what method he/she currently uses is controversial.2

VARK is an acronym that represents the different categories of preferred sensory methods for learning: V (Visual), A (Auditory), R (Read/Write) and K (Kinesthetic). In completing the VARK questionnaire and identifying how one best learns, a student could then identify how to get the most out of studying. No one particular style is better than another.2 In fact, very rarely do individuals learn by one method alone. There are a few lucky individuals who learn equally through ALL sensory methods; they fall into a category called “multimodal” learners.1,2

Visual!    
Students who are visual learners need to make a few adjustments while they are in class to understand the material. Visual learners, perhaps more than other students, need to attend lecture or procure a copy of the handout.  It can be helpful for visual learners to imagine the words on a slide or highlight and underline key words on the handout for added emphasis. Visual learners experience things with their eyes, such as watching the teacher’s body language and facial expressions to fully understand what’s being presented. They prefer to sit near the front of the class and prefer to see pictures and graphs rather than wordy explanations. Diagrams, illustrations and interactive whiteboards further assist the visual learners.3, 4

As a teacher, we can do plenty of things to ensure that our visual learners have everything they need. We can provide visuals aides, such as graphs or pictures, coupled with words on slides. There is nothing wrong with repeating the same information if you are presenting it differently, such as pictures and words. If the teacher’s preferred method of teaching is through paragraphs on the slides or handouts, try to highlight or underline key words or color code items of importance to help visual learners. 3, 4

Auditory!             
Auditory students prefer learning through discussions, talking through topics, and listening to others explain the material. These individuals use the tone and pitch of a person’s speech to interpret emotion. Students who learn through auditory methods usually listen during lecture rather than diligently take notes. If they try to multitask, they may miss an important message.3, 4

In order to help students who learn through auditory means, teachers need to understand that they cannot just show a slide and say “know this slide.” For students who learn best through hearing, they need to explain their slides so the students can fully understand the information. Teachers can encourage group learning and should allow students to tape record the lecture for further review.3, 4 The act of merely reading an abbreviated version of the material presented can be quite effective for an auditory learner.

Read/Write!                 
Individuals who learn through reading and writing benefit from taking notes, sometimes multiple times.  This can be done by simply rewriting the same thing over and over, or by rewording the material in a different way. Rewriting the notes using different words can help a student understand the concept rather than just memorizing a series of words. Students are encouraged to review their notes every day to ensure continuous absorption of the information. They can also organize graphs into statements rather than trying to be too visual.3, 4 Most read/write learners are also have visual or kinesthetic learning tendencies.

Teachers can assist students who learn by read/write by providing additional resources for students to consult for further explanation regarding the topic.  Teachers may need to slow down a bit to ensure that students who learn through reading/writing have sufficient time to write notes during class.3, 4

Kinesthetic!         
Students who are kinesthetic learners prefer a more hands-on approach. They tend to learn by learning by “doing” something. They like to physically experience the topic, rather than just reading about it, hearing about it, or watching someone else. Many of these students tend to thrive during clinical rotations as they have the opportunity to put their knowledge to use. Hands on experiences are the best method for these students, but they can become distracted by their need for movement and must learn to control this urge or use it for their benefit.3, 4

Teachers can assist by providing opportunities outside the classroom that benefit these students. Lab practicals and clinical experiences allow these students to “do” what they’ve told about in the classroom.  This helps them to understand better than a traditional written exam. Teachers can try to include brief group exercises interspersed throughout their lectures where students can practice counseling or medication preparation in the classroom.3, 4

The VARK questionnaire benefits students by providing them with information on their learning style and preferences. This tool benefits teachers by reminding them that each student is an individual and learns in a different way. By understanding the different ways through which learning occurs, teachers can reach more students and help foster stronger teacher-student relationships.5

References:
  1. Fleming N. VARK -- A Guide to Learning Styles. VARK-LEARN Limited, 1987. Web. 10 Sept. 2014.
  2. Fleming N and Baume D. Learning Styles Again: VARKING up the Right Tree!" Educational Developments 2006; 7: 4-7.
  3. Cherry K. What Are the 4 VARK Learning Styles? About. About Education, n.d. Web. 10 Sept. 2014.
  4. VARK: Learning Styles: Visual, Auditory, Read/Write, Kinesthetic. Southwestern Community College. Web. 10 Sept. 2014.
  5. Fleming N. I'm Different; Not Dumb. Modes of Presentation (VARK) in the Tertiary Classroom. Research and Development in Higher Education, Proceedings of the 1995 Annual Conference of the Higher Education and Research Development Society of Australasia (HERDSA). HERDSA, 1995; 308-13. Web. 10 Sept. 2014.

October 2, 2014

Should Modified Essay Questions Be the Primary Method to Assessing Performance?

By Kim-Ngan Tran, Pharm.D.,  PGY1 Pharmacy Practice Resident, Medstar Union Memorial Hospital

Multiple-choice questions (MCQs) are widely used as the primary means to assess student performance in most pharmacy and medical programs because they are a standardized method that can yield an objective score for a large number of test takers in a short period of time. Medical/pharmacy programs have changed their curricula to include more problem-based learning, which is an essential skill for a clinical practitioner. However, it is quite challenging for teachers to construct good MCQs that evaluate a student’s problem-solving skills.

Let’s discuss the advantages and disadvantages of MCQ and essay exams. MCQ exams are cheap and easy to score.  They can test a breadth of knowledge within a short examination time.  Moreover, it is the most commonly used as an evaluation method for licensure and board examinations.  Therefore, student must get practice with the MCQ format in order to confidently take licensure and board exams.  Another positive effect is that students’ final exam scores often improve because they have been previous tested on similar material during the semester.1 Despite those advantages, MCQs have some weaknesses. There is a risk of students guessing answers and thus the results are not a true reflection of what the student knows. Writing MCQs is very time-consuming and fairly difficult because you would want to produce questions that can evaluate students’ ability to understand and apply concepts — not just recall facts based on memorization. Because of these challenges, many teachers do not return an exam or discuss exam answer keys with students in order to reuse the questions in the future. Thus students are not able to review missed or wrongly answered questions … and thus failing to learn important concepts.1  In contrast to MCQ exam, an essay exam is relatively easier to write and less time consuming for teachers to create. This method provides teachers a better away to assess their students’ thought process, critical thinking, and writing skills. By providing an answer and not selecting choices, guessing is minimized. Nevertheless, grading essay exams is very time consuming and difficult to score objectively. Longer examination times are needed for students to finish an essay exam when compared to a MCQ exam if you wish to test an equal breadth of knowledge. Thus, essay exams are typically used for small classes and when teachers desire to measure students’ problem-solving skills.

Is there another approach?   Is there another question type that has the advantages of both the MCQ and traditional essay exam technique?   The modified essay question (MEQ) was developed by Hodgkin and Knox as an examination tool for the Royal College of General Practitioners.2 MEQ exams include multiple problem-solving questions that are designed to test higher cognitive skills and can be consistently, objectively, and efficiently scored. By using MEQs, teachers can measure the knowledge retained and evaluate the students’ thinking and reasoning skills.2,3 A typical MEQ provides a clinical scenario and one or more short answer questions based on Bloom’s taxonomy (memorizing, understanding, evaluating, analyzing, and creating).4,5 For example, instead of using MCQ to test students about chronic obstructive pulmonary disease, a teacher could use MEQ to assess students’ ability to evaluate and provide an appropriate treatment plan for a patient scenario (Table 1). Students have to understand signs and symptoms related to the disease state and how to diagnose that condition. Then, they must apply their knowledge to develop an individualized treatment plan.

Table 1: Example MEQ
A 56 year old African American male presents to the emergency department with a complaint of worsening shortness of breath and cough for two weeks. He is a smoker with 40 pack year history. His past medical history includes hypertension, diabetes, hyperlipidemia, chronic obstructive pulmonary disease (COPD), and obstructive sleep apnea.
  1. List the differential diagnoses based on this patient’s symptoms?
  2. List the laboratory tests needed to confirm the diagnosis?
  3. What is the best initial treatment plan for this patient?
  4. After 3 days, the patient is stable and can be discharged. What is the best discharge treatment plan for this patient? State the current guideline that supports your answer.

To ensure the quality of the exam, questions must be relevant, valid, reliable, and objective. Teachers should define intended learning objectives to be assessed by each question. Patient cases should be clearly developed, include the relevant data needed to answer questions, and avoid extraneous information. MEQs should not be long.  Ask a colleague  to review the exam and provide suggestions to improve the questions. The common problem of essay exams is that grading may not be standardized. To address this problem, teachers should have key answers for all questions and assign a specific number of points to each. Then, if a student’s answer matches the keyed answers, he/she will get full credit. Partial credit can be given if a question contains more than one part; therefore, each answer must be assigned points in the key. The duration of the exam and the amount of time allotted to each question is important because if you do not give students enough time to answer questions, they will perform poorly and you can’t evaluate the students’ actual performance.

The MEQ model will work better if a teacher has help from a teaching assistant (or colleague) to grade all the responses. MEQs should only be used in a class that requires students to build higher-order thinking skills. Clearly, Pharmacotherapy and therapeutics course are intended to build critical thinking and decision-making skills.   These would be appropriate environments to use MEQ to evaluate students’ clinical knowledge.

References
  1. Roediger H, Marsh E. The positive and negative consequences of multiple-choice testing. J Exp Psychol Learn Mem Cogn. 2005;31: 1155-9.
  2. The Boards of Censors of the Royal College of General Practitioners. The modified essay question. J Roy Coll Gen Practit. 1971;21: 373-6.
  3. Stratford P, Perice-Fenn H. Modified essay question. Physical Therapy. 1985;65: 1075-9.
  4. Khan M, Aljarallah B. Evaluation of modified essay questions (MEQ) and multiple choice questions (MCQ) as a tool for Assessing the Cognitive Skills of Undergraduate Medical Students. International Journal of Health Sciences. 2011;5: 39-43.
  5. Palmer E, Devitt P. Assessment of higher order cognitive skills in undergraduate education: Modified essay or multiple choice questions? Research paper. BMC Medical Education. 2007;7:49.