Research | Open | Published:
An educational intervention for medical students to improve self-efficacy in firearm injury prevention counseling
Injury Epidemiologyvolume 6, Article number: 27 (2019)
Most physicians support counseling patients about firearm injury prevention (FIP), but infrequently do so due to lack of training and low confidence. Interventions to increase counseling frequency should focus on improving physician self-efficacy. Firearm injuries affect many clinical specialties; therefore, trainees would benefit from early FIP education. This study aims to determine if a 20-min educational intervention improves self-efficacy in FIP counseling in third-year medical students. Knowledge and beliefs were also assessed as secondary indicators of self-efficacy.
This was a prospective study performed at a medical school associated with a tertiary care children’s hospital during the 2016–17 academic year. Groups of 12–15 different third-year medical students were selected to receive either a 20-min intervention or control lecture during their monthly pediatric lectures. The intervention consisted of two clinical vignettes, a brief discussion about the importance of FIP, and suggestions for clinical integration. The control session was a case-based lecture about pediatric emergencies. Participants completed baseline electronic assessments. Intervention students also completed post-intervention assessments immediately following each session. All participants completed final assessments at 6 months. Data were analyzed using Wilcoxon signed-rank tests and Wilcoxon rank-sum.
We surveyed a total of 130 students. Sixty-five students completed the entire series of assessments – 22 from the control and 43 from the intervention group. There were no significant differences between the control and intervention groups at baseline. Immediately after, intervention, participants reported feeling more self-efficacious, had improved knowledge of FIP risk factors, and had beliefs more consistent with providing FIP anticipatory guidance (p < 0.001 for all three measures). After 6 months, participants sustained improvement in one of two self-efficacy questions (“I feel ready to counsel patients about firearm injury prevention”) and retained knowledge of risk factors (p < 0.05 for both). However, their beliefs did not significantly favor FIP counseling, and they were not more likely to engage in a conversation about firearm safety.
A 20-min educational intervention acutely improved self-efficacy in FIP counseling in third-year medical students, but improvements weakened after six months. Without further training, the beneficial effects of a one-time intervention will likely wane with time.
In 2016, firearm injuries were the leading cause of death for 15- to 24-year-olds in the US (Web-based injury statistics query and reporting system 2018). Both fatal and non-fatal injuries impose a significant economic burden on society and devastate families and healthcare institutions (Lee et al. 2014; Fowler et al. 2015; Russo et al. 2016). Providing care to patients with firearm injuries is often multifaceted and involves multiple disciplines within healthcare (Avraham et al. 2018; Bayouth et al. 2018; Tasigiorgos et al. 2015; Greenspan and Kellermann 2002; DiScala and Sege 2004).
Most physicians agree on the need to address firearm injuries and believe that physicians should have an active role in prevention counseling (Betz et al. 2013; Grossman et al. 1995; Roszko et al. 2016; Solomon et al. 2002; Cassel et al. 1998). However, despite overwhelming support, physicians still do not regularly counsel their patients about firearm injury prevention (FIP) (Solomon et al. 2002; Cassel et al. 1998; Olson et al. 2007). In fact, most physicians reported low confidence in FIP counseling and inadequate or low rates of FIP training demonstrating an important deficiency in medical education (Butkus and Weissman 2014; Cheng et al. 1999; Finch et al. 2008; Price et al. 1997a; Price et al. 1997b; Price et al. 2010; Khubchandani et al. 2009).
Physician self-efficacy in counseling is related to the likelihood of counseling behaviors in practice and specifically appears to be a key determinant of FIP counseling (Solomon et al. 2002; Cheng et al. 1999; Finch et al. 2008). Physician beliefs and knowledge about FIP are also important components that influence and inform counseling behaviors, and have been studied as elements that directly contribute to self-efficacy (Abraham et al. 2001; Dingeldein et al. 2012).Therefore, educational efforts aimed to improve counseling behavior and practices should focus on improving self-efficacy in providing anticipatory guidance as well as supportive knowledge content.
Several studies have been published investigating FIP training and intervention outcomes (Abraham et al. 2001; Dingeldein et al. 2012; Barkin et al. 2008a; Hamilton et al. 2014). Though improvements in self-efficacy were reported, these studies were limited to pediatric residents. Given the broad scope of firearm injuries, including FIP training in undergraduate medical education may be ideal.
Our study aims to determine if a 20-min educational intervention improves FIP counseling in third-year medical students. In addition to reported counseling behavior, we assess student self-efficacy as our primary indicator of counseling behavior. We also evaluate student beliefs and knowledge as secondary indicators contributing to self-efficacy. Our intervention focuses on limiting children’s access to firearms by advocating for proper firearm storage as a means of reducing injuries (Grossman et al. 2005; Shenassa et al. 2004; Barkin et al. 2008b).
This was a prospective, interventional study performed during the 2016–17 academic year at an academic medical school. Groups of 12–15 different third-year medical students attended a monthly lecture series during their pediatric clerkship rotation (Fig. 1). Each month, students received either a 20-min intervention or control lecture, depending on the scheduled speaker for that month. The intervention was developed and presented by medical students in conjunction with an attending pediatric emergency medicine physician. The intervention consisted of two clinical vignettes, a summary of FIP legislation and epidemiology, a brief discussion about the importance of FIP, and suggestions for clinical integration, including recommendations from the ASK campaign (www.askingsaveskids.org). Students who received the intervention were also given cable gun locks, provided by Master Lock™ (Model #107KADSPT, Milwaukee, WI) in partnership with the Emergency Nurses Association, at the end of the presentation. Locks were provided to students to encourage them to engage in a conversation about FIP with someone and give them the lock. Each lock came with a standard instruction handout. Participants in the intervention group were also provided with additional web-based resources immediately after the intervention. The control lecture was a standard case-based lecture about pediatric emergencies. Participants in the control group were also provided with the same web-based resources after completion of their 6-month assessments.
Study design and assessments were based on a previous study by Dingeldein et al. with alterations to coordinate with clerkship schedules and time limitations (Dingeldein et al. 2012). All study participants completed baseline electronic pre-intervention assessments. Participants in the intervention group also completed post-intervention assessments immediately following the session. All participants completed 6-month follow-up assessments to evaluate long-term effects of the intervention. Six-month follow-up assessments were sent to participants’ institutional emails six months after each corresponding lecture. A maximum of three emails were sent to participants to collect 6-month assessments. Participation in the intervention was voluntary, and all students were given the opportunity to opt out, but were encouraged to participate. Investigators were provided with the number of students scheduled to attend each lecture by the clerkship coordinator, but, all students who opted out or were absent could not be identified. All assessments were created and disseminated via SurveyMonkey™ (San Mateo, CA).
All assessments evaluated participants’ perceived self-efficacy about FIP counseling, beliefs about FIP, and knowledge of risk factors as contributory indicators of FIP counseling behavior. Self-efficacy and belief questions used a 5-point Likert scale (1 = strongly disagree, 5 = strongly agree) while knowledge was evaluated by a 6-question survey (Fig. 2). Basic demographic information, previous experience with firearms, and participants’ institution emails were also collected. Institutional email addresses were collected in all assessments for tracking responses for statistical analysis and disseminating follow-up material (6-month assessments and web-based resources). Institutional email addresses often contained surnames of participants, but care was taken to minimize any other potentially identifying information as well as to maintain anonymity of their responses. Finally, 6-month follow-up assessments asked all students if they had a conversation about firearms with someone in the past 6 months. This study was approved by the Institutional Review Board at the Medical College of Wisconsin.
Patterns of survey completion were reported. For all statistical tests, missing data were excluded via list-wise deletion, which assumes missing values are missing completely at random. Descriptive statistics were calculated for all demographic characteristics and assessment responses including mean, median, standard deviation, and range for continuous variables and frequency and percent for categorical variables. Baseline participant characteristics and assessment responses were compared between control and intervention groups using Wilcoxon rank-sum tests for continuous variables and Fisher’s exact tests for categorical variables. For the intervention group, pre- and post-intervention assessment responses and total quiz score were compared using Wilcoxon signed-rank tests. Pre- and 6-month assessment responses and total quiz scores were compared within control and intervention groups using Wilcoxon signed-rank tests. The change in scores (6-month – Pre) were compared between control and intervention groups using Wilcoxon rank-sum tests. All statistical analyses were performed using R version 3.3.1 (R Foundation for Statistical Computing, http://www.R-project.org). All p-values were 2-sided and p less than 0.05 was considered statistically significant.
We surveyed a total of 130 out of 139 students—54 from the control and 76 from the intervention—scheduled to attend the lecture series from the Class of 2018. Nine students either opted out or were absent on the day of the lecture and did not complete assessments. Of the 130, two from the control and one from the intervention were excluded immediately due to incomplete pre-session assessments. At baseline, there were no significant differences between the control and intervention group in age, gender, home state, or previous experience with firearms. Similarly, there were no significant differences in FIP self-efficacy, beliefs, or knowledge between the two groups (Table 1).
Immediate effects of the intervention
Of the 75 students who completed the pre-intervention assessments, four students did not complete post-intervention assessments. The remaining 71 students from the intervention group were included in this analysis. Prior to the intervention, students did not feel ready to counsel patients or confident in providing advice and resources about firearm safety (mean = 2.9 and 3.0 respectively). (Table 2) Immediately after the intervention, students felt significantly more self-efficacious in both questions (p < 0.001 for both; mean difference = + 1.0 and + 1.1 respectively) (Table 3).
There were five questions assessing beliefs about FIP in the context of medical practice. Pre-assessment results demonstrated that student beliefs favored FIP counseling and education in all five questions at baseline. Immediately after the intervention, responses to three of the five questions shifted even more towards favoring FIP (p < 0.001 for all three questions). The remaining two questions, evaluating beliefs about violation of patient privacy and gun violence as a public health issue, remained unchanged. Students still disagreed asking patients about firearms is a violation of patient privacy (mean = 1.8) and still agreed gun violence should be considered a public health issue (mean = 4.5) after the intervention (Table 3).
There were six questions assessing knowledge of FIP risk factors. Prior to the intervention, students averaged 3.0 correct out of 6.0. Immediately after the intervention, scores increased significantly to a mean of 5.4 out of 6.0 (p < 0.001) (Table 3).
6-month effects of the intervention
Sixty-five students were included in this analysis – 22 from the control and 43 from the intervention. Sixty-five students were excluded due to failure to complete any of the three assessments. After 6 months, students who received the intervention expressed increased readiness to counsel patients about FIP compared to students who received the standard lecture (p < 0.05). Additionally, students who received the intervention had improved scores of FIP risk factors (p < 0.05) (Table 4).
However, students no longer felt as confident in providing advice and resources about firearm safety. Furthermore, though their beliefs still favored FIP counseling and education in medical practice, there were no significant differences in any of the five belief-type questions when compared to students in the control group after 6 months. Of note, students’ beliefs about the statements “Asking patients about firearms is a violation of privacy and can damage the patient-doctor relationship” and “Gun violence should be considered a public health issue” were already one-sided at baseline. Students who received the intervention were also not more likely to engage in a conversation about firearm safety or storage (Table 5). In fact, the majority of students, who received a gun lock as part of the intervention, did not give the gun lock to anyone (78.6%).
According to the social learning theory (previously social cognitive theory), one’s self-efficacy, knowledge, and beliefs are important determinants of one’s behavior, particularly in the context of health-related behaviors (Bandura 2004). This theory has been studied to target educational interventions for both patients and physicians (Mohebi et al. 2013; Ha et al. 2018; Ozer et al. 2004; Maiuro et al. 2000). Of note, it has specifically shown improvements in FIP counseling (Solomon et al. 2002; Finch et al. 2008; Abraham et al. 2001; Dingeldein et al. 2012). However, it is also important to note the intrinsic limitations of the theory and recognize the complexity of the determinants of counseling.
Our intervention was successful in maintaining improvements in the self-efficacy question about feeling ready to conduct FIP counseling after six months. We postulate that the regression observed in the second question (“I am confident I can provide appropriate advice and resources to patients about firearm safety”) is most likely due to the lack of repetition and subsequent degredation in behavior practice and self-efficacy. In a review by Bailey et al. summarizing neurobiological findings, long-term potentiation, defined as repeated stimulation and conditioning of a certain behavior, was pivotal in the formation of long-term memory from short-term memory (Bailey et al. 2015). Educational data further support the benefits of practice and repetition in memory retention, particularly spaced repetition (Kang 2016). Alternatively, without repeated stimulation, hippocampal pruning of short-term memory will puruse resulting in the loss of behavioral pattern (Bailey et al. 2015). In summary, the old adage – “use it or lose it” – likely explains the loss of participants’ self-efficacy.
The intervention showed categorical retention of knowledge of FIP at 6 months. This retention of knowledge is encouraging and may have directly contributed to improvement of participants’ self-efficacy. However, participants’ beliefs about FIP did not persist after 6 months. Immediately after the intervention, we observed significant changes in three of the five belief questions. These changes were no longer significant during follow-up. The question about gun violence being a public health issue likely saw no difference because the baseline response was high agreement at 4.4/5. However, they were still consistent with other studies examining physician opinions about FIP and favor physician involvement (Betz et al. 2013; Grossman et al. 1995; Roszko et al. 2016; Solomon et al. 2002; Cassel et al. 1998).
Gun locks were provided to students in the intervention group in response to Barkin et al.’s observation that FIP counseling behavior may have decreased due to the diminishing availability of locks for patients (Barkin et al. 2008a). Since gun locks were not provided to the control group, no conclusion can be drawn about whether the participants given gun locks were more likely to engage in FIP counseling than those who did not.
As previously mentioned, the broad scope of firearm injuries may lend itself to ideal placement in undergraduate medical education (UME). However, we would advocate for including FIP training at multiple levels at difference time points of medical education from UME to attending level continued medical education (CME) courses. Providing anticipatory guidance for firearm injuries is supported by multiple professional medical organizations including the American Academy of Pediatrics and the American College of Surgeons (AMA Recommends New, Common-sense Policies to Prevent Gun Violence 2018; Dowd and Sege 2012; Statement on Firearm Injuries 2013; Butkus et al. 2014). The benefits of spaced repetition has also been demonstrated by several studies showing increased likelihood of physician FIP counseling if provided continued training (Price et al. 2007; Kaplan et al. 1998). Without periodic reinforcement, physician and physician trainee self-efficacy in providing FIP counseling will likely diminish with time, as seen in our study.
This study has several important limitations. First and most notably, our study lost a significant number of students to six-month follow-up. Of the original 130 students, only 65 students (50%) followed through and completed the full series of surveys. Attendance for the didactic was required by the clerkship, but participation in our study was voluntary. Six-month assessments were also distributed without regard for holiday breaks and exams. Additionally, students participated in these sessions throughout the duration of their third year. It is likely that clinical experience of each student at the time of intervention could not be controlled for; and therefore, students may have felt more or less comfortable having discussions with families as the academic year progressed. Third, endpoint data were collected at 6 months and our results were not validated. As mentioned before, further studies should investigate more distant time points and validate their results by objectively measuring student behavior. Finally, our second self-efficacy question (“I am confident I can provide advice and resources…”) was a double-barrelled statement combining two elements (advice and resources) into a single question, which may have influenced the non-improvement seen in our results. It is also important to note that this educational intervention was performed in Milwaukee, where exposure to firearm violence is prevalent, and may influence student beliefs and open-mindedness to our intervention.
A 20-min educational intervention acutely improved self-efficacy in FIP counseling in third-year medical students, but improvements weakened after six months. Students retained knowledge of FIP risk factors after six months and had beliefs consistent with previously reported clinician attitudes about FIP. But without further training, the beneficial effects of a one-time intervention will likely wane with time. Including FIP training into medical school curricula may encourage development of more competent and effective physicians.
Continued medical education
Firearm injury prevention
Undergraduate medical education
Abraham A, Cheng TL, Wright JL, Addlestone I, Huang Z, Greenberg L. Assessing an educational intervention to improve physician violence screening skills. Pediatrics. 2001;107(5):E68.
AMA Recommends New, Common-sense Policies to Prevent Gun Violence. American Medical Association Website. 2018. Retrieved from https://www.ama-assn.org/ama-recommends-new-common-sense-policies-prevent-gun-violence.
Avraham JB, Frangos SG, DiMaggio CJ. The epidemiology of firearm injuries managed in US emergency departments. Inj Epidemiol. 2018;5(1):38.
Bailey CH, Kandel ER, Harris KM. Structural components of synaptic plasticity and memory consolidation. Cold Spring Harb. Perspect. Biol. 2015;7(7):a021758.
Bandura A. Health promotion by social cognitive means. Health Educ. Behav. 2004;31(2):143–64.
Barkin SL, Finch SA, Ip EH, Scheindlin B, Craig JA, Steffes J, Weiley V, Slora E, Altman D, Wasserman RC. Is office-based counseling about media use, timeouts, and firearm storage effective? Results from a cluster-randomized, controlled trial. Pediatrics. 2008b;122(1):e15–25.
Barkin SL, Finch SA, Ip EH, et al. Is office-based counseling about media use, timeouts, and firearm storage effective? Results from a cluster-randomized, controlled trial. Pediatrics. 2008a;122(1):e15–25.
Bayouth L, Lukens-Bull K, Gurien L, Tepas JJ 3rd, Crandall M. Twenty years of pediatric gunshot wounds in our community: Have we made a difference? J. Pediatr. Surg. 2018;30(18):30619–5.
Betz ME, Miller M, Barber C, et al. Lethal means restriction for suicide prevention: beliefs and behaviors of emergency department providers. Depress. Anxiety. 2013;30(10):1013–20.
Butkus R, Doherty R, Daniel H. Reducing firearm-related injuries and death in the United States: executive summary of a policy position paper from the american college of physicians. Ann. Intern. Med. 2014;160(12):858.
Butkus R, Weissman A. Internists’ attitudes toward prevention of firearm injury. Ann. Intern. Med. 2014;160(12):821–7.
Cassel CK, Nelson EA, Smith TW, Schwab CW, Barlow B, Gary NE. Internists’ and surgeons’ attitudes toward guns and firearm injury prevention. Ann. Intern. Med. 1998;128(3):224–30.
Cheng TL, DeWitt TG, Savageau JA, O’Connor KG. Determinants of counseling in primary care pediatric practice: physician attitudes about time, money, and health issues. Arch. Pediatr. Adolesc. Med. 1999;153(6):629–35.
Dingeldein L, Sheehan K, Krcmarik M, Dowd MD. Evaluation of a firearm injury prevention web-based curriculum. Teach Learn Med. 2012;24(4):327–33.
DiScala C, Sege R. Outcomes in children and young adults who are hospitalized for firearms-related injuries. Pediatrics. 2004;113(5):1306–12.
Dowd MD, Sege RD. Firearm-related injuries affecting the pediatric population: council on injury, violence, and Poison Prevention Executive Committee. Pediatrics. 2012;130(5):e1416-21.
Finch SA, Weiley V, Ip EH, Barkin S. Impact of pediatricians’ perceived self-efficacy and confidence on violence prevention counseling: a national study. Matern. Child Health J. 2008;12(1):75–82.
Fowler KA, Dahlberg LL, Haileyesus T, Annest JL. Firearm injuries in the United States. Prev. Med. 2015;79:5–14.
Greenspan AI, Kellermann AL. Physical and psychological outcomes 8 months after serious gunshot injury. J. Trauma. 2002;53(4):709–16.
Grossman DC, Mang K, Rivara FP. Firearm injury prevention counseling by pediatricians and family physicians. Practices and beliefs. Arch. Pediatr. Adolesc. Med. 1995;149(9):973–7.
Grossman DC, Mueller BA, Riedy C, et al. Gun storage practices and risk of youth suicide and unintentional firearm injuries. JAMA. 2005;293(6):707–14.
Ha FJ, Hare DL, Cameron JD, Toukhsati SR. Heart failure and exercise: a narrative review of the role of self-efficacy. Heart Lung Circ. 2018;27(1):22–7.
Hamilton S, Neeley S, Roman B. The culture of gun violence: an active learning exercise. MedEdPORTAL Publications. 2014;10(9941) https://doi.org/10.15766/mep_2374-8265.9941.
Kang SHK. Spaced repetition promotes efficient and effective learning: policy implications for instruction. Policy Insights Behav. Brain Sci. 2016;3(1):12–9.
Kaplan MS, Adamek ME, Rhoades JA. Prevention of elderly suicide. Physicians’ assessment of firearm availability. Am. J. Prev. Med. 1998;15(1):60–4.
Khubchandani J, Price JH, Dake JA. Firearm injury prevention training in preventative medicine residency programs. J. Community Health. 2009;34(4):295–300.
Lee J, Quraishi SA, Bhatnagar S, Zafonte RD, Masiakos PT. The economic cost of firearm-related injuries in the United States from 2006 to 2010. Surgery. 2014;155(5):894–8.
Maiuro RD, Vitaliano PP, Sugg NK, Thompson DC, Rivara FP, Thompson RS. Development of a health care provider survey for domestic violence: psychometric properties. Am. J. Prev. Med. 2000;19(4):245–52.
Mohebi S, Azadbakht L, Feizi A, Sharifirad G, Kargar M. Review the key role of self-efficacy in diabetes care. J. Educ. Health Promot. 2013;2:36.
Olson LM, Christoffel KK, O’Connor KG. Pediatricians’ involvement in gun injury prevention. Inj Prev. 2007;13(2):99–104.
Ozer EM, Adams SH, Gardner LR, Mailloux DE, Wibbelsman CJ, Irwin CE. Provider self-efficacy and the screening of adolescents for risky health behaviors. J. Adolesc. Health. 2004;35(2):101–7.
Price JH, Bedell AW, Everett SA, Oden L. Training in firearm safety counseling in family practice residency programs. J. Community Health. 1997a;22(2):91–9.
Price JH, Conley PM, Oden L. Training in firearm safety counseling in pediatric residency programs. Arch. Pediatr. Adolesc. Med. 1997b;151(3):306–10.
Price JH, Kinnison A, Dake JA, Thompson AJ, Price JA. Psychiatrists’ practices and perceptions regarding anticipatory guidance on firearms. Am. J. Prev. Med. 2007;33(5):370–3.
Price JH, Thompson AJ, Khubchandani J, Mrdjenovich AJ, Price JA. Firearm anticipatory guidance training in psychiatric residency programs. Acad. Psychiatry. 2010;34(6):417.
Roszko PJ, Ameli J, Carter PM, Cunningham RM, Ranney ML. Clinician attitudes, screening practices, and interventions to reduce firearm-related injury. Epidemiol. Rev. 2016;38(1):87–110.
Russo R, Fury M, Accardo S, Krause P. Economic and educational impact of firearm-related injury on an urban trauma center. Orthopedics. 2016;39(1):e57–61.
Shenassa ED, Rogers ML, Spalding KL, Roberts MB. Safer storage of firearms at home and risk of suicide: a study of protective factors in a nationally representative sample. J. Epidemiol. Community Health. 2004;58(10):841–8.
Solomon BS, Duggan AK, Webster D, Serwint JR. Pediatric residents’ attitudes and behaviors related to counseling adolescents and their parents about firearm safety. Arch. Pediatr. Adolesc. Med. 2002;156(8):769–75.
(2013, January 16) Statement on Firearm Injuries. American College of Surgeons Website. Retrieved from https://www.facs.org/about-acs/statements/12-firearm-injuries.
Tasigiorgos S, Economopoulos KP, Winfield RD, Sakran JV. Firearm injury in the United States: An overview of an evolving public health problem. J. Am. Coll. Surg. 2015 Dec;221(6):1005–14.
Web-based injury statistics query and reporting system: Leading causes of death reports. Centers for Disease Control and Prevention Website. http://webappa.cdc.gov/sasweb/ncipc/leadcaus10_us.html. Updated 2016. Accessed 8 Aug 2018.
The authors would like to thank the Medical College of Wisconsin’s Department of Pediatrics for their guidance and cooperation with our project. The authors would also like to thank the Wauwatosa and Milwaukee Police Departments, Master Lock, and the Brady Campaign.
The Wisconsin Medical Society provided a summer fellowship stipend for one of the authors (JZK). Publication costs were funded by the Injury Free Coalition for Kids™.
Availability of data and materials
Intervention Powerpoint and associated resources are available upon request from the authors.
About this supplement
This article has been published as part of Injury Epidemiology Volume 6 Supplement 1, 2019: Proceedings from the 23rd Annual Injury Free Coalition for Kids® Conference: Forging New Frontiers: Pediatric Injury Prevention - Process, Programs and Progress. The full contents of the supplement are available online at https://injepijournal.biomedcentral.com/articles/supplements/volume-6-supplement-1.
Ethics approval and consent to participate
The study was approved by the Institutional Review Board at the Medical College of Wisconsin.
Consent for publication
The authors have no conflicts of interest to declare.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.