Skip to main content
  • Original Contribution
  • Open access
  • Published:

Size matters: How safety climate and downstream outcomes vary by fire department organization type

Abstract

Background

Safety climate is an upstream predictor of safety behaviors (e.g., safety compliance), organizational outcomes (e.g., burnout, engagement), and safety outcomes (e.g., injuries). The Fire Service Organizational Culture of Safety (FOCUS) survey, which was psychometrically validated, measures the industry-specific safety climate of the US fire and rescue service. It is expressed by two factors, Management Commitment to Safety and Supervisor Support for Safety.

Methods

The FOCUS beta-test included a random sample of 132 fire departments stratified by Federal Emergency Management Agency region and organization type (career, combination, volunteer). We conducted descriptive analysis with the responses from 8414 firefighters nested within 611 stations in 125 fire departments. We reported descriptive statistics to assess the distribution of all continuous [mean ± standard deviation (SD)] and categorical variables (counts, percentages) stratified by organization type. Regression analyses were conducted to investigate the associations between safety climate, safety behaviors, organizational outcomes, and safety outcomes stratified by organization type.

Results

The mean age of the analytic sample was 40.2 years, and the mean years of experience was 16.1 years. This sample included 53.6% career, 27.2% combination (career and volunteer), and 19.2% volunteer fire departments. The mean Management Commitment score was 71.4 (SD =  ± 10.4), and the mean Supervisor Support score was 81.7 (± 5.2). The mean Management Commitment scores were 67.1 (± 8.4), 72.2 (± 10.7), and 82.1 (± 6.1), respectively, for career, combination, and volunteer fire departments. The mean Supervisor Support scores were not notably different by organization type. Regression analyses generally supported the beneficial role of safety climate, while suggesting organization type as a potential effect modifier. Specifically, we observed a more negative association between Management Commitment as departments became more career.

Conclusions

Analysis of nationally representative data from the US fire and rescue service indicates safety climate is positively associated with safety behavior, organizational outcomes, and safety outcomes reflecting employee well-being. The findings also suggest that this association varies by organization type. In fact, a dose–response relationship was observed, with Management Commitment to safety lowest among career departments. Thus, our results suggest that it is not just being busy that decreases Management Commitment.

Background

Safety climate is defined as the shared perceptions of employees regarding their organization’s safety policies, procedures, and practices and how different kinds of behavior that are supported and rewarded by leadership within the organization (Zohar 1980). Safety climate has been identified as one of the most pronounced upstream predictors of safety behaviors (e.g., safety compliance), and safety outcomes (e.g., injuries), as well as organizational outcomes (e.g., burnout, engagement) (Christian et al. 2009; Huang et al. 2016). Understanding an organization’s safety climate can allow for organization-level changes that can improve the downstream effects resulting in improved safety behaviors, a reduction in injuries, and improved perceptions of organizational outcomes.

The Fire Service Organizational Culture of Safety (FOCUS) survey measures the industry specific safety climate of the US fire and rescue service (Davis et al. 2020; Taylor et al. 2019). In 2018, it was estimated that the US fire service was comprised of approximately 1.1 million firefighters, of which 745,000 (67%) were volunteer employees and 370,000 (33%) were career employees (Evarts and Stein 2020). According to the National Fire Incident Reporting System, in 2017, 64% of the 26,880,800 calls that fire departments received required emergency medical services (EMS) or rescue services response (United States Fire Administration 2019). The purpose of FOCUS is to provide objective data for fire department decision making to prevent injuries and increase well-being through measurement, monitoring, and management of safety climate. The first wave of FOCUS has been referred to as the FOCUS beta-test survey (Taylor et al. 2019). The FOCUS beta-test survey obtained information on fire department organization type (“organization type”) for all departments. Organization type is categorized as career, combination (career and volunteer), and volunteer fire departments. FOCUS has been previously psychometrically validated using a geographically stratified random sample of 130 fire departments including 615 stations and 8575 firefighters (Taylor et al. 2019). In brief, a 14-item multi-level measure of industry specific safety climate for the fire service was developed (Taylor et al. 2019). The dissemination of FOCUS survey results has been previously described (Davis et al. 2020). Briefly, findings and implications of the FOCUS beta-test survey were shared with the participating departments in a 7-page report comparing benchmarks of their data to other fire departments. Each participating department is provided with their department-specific report, which includes their overall FOCUS score, scores for Management Commitment to Safety (Management Commitment), and Supervisor Support for Safety (Supervisor Support) at the department level. Then at the station-level their FOCUS score is reported, along with burnout on EMS and fire, engagement on EMS and fire, and job satisfaction.

In line with the previous studies regarding the common attributes of safety climate (Flin et al. 2000; Yule et al. 2007), the FOCUS survey operationalized safety climate by two factors, Management Commitment and Supervisor Support (Taylor et al. 2019). Our current work is based upon the safety climate to safety outcomes causal pathway. Our previous work has informed us that safety climate precedes safety behaviors followed by organizational outcomes followed by safety outcomes. Organizational outcomes relate to burnout, engagement, and job satisfaction (Davis et al. 2020; Taylor et al. 2019). Safety outcomes include occupational injuries and near misses (Davis et al. 2020; Taylor et al. 2019). Our previous work informs us that burnout is typically higher on emergency medical services (EMS) runs versus on fire runs and that engagement is typically higher on fire runs versus on EMS runs (Davis et al. 2020; Taylor et al. 2019). Also, notable variations in burnout and engagement were found across fire departments (Davis et al. 2020). One important question that needs to be answered is whether these differences in safety climate and its potential outcomes are systematic and which organizational contexts or structural elements are associated with the differences.

Prior investigations into the role of organizational safety climate within the fire service evaluated different outcome measures among career firefighters (Smith 2020; Smith et al. 2019, 2020). One study examined the impact of affective organizational commitment, defined as a determinant of one’s dedication to their organization, on firefighter safety (Smith 2020). It found that affective organizational commitment is associated with positive safety behavior outcomes among career firefighters (Smith 2020). Another study developed and validated a multi-level safety climate measure for the fire service by surveying two metropolitan fire departments (Smith et al. 2019). Building upon this research, additional work in these departments was conducted to examine the association between stress and burnout with safety behaviors of career firefighters (Smith et al. 2020). The authors concluded that burnout negatively affects the safety behavior outcomes of compliance and safety citizenship among career firefighters (Smith et al. 2020). However, these findings might be specific to the unique governance structures or leadership approaches to career fire departments only and not readily generalizable to volunteer or combination departments.

In the current study, we evaluated the descriptive characteristics that differed between mean FOCUS scores of Management Commitment and Supervisor Support among the FOCUS beta-test respondents. Our primary research aim was to examine how the individual demographic and department-level data differed by safety climate among participating fire departments. Our secondary aim was to investigate the differences of safety climate scores by fire department organization type. Our tertiary aim was to investigate the association between self-reported injury status and safety climate by organization type. This study describes the FOCUS beta-test survey data with particular emphasis on responding to queries, such as the impact of busyness, raised by participating fire departments for the effective promotion of safety climate.

Methods

Population

The FOCUS beta-test survey was a random sample of career, combination, and volunteer fire departments (n = 132), which was geographically stratified across the 10 US Federal Emergency Management Agency (FEMA) regions. Its design, recruitment, and psychometric properties have been described previously (Davis et al. 2020; Taylor et al. 2019). In brief, we have data collected from three levels: individual, station, and fire department. Fire departments were encouraged to achieve at least a 60% response rate, at the station level, when participating in the FOCUS survey beta-test. The FOCUS beta-test included 10,073 individuals nested within 757 stations in 132 fire departments. Our baseline analytic sample was that of the FOCUS beta-test psychometric analysis, which was comprised of 8575 individuals nested within 615 stations in 130 fire departments (Taylor et al. 2019). Our exclusionary criteria for analysis were as follows: stations that did not have an EMS component (n = 49 individuals, n = 4 stations), respondents that did not complete any of the demographic questions (n = 83 individuals), respondents that had missing safety climate scores (n = 29 individuals, n = 3 departments), and departments that did not complete their supplementary department-level demographic survey (n = 2). This resulted in an analytic sample of 8414 individuals nested within 611 stations in 125 fire departments. Our analytic sample had an average 66% response rate to the FOCUS beta-test survey at the department level.

Descriptive variables

Descriptive and demographic characteristics were obtained from the individual respondents of the FOCUS beta-test survey. In the survey, individuals were asked to “select all that apply” when identifying their rank and race and ethnicity. In the event that an individual selected more than one response they were categorized as “more than one selected” for rank and “more than one race” for race and ethnicity. We reduced the number of categories for rank due to small sample sizes when stratified by organization type and injury status. For rank we created a three-level categorical variable (non-officer, officer, leadership), referred to as officer status. The non-officer category included individuals that identified as a firefighter, emergency medical technician (EMT), or paramedic. The officer category included individuals that identified as a lieutenant or captain. The leadership category included individuals that identified as a battalion chief, chief, or commissioner. Individuals that had selected more than one rank were classified based on the highest level of rank they selected.

Additionally, select descriptive characteristics were collected from each fire department to obtain the demographic make-up of the department. For Insurance Services Office (ISO) rating, some departments reported two scores since rural and urban areas have a different scoring, typically. In the event that two scores were reported by a fire department the poorer score was used for the descriptive statistics. Of note, the roster size, annual call volume, and population served variables are naturally continuous.

Safety Climate

The two FOCUS safety climate scores we examined were mean Management Commitment scores and mean Supervisor Support scores. FOCUS Management Commitment is defined as firefighter perceptions of how leadership values and supports safety within the organization and has been conceptualized as a department-level safety climate dimension (Taylor et al. 2019). FOCUS Supervisor Support is defined as department members’ perceptions of the commitment to safety by their direct supervisor (e.g., captain, lieutenant) in how they value and support safety within their crew and has been conceptualized as a station-level safety climate dimension (Taylor et al. 2019). Scores for each of these domains were measured through self-reported responses for seven items on a 5-point Likert scale (strongly disagree, disagree, neither agree nor disagree, agree, and strongly agree) from the FOCUS survey instrument. Mean scores were converted to a 100-point scale for interpretability by the fire service. As an example, if the mean score was 3.7, it was converted to 74.0 by multiplying 3.7 by 20.

Safety compliance behavior

Safety compliance behavior, referred to as safety compliance, is defined as the degree of accordance by a member to established safety protocols, processes, and standards by members for fire-based response and was assessed using an adaptation from the Vulnerability Assessment Project, which has been used by fire department leadership to evaluate and assess risks associated with exposures, injuries, and line of duty deaths (National Fallen Firefighters Foundation 2014). Responses were obtained using a 5-point Likert scale (strongly disagree, disagree, neither agree nor disagree, agree, and strongly agree) through self-reported responses by individuals. Mean scores were converted to a 100-point scale for interpretability.

Organizational outcomes

Organizational outcomes representing firefighters’ well-being at work domain (burnout on EMS and fire runs, engagement on EMS and fire runs, and job satisfaction) were obtained using a 5-point Likert scale (strongly disagree, disagree, neither agree nor disagree, agree, and strongly agree). This information was obtained through self-reported responses among individual respondents. Each survey included questions regarding burnout on EMS and fire runs and engagement on EMS and fire runs. Thus, the same individual completed the corresponding questions thinking about their perceived burnout and engagement on EMS runs versus their fire runs. Mean scores were converted to a 100-point scale for interpretability. These organizational outcomes have been previously defined and their measures were validated (Taylor et al. 2019). Burnout was derived from Maslach’s Burnout Inventory and is defined as emotional exhaustion and depersonalization due to the chronic strain of an individual’s work (Maslach and Jackson 1981). It should be noted that burnout scores for FOCUS are interpreted as more positive the lower the score is (Davis et al. 2020). For example, the lower a department’s burnout score, the less burnout those members reported experiencing. Engagement is defined as the vigor, absorption, and dedication of one’s work-related state and was assessed using a 6-item scale that measured employee engagement (Schaufeli et al. 2002). Job satisfaction is defined as the level of positivity about work, sometimes referred to as morale and was assessed using an adaptation from the Safety Attitudes Questionnaire’s subscale on job satisfaction (Sexton et al. 2006).

Statistical analysis

We reported descriptive statistics to assess the distribution of all continuous (mean ± standard deviation (SD), range) and categorical variables (counts, percentages) for the analytic sample stratified by organization type. Descriptive and demographic variables were collected at the individual level and department level.

Pearson correlation matrixes were run for continuous variables to investigate correlations between covariates and mean safety climate scores at the department level as well as at the individual level. Linear regression models were used to estimate the relationship between organizational outcomes and the two dimensions of FOCUS safety climate: Management Commitment and Supervisor Support. The linear regression models were adjusted for roster size, annual call volume, and population served. These size variables were recategorized based on quartiles for each corresponding organization type.

Logistic regression was used to estimate the odds of self-reported injury 12 months prior to completing FOCUS associated with safety climate scores (Management Commitment, Supervisor Support). Multilevel logistic regression was used to calculate the beta estimates that were then exponentiated to estimate the odds ratios (OR) and 95% confidence intervals (CI). For the multilevel models, individual-level injury status (yes/no) was regressed on department-level Management Commitment or Supervisor Support scores, while random effects were specified at the department and station levels. These models were adjusted for age, years of experience, sex (male, female), and officer status (non-officer, officer, leadership). Due to missing data, individuals missing injury status (n = 398), sex (n = 224), and officer status (n = 103) were excluded from these models. Statistical significance was set to < 0.05 for all analyses.

The protocol received Institutional Review Board approval from Drexel University. All statistical analyses were conducted using SAS 9.4 (Cary, North Carolina).

Results

Our sample included a total of 125 fire departments comprised of three organization types: 67 (53.6%) career, 34 (27.2%) combination (career and volunteer), and 24 (19.2%) volunteer fire departments. We report the descriptive characteristics of the beta-test respondents for the total population and stratified by organization type in Table 1. In total, 1406 individuals (16.7%) reported that they had experienced an injury in the 12 months prior to completing the survey. There were differences in organizational outcomes when participants were thinking about their work on an EMS run versus a fire run, most notably for engagement. The overall mean engagement on EMS was 70.9 (41.7–88.2) versus 80.3 (60.7–91.8) on fire runs. We did not observe notable differences by organization type. The mean Management Commitment score was 71.4 (SD ± 10.4) and the mean Supervisor Support score was 81.7 (± 5.2) for all departments. The mean Management Commitment score varied between organizational types, indicating a dose–response relationship (Fig. 1A). Which was not observed for Supervisor Support (Fig. 1B).

Table 1 Descriptive characteristics of FOCUS beta-test analytic sample stratified by fire department organization type
Fig. 1
figure 1

Box and whisker plots comparing Management Commitment and Supervisor Support scores by organization type. A Comparison of mean Management Commitment scores by organization type (career, combination, volunteer); B Comparison of mean Supervisor Support scores by organization type (career, combination, volunteer)

Pearson correlation matrices are presented by department level (Table 2) and individual level (Table 3). We observed a high positive correlation between annual call volume with roster size and with population served (Table 2). The relationship between these size variables and safety climate scores by organization type is presented in Fig. 2. We observed a high negative correlation between burnout and engagement on EMS runs (Table 2). We observed a moderate negative correlation between burnout on fire runs with engagement on fire runs. We observed a high positive correlation between job satisfaction and Management Commitment. A similar high positive correlation was observed between job satisfaction and Supervisor Support. At the individual level we observed similar patterns (Table 3). At the individual level we included the age and years of experience variables to our Pearson correlation matrix. We observed a high correlation between age and years of experience. In addition to the correlations present at the department level, among individuals we observed a moderate positive correlation between engagement on fire runs with Supervisor Support. Additionally, we observed a moderate positive correlation between safety compliance and Management Commitment.

Table 2 Department-level Pearson correlation coefficient matrix (n = 112)
Table 3 Individual-level Pearson correlation coefficient matrix (n = 8414)
Fig. 2
figure 2

Box and whisker plots comparing Management Commitment and Supervisor Support scores by size variables. A Comparison of mean Management Commitment scores by Roster Size categories; B Comparison of mean Supervisor Support scores by Roster Size categories; C Comparison of mean Management Commitment scores by Annual Call Volume categories; D Comparison of mean Supervisor Support scores by Annual Call Volume categories; E Comparison of mean Management Commitment scores by Population Served categories; F Comparison of mean Supervisor Support scores by Population Served categories

The results of the linear regression analyses are shown in Table 4. These analyses were used to estimate the relationship between safety climate scores and safety behaviors/organizational outcomes at the department level. Our findings indicate that all of our safety behavior/organizational outcomes are associated with both Management Commitment and Supervisor Support. Of note, job satisfaction was identified to have the strongest association between both Management Commitment and Supervisor Support as evidenced by the β of 0.79 and 0.67, respectively.

Table 4 Linear regression models examining the relationship between safety climate scores and safety behaviors/organizational outcomes

The results of the linear regression analyses stratified by organization type are shown in Table 4. These analyses were used to estimate the relationship between safety climate scores and safety behaviors/organizational outcomes at the department level stratified by organization type. Job satisfaction was the only outcome for which we observed an association across all organization types. This was observed for both Management Commitment and Supervisor Support. Our findings indicate that all of our safety behavior/organizational outcomes are associated with Supervisor Support for career and combination departments, but not with Management Commitment. Overall, we did not observe the same associations between safety behavior and organizational outcomes (excluding job satisfaction) with safety climate scores present among volunteer departments. We did observe a positive association between safety compliance and Supervisor Support in volunteer departments for the fully adjusted models.

Examination of individual-level descriptive characteristics shown was used to evaluate the relationship between injury status and safety climate scores (Table 5). Among all individuals, for a one-unit increase in Management Commitment the odds of injury decreases by 3% (OR 0.97, 95% CI 0.97–0.98). Among all individuals, for a one-unit increase in Supervisor Support the odds of injury decreases by 4% (OR 0.96, 95% CI 0.94–0.98). A similar association was observed among career fire department members. Among combination fire department members, for a one-unit increase in Management Commitment the odds of injury decreases by 3% (OR 0.97, 95% CI 0.95–0.99). We did not observe an association with injury status and Supervisor Support in combination or volunteer departments. Additionally, we did not observe an association with injury status and Management Commitment for volunteer departments.

Table 5 Multilevel logistic regression between safety climate and injury status among individuals stratified by organization type

Discussion

For our study we evaluated and reported on the descriptive characteristics of the FOCUS beta-test survey sample at the individual and department level, stratified by fire department organization type. Additionally, we examined the association between safety behaviors, organizational outcomes, and safety outcomes with safety climate scores. Overall, we observed a 10-point difference between Management Commitment and Supervisor Support when comparing the overall department mean scores. Additionally, we observed a reduction in the odds of self-reported injury for a one-unit increase in Management Commitment and Supervisor Support among our population.

Management Commitment and Supervisor Support

Management Commitment was the lower scoring safety climate score. When we stratified Management Commitment by organization type, we observed a dose–response relationship, which indicated that the more career a department became the lower the Management Commitment score became. We hypothesize that this means that leaders in more career departments may have work to do to better communicate their actual support for safety among their members. Prior research in the trucking industry observed a protective impact of safety climate on safety behavior and injury that was moderated by the quality of safety communication by supervisors (Huang et al. 2018). Future research should further investigate this dose–response finding and see what is changing in terms of the organizational environment that may lead to these reductions in perceived Management Commitment. Those factors may then become targets for intervention. We did not observe the same dose–response when we stratified Supervisor Support by organization type.

Management Commitment and department size

Among our sample, career fire departments were typically larger in roster size, annual call volume, and population served compared to combination or volunteer departments. Due to the larger roster size, we believe that rank-and-file members within career departments are less likely to interact with leadership at the management level. This may be what is driving the differences observed when stratified by organization type for Management Commitment. This finding suggests to us that management of career departments, specifically, need to improve their interaction at the station level. An effort by management to visit members at the stations may be warranted to increase the perception of Management Commitment and be more reflective of the Supervisor Support scores we observed. The executive leadership walkaround exemplifies this idea and has been used successfully in the healthcare industry (Schwendimann et al. 2013; Sexton et al. 2018); however, we do not believe that this intervention has been evaluated specifically in the fire service.

Supervisor Support and department size

We observed that combination fire departments look more like career because they have lower Supervisor Support for safety scores compared to volunteer. Since this score is directly linked to the interaction between officers and non-officer members at the station level, this is something that should be addressed by career and combination departments to ensure that their rank-and-file feel supported by their direct supervisors.

Safety climate and job satisfaction

We observed a positive association of both Management Commitment and Supervisor Support with job satisfaction across all organization types. The association was strongest with Supervisor Support. These findings held for the fully adjusted models and support the findings from our correlation matrices. Future work should examine Management Commitment interventions to further increase the job satisfaction score.

Safety climate and organizational outcomes

Across career and combination departments we observed that safety climate is positively associated with safety behavior and organizational outcomes that are reflective of employee well-being. These associations were notably stronger for Supervisor Support when compared to Management Commitment for career and combination departments. Additionally, across career, combination, and volunteer departments we observed a positive association between safety compliance and Supervisor Support. Connecting this to our conceptual framework (Taylor et al. 2019), this further supports the idea that supervisors matter and may play an important role in preventing injuries.

Safety climate and injury

Overall and for career members, we observed that the individuals had lower odds of self-reported injury in the past 12 months for every one-unit increase of Management Commitment and of Supervisor Support. There was a borderline association observed between injury status and Supervisor Support among members in combination departments. Our lack of associations among members at volunteer departments may be due to the small sample size for this organization type. We recommend that these results be interpreted cautiously. Overall, this finding suggests that Supervisor Support is a slightly stronger driver in lowering the odds of injury than Management Commitment, especially in combination departments. Future research should examine this relationship with a larger volunteer sample to better understand the true relationship in this organization type.

Relevance

Previous research has been conducted to evaluate different aspects of safety climate as it relates to the physical and mental health of firefighters (Armstrong et al. 2016). Additional work has been conducted to investigate the effect of burnout on firefighters (Smith et al. 2020; Jeung and Chang 2021). Reducing burnout, among members of the fire service, may aid in injury prevention. Further understanding of safety climate within the US fire service is necessary in order to provide physical and mental health prevention among the workers in this occupational group.

Observed gaps in terms of the relationship between safety climate and organizational outcomes across career, combination, and volunteer departments may indicate the heterogeneity in self-determination and work attitude (Deci and Ryan 2012) across career and volunteer firefighters. Volunteer firefighters are more likely to be intrinsically motivated and work in a highly autonomous way. Accordingly, they are more likely to find task identity and significance from their own work behaviors, rather than relying on external feedback from management or supervisors (Gagné et al. 1997). Moreover, weaker relationships between safety climate and injury status in combination and volunteer departments than in career departments suggest that a stronger sense of independence and autonomy among volunteer firefighters can hamper the effective translation of safety climate into individual-level safety behaviors and outcomes. Considered jointly, safety climate facilitation efforts need to properly consider the unique work attitudes of volunteer firefighters for the optimal workplace safety, health, and well-being promotion.

Our prior work (Taylor et al. 2019) is supported by our current findings which provides more insight into the relationships between organizational outcomes and safety climate scores among the FOCUS beta-test respondents, specifically in understanding the differences across organization types.

Strengths

Our study had important strengths. The FOCUS beta-test is comprised of a large sample size. Participating fire departments were selected using a geographically stratified random sampling method, which reduces concerns for selection bias based on sampling methods This method of sampling is appropriate for obtaining representation across the US. Another strength of the FOCUS survey is that the same individual reported on their individual perception to burnout and engagement on EMS runs and on fire runs. This survey design controls for confounding since the same person is answering for both EMS and fire runs. We observed that reported burnout on EMS runs was higher, while engagement was lower in response to EMS runs, meaning that the individual going on the EMS runs experiences more burnout and feel less engagement. These findings are consistent with the increased percentage of EMS runs compared to fire runs observed in our sample.

To our knowledge, we are the first research group to evaluate safety climate in a sample that includes career, combination, and volunteer fire departments. This is important for our work on safety climate as it provides a greater understanding of the importance of investigating safety by organization type.

Limitations

There are several limitations to the current study. Within our sample we had an over-representation of career versus volunteer firefighters. This oversampling of career departments is particularly evident when looking at our analyses stratified by organization type. We observed limited associations among volunteer departments, which may be driven by the small number of volunteer departments in our sample. In future analyses, if possible, a larger sample size of volunteer fire departments is warranted to examine whether there are differences in associations in comparison with our findings. While our method reduced concerns of selection bias by sampling, it is possible that selection bias could still be present because we had an average 66% response rate at the department level.

Another limitation is that injury status was only captured at the individual level through self-report recalling injuries that occurred over the past 12 months. There is a possibility that minor injuries were not reported due to recall bias depending on when the injury occurred and when the respondent participated in our survey. Since injury was only evaluated on the individual level, the department-level mean Management Commitment and Supervisor Support scores were attributed to all individuals in the corresponding department. Thus, there is potential ecological fallacy present, which would result in a skewing of the true association. Additionally, there were a limited number of individuals that reported having an injury in the 12 months prior to completing the FOCUS survey, especially in volunteer fire departments. Thus, cautious interpretation of the logistic regression findings is warranted.

Conclusions

Our research evaluated the results from 125 fire departments that completed the FOCUS beta-test survey. Our results indicate that safety climate is positively associated with safety behavior, safety outcomes, and organizational outcomes reflecting employee well-being. There is a notable dose–response in that as a department becomes more career its Management Commitment to Safety decreases. And while we have controlled for roster size, annual call volume, and population served, our results indicate that it is not just being busy, but something else within the organization that contributes to this marked difference. Future studies should elucidate the phenomena of how Management Commitment declines as a department becomes more career-like.

Availability of data and materials

The datasets generated and analyzed during the current study are not publicly available due to conditions of the IRB but are available from the corresponding author on reasonable request.

Abbreviations

FOCUS:

Fire Service Organizational Culture of Safety survey

US:

United States

EMS:

Emergency medical services

FEMA:

Federal Emergency Management Agency

SD:

Standard deviation

EMT:

Emergency medical technician

CPSE:

Center for Public Safety Excellence

ISO:

Insurance Services Office

OR:

Odds ratio

CI:

Confidence interval

References

  • Armstrong D, Shakespeare-Finch J, Shochet I. Organizational belongingness mediates the relationship between sources of stress and posttrauma outcomes in firefighters. Psychol Trauma Theory Res Pract Policy. 2016;8(3):343–7.

    Article  Google Scholar 

  • Christian MS, Bradley JC, Wallace JC, Burke MJ. Workplace safety: a meta-analysis of the roles of person and situation factors. J Appl Psychol. 2009;94(5):1103–27.

    Article  Google Scholar 

  • Davis AL, Allen J, Shepler L, Resick C, Lee J, Marinucci R, et al. Moving FOCUS—The Fire Service Organizational Culture of Safety survey—from research to practice. J Safety Res. 2020;74:233–47.

    Article  Google Scholar 

  • Deci EL, Ryan RM. Self-determination theory. In: Van Lange PAM, Kruglanski AW, Higgins ET, editors. Handbook of theories of social psychology. New York: Sage Publications Ltd; 2012.

    Google Scholar 

  • Evarts B, Stein GP. US Fire Department Profile 2018. 2020. https://www.nfpa.org/-/media/files/News-and-Research/Fire-statistics-and-reports/Emergency-responders/osfdprofile.pdf.

  • Flin R, Mearns K, O’Connor P, Bryden R. Measuring Safety Climate: Identifying the Common Features. Safety Sci. 2000;34(1–3):177–92.

    Article  Google Scholar 

  • Gagné M, Senecal CB, Koestner R. Proximal job characteristics, feelings of empowerment, and intrinsic motivation: a multidimensional model 1. J Appl Soc Psychol. 1997;27(14):1222–40.

    Article  Google Scholar 

  • Huang YH, Lee J, McFadden AC, Murphy LA, Robertson MM, Cheung JH, et al. Beyond safety outcomes: an investigation of the impact of safety climate on job satisfaction, employee engagement and turnover using social exchange theory as the theoretical framework. Appl Ergon. 2016;55:248–57.

    Article  Google Scholar 

  • Huang YH, Sinclair RR, Lee J, McFadden AC, Cheung JH, Murphy LA. Does talking the talk matter? Effects of supervisor safety communication and safety climate on long-haul truckers’ safety performance. Accid Anal Prev. 2018;117:357–67.

    Article  Google Scholar 

  • Jeung DY, Chang SJ. Moderating Effects of Organizational Climate on the Relationship between Emotional Labor and Burnout among Korean Firefighters. Int J Environ Res Public Health. 2021;18(3):914.

    Article  Google Scholar 

  • Maslach C, Jackson SE. The measurement of experienced burnout. J Organ Behav. 1981;2(2):99–113.

    Article  Google Scholar 

  • National Fallen Firefighters Foundation. Vulnerability Assessment Program 2014. https://www.firevap.org/.

  • Schaufeli WB, Salanova M, González-Romá V, Bakker AB. The measurement of engagement and burnout: a two sample confirmatory factor analytic approach. J Happiness Stud. 2002;3(1):71–92.

    Article  Google Scholar 

  • Schwendimann R, Milne J, Frush K, Ausserhofer D, Frankel A, Sexton JB. A closer look at associations between hospital leadership walkrounds and patient safety climate and risk reduction: a cross-sectional study. Am J Med Qual. 2013;28(5):414–21.

    Article  Google Scholar 

  • Sexton JB, Helmreich RL, Neilands TB, Rowan K, Vella K, Boyden J, et al. The Safety Attitudes Questionnaire: psychometric properties, benchmarking data, and emerging research. BMC Health Serv Res. 2006;6(1):1–10.

    Article  Google Scholar 

  • Sexton JB, Adair KC, Leonard MW, Frankel TC, Proulx J, Watson SR, et al. Providing feedback following Leadership WalkRounds is associated with better patient safety culture, higher employee engagement and lower burnout. BMJ Qual Saf. 2018;27(4):261–70.

    Article  Google Scholar 

  • Smith TD. Examination of safety climate, affective organizational commitment, and safety behavior outcomes among fire service personnel. Disaster Med Public Health Prep. 2020;14(5):559–62.

    Article  Google Scholar 

  • Smith TD, DeJoy DM, Dyal MA, Pu Y, Dickinson S. Multi-level safety climate associations with safety behaviors in the fire service. J Safety Res. 2019;69:53–60.

    Article  Google Scholar 

  • Smith TD, Mullins-Jaime C, Dyal MA, DeJoy DM. Stress, burnout and diminished safety behaviors: an argument for Total Worker Health® approaches in the fire service. J Safety Res. 2020;75:189–95.

    Article  Google Scholar 

  • Taylor JA, Davis AL, Shepler L, Lee J, Cannuscio C, Zohar D, et al. Development and validation of the fire service safety climate scale. Saf Sci. 2019;118:126–44.

    Article  Google Scholar 

  • United States Fire Administration. Fire department overall run profile as reported to the national fire incident reporting system (2017). 2019. https://www.usfa.fema.gov/downloads/pdf/statistics/v20i1.pdf.

  • Yule S, Flin R, Murdy A. The role of management and safety climate in preventing risk-taking at work. Int J Risk Assess Manag. 2007;7(2):137–51.

    Article  Google Scholar 

  • Zohar D. Safety climate in industrial organizations: theoretical and applied implications. J Appl Psychol. 1980;65(1):96–102.

    Article  CAS  Google Scholar 

Download references

Acknowledgements

The Center for Firefighter Injury Research and Safety Trends (FIRST) at Drexel University thanks the 132 fire departments for their participation in the development and testing of the FOCUS beta-test survey.

The authors express gratitude to Ms. Kelly McLaughlin, MPH, for her preliminary SAS regression modeling, Ms. Gabrielle Mullin, MPH, for her assistance with statistical analysis programming support during the exploratory data analysis stage, Ms. Alexandra Fisher for her assistance with conducting quality assurance checks of the tables and results, and Fire Commissioner Adam Thiel (Philadelphia Fire Department) and Chief Rich Marinucci (Executive Director of Fire Department Safety Officers Association) for assistance with the categorization of ISO rating scores.

Funding

These data used for this study were previously obtained with the support of the FEMA FY 2011 Assistance to Firefighters Grant Program, Fire Prevention and Safety Grants EMW-2011-FP-00069 (Research and Development). FEMA had no role in study design; in the collection, analysis, and interpretation of data; in the writing of the manuscript; or in the decision to submit the article for publication.

Author information

Authors and Affiliations

Authors

Contributions

ALD and JAT contributed to the initial conception and design of the work, secured funding for the study, and conducted data collection through interviews and focus groups. AMG conducted data analysis, interpreted results, and drafted the manuscript. JL assisted with data analysis including initial data cleaning and statistical modeling support. JL and JAA contributed to the understanding of the theoretical framework and interpretation of the results. JAT oversaw the data analysis, contributed to interpretation of results, and contributed to drafting the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Ashley M. Geczik.

Ethics declarations

Ethics approval and consent to participate

The study was approved by the Drexel University IRB and received research compliance review from the Department of Homeland Security.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Geczik, A.M., Lee, J., Davis, A.L. et al. Size matters: How safety climate and downstream outcomes vary by fire department organization type. Inj. Epidemiol. 9, 11 (2022). https://doi.org/10.1186/s40621-022-00373-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s40621-022-00373-x

Keywords