Performance measures offer a valuable tool in support of efforts to understand programmatic impact, benefit, and potential for improvement. Stakeholders at the state and local level are eager to benefit from the activities, programs and services being offered by the FHWA Road Weather Management Program. At the same time, the RWMP is eager to see documented evidence that they are achieving the goals set out for the program and satisfying the needs of their constituency. Reflecting early guidance from stakeholders, the eleven metrics examined in this paper are primarily directed to measuring the outcome benefits that the program is providing. But even the most carefully crafted output and outcome metrics can only approximate the concepts they seek to measure. The measures used to support the performance of the RWMP reflect a combination of quantifiable outputs (e.g., number of agencies that have acquired an MDSS, or the number of training programs conducted) and qualitative outcomes (e.g., the extent to which agencies are using MDSS more effectively throughout their jurisdiction, or the proactive incorporation of road weather information by transportation operators in decision making). In addition, other programs and factors can influence the measured outcomes, presenting a challenge to attribute observed data to the causal effects of the RWMP.
In addition, the responses of the state transportation agencies and stakeholders that are served by the RWMP offer another valuable indicator of program performance. State transportation agency stakeholders who were interviewed were asked to provide suggestions on how the RWMP could better support them. While a few respondents said they wanted more financial support from the RWMP, others sought more of what the program is already providing; namely, more opportunities to participate in programs such as the Clarus Initiative and MDSS, more long-distance learning opportunities and technology transfer given that states have severely constrained travel budgets, more direct engagement with the states in addition to channeling support through the private sector, and continued emphasis on ways to enhance and expand information flow and integrate weather into their operations. Overall, these stakeholders seemed pleased with the RWMP’s performance, with one respondent saying, “Keep doing what you’re doing.”
Based on an enhanced understanding of its past performance, the RWMP will be in a position to more effectively move the quality and benefits of the program forward. Even with this first application of the measures, clear progress toward attaining the SAFETEA-LU goals has been demonstrated, and the future forecast for improving performance of the RWMP appears bright.