The National Weather Service (NWS) is the federal agency responsible for issuing official government severe weather warnings based on meteorological forecasts. During the 2012 winter season, NWS piloted a new extreme cold warning to replace wind chill warning in eight Weather Forecast offices in South Dakota, North Dakota, Minnesota, and Arkansas. This new product was developed to augment NWS cold-weather advisories. In working with the NWS Bismarck, North Dakota, area specifically, it was noted that there was no cold-warning product available for NWS to issue during life-threatening cold temperatures with little or no wind. The existing wind chill warning is typically issued if wind conditions are > 3 mph and temperatures are −35° or −40°F. The extreme cold warning, issued for both wind and nonwind conditions, although not used for public warning in the past, has been effectively used in the NWS-Alaska Region to warn the aviation industry against frozen fuels and hydraulic lines. The new extreme cold warning for the NWS-Bismarck Weather Forecast Office was defined as either temperature or wind chill ≤ −30°F for an extended period of time over a large geographical area. For the experimentation of any new warning product, a period of public feedback is required prior to the product being officially adopted, and NWS evaluates the effectiveness of the warning product.


To assist the NWS-Bismarck Weather Forecast Office in obtaining public feedback on the new extreme cold warning piloted during 18 Jan–15 April 2012, the Centers for Disease Control and Prevention (CDC) and North Dakota Department of Health (NDDoH) conducted a population-based household survey. The goal of the survey was to determine whether residents heard and understood the new warning, and if protective behaviors were prompted by the warning during the 2012 winter.

CDC has developed the Community Assessment for Public Health Emergency Response (CASPER), which is a rapid, population-based, epidemiologic tool to assess community knowledge and needs. CASPER provides a survey method to select and interview households that are representative of the whole population using a cluster sampling methodology that can be described in the following steps: 1) define a geographic area of interest as the sampling frame; 2) within this sampling frame, select a sample of 30 clusters (areas delineated by census, usually census blocks) with “probability proportional to size”; and 3) systematically sample seven households for face-to-face interviews within each cluster.

The advantages of a CASPER methodology are that the results are generalizable and data collection is timely. The questionnaire used for the survey is usually very short—around two pages—and specifically developed for each individual CASPER. Questions are based on the goal of the survey and are typically closed-ended (e.g., yes/no, multiple choice). The goal of CASPER is to survey 210 household interviews (30 clusters × 7 households), and is typically completed in two days, with the preliminary analysis completed within 1–2 days after data collection.

To obtain public feedback on the extreme cold warning, we conducted a CASPER in Burleigh County, North Dakota, one of the locations where the extreme cold warnings were issued as an experiment during the 2012 winter. Using the CASPER cluster sampling methodology, a representative sample of 210 households in Burleigh County was selected to be interviewed. In the first stage of sampling, 30 clusters were selected with a probability proportional to the number of households in each cluster. In the second stage, the interview teams systematically sampled seven households for interview within each cluster. We conducted weighted analysis to take into account the complex sampling methodology and reported the projected number and percentage of households in Burleigh County with a particular response. The objectives of this survey were to 1) assess whether residents understood the new and existing cold weather warnings; 2) determine behaviors prompted by the warnings; and 3) identify whether NWS is meeting the preferred advance warning time among the residents of Burleigh County, North Dakota.

On 10–11 April 2012, 12 interview teams of NDDoH, CDC, and NWS staff approached 483 households, completing 188 of the 210 target interviews (completion rate = 89.5%). The majority of households were aware of cold-weather warnings and took action, regardless of the name of the warning (wind chill or extreme cold) (Table 1). The majority of the households were knowledgeable about severe cold weather; they reported concerns about the possible threats and took many forms of protective action (Table 1).

Table 1.

Key findings from CASPER in Burleigh County, North Dakota.

Key findings from CASPER in Burleigh County, North Dakota.
Key findings from CASPER in Burleigh County, North Dakota.

Television was the main information source for severe winter weather for the majority (81%) of households; interestingly, only 6% used the Internet as their main source for weather information. The most desirable warning times were 1–2 days prior to the event, followed by 6–24 h prior, consistent with NWS's established target to warn the public a day or two in advance of severe winter weather. Finally, the majority of households were “very satisfied” or “satisfied” with the NWS's warnings and forecasts in terms of four performance indicators: accuracy, timeliness, reliability, and language used.


Using CASPER, we were able to obtain feedback from Burleigh county residents on a new NWS product piloted in their geographic location. CASPERs can be used to augment public feedback provided via the Web-based survey methodology typically used by NWS to gather feedback. Web-based surveys are useful since they are inexpensive to administer and generate information quickly; however, they require the participant to have an Internet connection and typically attract “weather enthusiasts” who visit NWS web pages regularly. Therefore, Web-based survey responses may not be representative of the general public, whereas CASPERs produce generalizable results and data collection can be done quickly.

This is one of the first times NWS has partnered with public health to assess extreme-weather warnings. Collaborations for similar studies could be done in the future to assess other existing or new warnings, particularly with NWS's growing interest to add public health messaging to their warnings to improve the public response and hopefully prevent weather-related morbidity and mortality.