Development of Skill by Students Enrolled in a Weather Forecasting Laboratory

Nicholas A. Bond Joint Institute for the Study of the Atmosphere and Ocean, University of Washington, Seattle, Washington

Search for other papers by Nicholas A. Bond in
Current site
Google Scholar
PubMed
Close
and
Clifford F. Mass Department of Atmospheric Sciences, University of Washington, Seattle, Washington

Search for other papers by Clifford F. Mass in
Current site
Google Scholar
PubMed
Close
Restricted access

Abstract

Daily values of forecast scores are evaluated for students in a weather analysis and forecasting class (ATMS 452) offered by the Department of Atmospheric Sciences of the University of Washington during the spring terms of 1997–2007. The objective of this study is to determine the rate at which senior-level undergraduate students develop proficiency at short-term (next day) weather forecasting. Separate analyses are carried out for different categories of forecast parameters. Time series of the average skill achieved over the course of the quarter are presented for the median and the best–worst two student forecasters each year. An overall improvement in student forecast skill occurs over roughly the first 6 weeks of the quarter, followed by minimal systematic changes. Negligible trends in average forecast skill have occurred over the past 10 yr. The correlation coefficient between the students’ overall forecast performance and test scores in ATMS 452 is about 0.4. The results are relevant to the design of effective instructional programs for weather forecasting.

Corresponding author address: Nicholas A. Bond, JISAO, University of Washington, Box 354925, Seattle, WA 98195-4925. Email: nab3met@u.washington.edu

Abstract

Daily values of forecast scores are evaluated for students in a weather analysis and forecasting class (ATMS 452) offered by the Department of Atmospheric Sciences of the University of Washington during the spring terms of 1997–2007. The objective of this study is to determine the rate at which senior-level undergraduate students develop proficiency at short-term (next day) weather forecasting. Separate analyses are carried out for different categories of forecast parameters. Time series of the average skill achieved over the course of the quarter are presented for the median and the best–worst two student forecasters each year. An overall improvement in student forecast skill occurs over roughly the first 6 weeks of the quarter, followed by minimal systematic changes. Negligible trends in average forecast skill have occurred over the past 10 yr. The correlation coefficient between the students’ overall forecast performance and test scores in ATMS 452 is about 0.4. The results are relevant to the design of effective instructional programs for weather forecasting.

Corresponding author address: Nicholas A. Bond, JISAO, University of Washington, Box 354925, Seattle, WA 98195-4925. Email: nab3met@u.washington.edu

Save
  • Baars, J. A., and Mass C. F. , 2005: Performance of National Weather Service forecasts compared to operational, consensus, and weighted model output statistics. Wea. Forecasting, 20 , 10341047.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Bosart, L. F., 1983: An update on trends in skill of daily forecasts of temperature and precipitation at the State University of New York at Albany. Bull. Amer. Meteor. Soc., 64 , 346354.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Doswell C. A. III, , 2004: Weather forecasting by humans: Heuristics and decision making. Wea. Forecasting, 19 , 11151126.

  • Gedzelman, S. D., 1978: Forecasting skill of beginners. Bull. Amer. Meteor. Soc., 59 , 13051309.

  • Murphy, A. H., and Epstein E. S. , 1967: A note on probability forecasts and “hedging”. J. Appl. Meteor., 6 , 10021004.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Roebber, P. J., 1998: The regime dependence of degree day forecast technique, skill, and value. Wea. Forecasting, 13 , 783794.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Roebber, P. J., 2005: Bridging the gap between theory and applications: An inquiry into atmospheric science teaching. Bull. Amer. Meteor. Soc., 86 , 507517.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Roebber, P. J., and Bosart L. F. , 1996: The contributions of education and experience to forecast skill. Wea. Forecasting, 11 , 2140.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Roebber, P. J., Schultz D. M. , Colle B. A. , and Stensrud D. J. , 2004: Toward improved prediction: High-resolution and ensemble modeling systems in operations. Wea. Forecasting, 19 , 936949.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Sanders, F., 1979: Trends in skill of daily forecasts of temperature and precipitation. Bull. Amer. Meteor. Soc., 60 , 763769.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Sanders, F., 1986: Trends in skill of Boston forecasts made at MIT, 1966–1984. Bull. Amer. Meteor. Soc., 67 , 170176.

  • Stuart, N. A., Schultz D. M. , and Klein G. , 2007: Maintaining the role of humans in the forecast process: Analyzing the psyche of expert forecasters. Bull. Amer. Meteor. Soc., 88 , 18931898.

    • Crossref
    • Search Google Scholar
    • Export Citation
All Time Past Year Past 30 Days
Abstract Views 0 0 0
Full Text Views 3296 2905 34
PDF Downloads 175 53 5