An Improved QC Process for Temperature in the Daily Cooperative Weather Observations

Kenneth G. Hubbard High Plains Regional Climate Center, University of Nebraska at Lincoln, Lincoln, Nebraska

Search for other papers by Kenneth G. Hubbard in
Current site
Google Scholar
PubMed
Close
,
Nathaniel B. Guttman National Climatic Data Center, Asheville, North Carolina

Search for other papers by Nathaniel B. Guttman in
Current site
Google Scholar
PubMed
Close
,
Jinsheng You High Plains Regional Climate Center, University of Nebraska at Lincoln, Lincoln, Nebraska

Search for other papers by Jinsheng You in
Current site
Google Scholar
PubMed
Close
, and
Zhirong Chen Department of Computer Science and Engineering, University of Nebraska at Lincoln, Lincoln, Nebraska

Search for other papers by Zhirong Chen in
Current site
Google Scholar
PubMed
Close
Restricted access

We are aware of a technical issue preventing figures and tables from showing in some newly published articles in the full-text HTML view.
While we are resolving the problem, please use the online PDF version of these articles to view figures and tables.

Abstract

TempVal is a spatial component of data quality assurance algorithms applied by the National Climatic Data Center (NCDC), and it has been used operationally for about 4 yr. A spatial regression test (SRT) approach was developed at the regional climate centers for climate data quality assurance and was found to be superior to currently used quality control (QC) procedures for the daily maximum and minimum air temperature. The performance of the spatial quality assessment procedures has been evaluated by assessing the rate with which seeded errors are identified. A complete dataset with seeded errors for the year 2003 for the contiguous United States was examined for both the maximum and minimum air temperature. The spatial regression quality assessment component (SRT), originating in the Automated Climate Information System (ACIS), and TempVal, originating in the NCDC database, were applied separately and evaluated through the ratio of identified seeded errors to the total number of seeds. The spatial regression test applied in the ACIS system was found to perform better in identifying the seeded errors. For all months, the relative frequency of correct identification of wrong data is 0.72 and 0.83 for TempVal and SRT, respectively. The goal of the comparison was to evaluate quality assurance techniques that could improve data quality assessment at the NCDC, and the results of the comparison led to the recommendation that the SRT be included in the NCDC quality assessment methodology.

Corresponding author address: Kenneth G. Hubbard, High Plains Regional Climate Center, University of Nebraska at Lincoln, Lincoln, NE 68583-0997. Email: khubbard@unlnotes.unl.edu

Abstract

TempVal is a spatial component of data quality assurance algorithms applied by the National Climatic Data Center (NCDC), and it has been used operationally for about 4 yr. A spatial regression test (SRT) approach was developed at the regional climate centers for climate data quality assurance and was found to be superior to currently used quality control (QC) procedures for the daily maximum and minimum air temperature. The performance of the spatial quality assessment procedures has been evaluated by assessing the rate with which seeded errors are identified. A complete dataset with seeded errors for the year 2003 for the contiguous United States was examined for both the maximum and minimum air temperature. The spatial regression quality assessment component (SRT), originating in the Automated Climate Information System (ACIS), and TempVal, originating in the NCDC database, were applied separately and evaluated through the ratio of identified seeded errors to the total number of seeds. The spatial regression test applied in the ACIS system was found to perform better in identifying the seeded errors. For all months, the relative frequency of correct identification of wrong data is 0.72 and 0.83 for TempVal and SRT, respectively. The goal of the comparison was to evaluate quality assurance techniques that could improve data quality assessment at the NCDC, and the results of the comparison led to the recommendation that the SRT be included in the NCDC quality assessment methodology.

Corresponding author address: Kenneth G. Hubbard, High Plains Regional Climate Center, University of Nebraska at Lincoln, Lincoln, NE 68583-0997. Email: khubbard@unlnotes.unl.edu

Save
  • Angel, W. E., Urzen M. L. , Del Greco S. A. , and Bodosky M. W. , 2003: Automated validation for summary of the day temperature data. Preprints, 19th Conf. on IIPS, Long Beach, CA, Amer. Meteor. Soc., CD-ROM, 15.3.

  • Barnett, V., and Lewis T. , 1994: Outliers in Statistical Data. 3d ed. Wiley and Sons, 584 pp.

  • Eischeid, J. K., Baker C. B. , Karl T. , and Diaz H. F. , 1995: The quality control of long-term climatological data using objective data analysis. J. Appl. Meteor., 34 , 27872795.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Gandin, L. S., 1988: Complex quality control of meteorological observations. Mon. Wea. Rev., 116 , 11371156.

  • Guttman, N. B., Karl C. , Reek T. , and Shuler V. , 1988: Measuring the performance of data validators. Bull. Amer. Meteor. Soc., 69 , 14481452.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Guttman, N. R., and Quayle R. G. , 1990: A review of cooperative temperature data validation. J. Atmos. Oceanic Technol., 7 , 334339.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Guttman, N. V., and Quayle R. G. , 1996: A historical perspective of U.S. climate divisions. Bull. Amer. Meteor. Soc., 77 , 293303.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Hubbard, K. G., 2001a: Multiple station quality control procedures. Automated Weather Stations for Applications in Agriculture and Water Resources Management, High Plains Regional Climate Center, Lincoln, NE, AGM-3 WMO Tech. Doc. 1074, 133–138.

  • Hubbard, K. G., 2001b: The Nebraska and High Plains Regional experience with automated weather stations. Automated Weather Stations for Applications in Agriculture and Water Resources Management, High Plains Regional Climate Center, Lincoln, NE, AGM-3 WMO Tech. Doc. 1074, 219–228.

  • Hubbard, K. G., and You J. , 2005: Sensitivity analysis of quality assurance using spatial regression approach—A case study of the maximum/minimum air temperature. J. Atmos. Oceanic Technol., 22 , 15201530.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Hubbard, K. G., DeGaetano A. T. , and Robbins K. D. , 2004: Announcing a Modern Applied Climatic Information System (ACIS). Bull. Amer. Meteor. Soc., 85 , 811812.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Hubbard, K. G., Goddard S. , Sorensen W. D. , Wells N. , and Osugi T. T. , 2005: Performance of quality assurance procedures for an applied climate information system. J. Atmos. Oceanic Technol., 22 , 105112.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Meek, D. W., and Hatfield J. L. , 1994: Data quality checking for single station meteorological databases. Agric. For. Meteor., 69 , 85109.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • National Weather Service, cited. 2000: Cooperative Observer Program (COOP). National Weather Service, Silver Spring, MD. [Available online at www.nws.noaa.gov/om/coop/Publications/coop.PDF.].

  • Reek, T., Doty S. R. , and Owen T. W. , 1992: A deterministic approach to the validation of historical daily temperature and precipitation data from the Cooperative Network. Bull. Amer. Meteor. Soc., 73 , 753762.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Shafer, M. A., Fiebrich C. A. , Arndt D. S. , Fredrickson S. E. , and Hughes T. W. , 2000: Quality assurance procedures in the Oklahoma mesonetwork. J. Atmos. Oceanic Technol., 17 , 474494.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Wade, C. G., 1987: A quality control program for surface mesometeorological data. J. Atmos. Oceanic Technol., 4 , 435453.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • You, J., and Hubbard K. G. , 2006: Quality control of weather data during extreme events. J. Atmos. Oceanic Technol., 23 , 184197.

All Time Past Year Past 30 Days
Abstract Views 0 0 0
Full Text Views 2198 1242 283
PDF Downloads 432 150 30